Loading…
Loading…
Models / ruri-v3-pt / ruri-v3-pt 30M
Embeddings · served with ONNX Runtime · ↓ 1.3K downloads a month · View on Hugging Face
Smaller versions (8-bit, 4-bit) need less GPU memory and answer a little less precisely.
The same model packaged differently: a quantized version needs less GPU memory and runs on a cheaper machine.
| Version | Runtime | Weights | GPU memory | Cheapest machine now |
|---|---|---|---|---|
| Originalcl-nagoya/ruri-v3-pt-30m | Text Embeddings Inference | 70 MB | 1.6 GB | $0.08/h RTX 3060 |
| ruri v3 30mcl-nagoya/ruri-v3-30m | Text Embeddings Inference | 70 MB | 1.6 GB | $0.08/h RTX 3060 |
| japanese reranker xsmall v2 (hotchpotch)hotchpotch/japanese-reranker-xsmall-v2 | Text Embeddings Inference | 70 MB | 1.6 GB | $0.08/h RTX 3060 |
| ruri v3 30m ONNX (sirasagi62)sirasagi62/ruri-v3-30m-ONNX | ONNX Runtime | 40 MB | 1.1 GB | $0.08/h GTX 1660 SUPER |
| ruri v3 30m ONNX (onnx-community)onnx-community/ruri-v3-30m-ONNX | ONNX Runtime | 40 MB | 1.1 GB | $0.08/h GTX 1660 SUPER |
| japanese reranker tiny v2 (hotchpotch)hotchpotch/japanese-reranker-tiny-v2 | Text Embeddings Inference |
Deploying ONNX models from the catalog is coming soon. Today, download the files from Hugging Face and upload them in Inference.
| 60 MB |
| 1.6 GB |
| $0.08/h RTX 3060 |
Prices are per hour for the whole machine and its disk, right now. Speed is Vast's DLPerf score of the machine, relative to the cheapest. Best value: the most speed per dollar. Only machines with a Vast reliability above 95% that download at 400 Mbit/s or more are offered: the machine fetches the model itself.