Loading…
Loading…
Models / bge-reranker-v2-m3 / bge-reranker-v2-m3 ~568M
Classification · served with ONNX Runtime · ↓ 5.2K downloads a month · View on Hugging Face
woxpas-ai/bge-reranker-v2-m3-onnx needs about 4.4 GB of GPU memory. It runs on one GTX 1660 SUPER from $0.07/h right now; best value: RTX 5090 at $0.62/h.
Smaller versions (8-bit, 4-bit) need less GPU memory and answer a little less precisely.
The same model packaged differently: a quantized version needs less GPU memory and runs on a cheaper machine.
| Version | Runtime | Weights | GPU memory | Cheapest machine now |
|---|---|---|---|---|
| OriginalBAAI/bge-reranker-v2-m3 | vLLM | 1.1 GB | 2.9 GB | $0.09/h RTX 3060 |
| ONNX (onnx-community)onnx-community/bge-reranker-v2-m3-ONNX | ONNX Runtime | 570 MB | 1.9 GB | $0.08/h GTX 1660 SUPER |
| onebrain rerank v1 (onebrain-ai)onebrain-ai/onebrain-rerank-v1 | ONNX Runtime | 570 MB | 1.9 GB | $0.08/h GTX 1660 SUPER |
| onnx (woxpas-ai)woxpas-ai/bge-reranker-v2-m3-onnx | ONNX Runtime | 570 MB | 1.9 GB | $0.08/h GTX 1660 SUPER |
| onnx (a-ivanovitch)a-ivanovitch/bge-reranker-v2-m3-onnx | ONNX Runtime | 1 MB | 1 GB | $0.08/h GTX 1660 SUPER |
| onnx int8 (Saegus)Saegus/bge-reranker-v2-m3-onnx-int8 | ONNX Runtime | 570 MB |
Deploying ONNX models from the catalog is coming soon. Today, download the files from Hugging Face and upload them in Inference.
| 1.9 GB |
| $0.08/h GTX 1660 SUPER |
Prices are per hour for the whole machine and its disk, right now. Speed is Vast's DLPerf score of the machine, relative to the cheapest. Best value: the most speed per dollar. Only machines with a Vast reliability above 95% that download at 400 Mbit/s or more are offered: the machine fetches the model itself.