How much GPU memory does zipformer_p-arabic-v3 need?

About 1.4 GB: 0.26 GB of weights and the runtime's own memory.

What is the cheapest GPU to run zipformer_p-arabic-v3?

Right now one Quadro P4000 at $0.07 an hour; RTX 5090 at $0.65 an hour is the best value for its speed. Prices are live offers from GPU clouds, checked every 15 minutes.

Can zipformer_p-arabic-v3 run on an RTX 4090?

Yes: it needs about 1.4 GB and an RTX 4090 has 24 GB.

Models / zipformer_p-arabic

Quran-Lab/zipformer_p-arabic-v3

Speech to text · served with ONNX Runtime · ↓ 434 downloads a month · View on Hugging Face

Quran-Lab/zipformer_p-arabic-v3 needs about 1.4 GB of GPU memory. It runs on one Quadro P4000 from $0.07/h right now; best value: RTX 5090 at $0.65/h.

The model's publisher asks users to accept its licence (other). GridPup cannot download this one yet: choose an ungated version below.

These ONNX files are an export for running in a browser (an audio encoder and a text decoder, each a version here): served as tensors, they do not make a transcript. For speech to text, pick the original model (for example openai/whisper-base), served with vLLM.

Weights: 260 MB
GPU memory needed: about 1.4 GB
Memory · disk: 8 GB · 30 GB
Licence: other

Versions

Smaller versions (8-bit, 4-bit) need less GPU memory and answer a little less precisely.

8-bitleft_context_probe/zipformer_p_arabic_v3.1_left128.int8.onnx70 MB · 1.1 GB GPU 8-bitleft_context_probe/zipformer_p_arabic_v3.1_left64.int8.onnx70 MB · 1.1 GB GPU full precisionleft_context_probe/zipformer_p_arabic_v3.1_left64.onnx260 MB · 1.4 GB GPU 8-bitzipformer_p_arabic_v3.1.int8.onnx70 MB · 1.1 GB GPU full precisionzipformer_p_arabic_v3.1.onnx260 MB · 1.4 GB GPU 8-bitzipformer_p_arabic_v3.int8.onnx70 MB · 1.1 GB GPU full precisionzipformer_p_arabic_v3.onnx260 MB · 1.4 GB GPU

Hardware and deploy

The publisher has not let GridPup download this licence-gated model yet. An ungated version of it (above) can be deployed.

Questions

How much GPU memory does zipformer_p-arabic-v3 need?: About 1.4 GB: 0.26 GB of weights and the runtime's own memory.
What is the cheapest GPU to run zipformer_p-arabic-v3?: Right now one Quadro P4000 at $0.07 an hour; RTX 5090 at $0.65 an hour is the best value for its speed. Prices are live offers from GPU clouds, checked every 15 minutes.
Can zipformer_p-arabic-v3 run on an RTX 4090?: Yes: it needs about 1.4 GB and an RTX 4090 has 24 GB.

Loading…