Qwen/Qwen2.5-VL-32B-Instruct

Vision + text · served with vLLM · ↓ 806K downloads a month · View on Hugging Face

Weights: 68 GB
GPU memory needed: about 80.5 GB
Conversation length: 8,192 tokens
Model allows: 128,000 tokens
Memory · disk: 42.1 GB · 116 GB
Architecture: Qwen2_5_VLForConditionalGeneration
Licence: apache-2.0

Versions of Qwen2.5-VL 32B

The same model packaged differently: a quantized version needs less GPU memory and runs on a cheaper machine.

Version	Runtime	Weights	GPU memory	Cheapest machine now
OriginalQwen/Qwen2.5-VL-32B-Instruct	vLLM	68 GB	80.5 GB	$0.89/h 2x Nvidia A40
AWQQwen/Qwen2.5-VL-32B-Instruct-AWQ	vLLM	21 GB	27.6 GB	$0.34/h 2x RTX 5060 Ti

Hardware and deploy

Endpoint name

$1.39/h from your balance while it runs, billed by the hour; stop it from its page. GridPup rents the machine with vLLM, which downloads the model from Hugging Face (usually ready in 10 to 15 minutes), and gives you an https address, keys and a Playground.

Loading…