Qwen/Qwen3-235B-A22B-Thinking-2507

Text generation · served with vLLM · ↓ 17.7K downloads a month · View on Hugging Face

Weights: 470 GB
GPU memory needed: about 526.4 GB
Conversation length: 8,192 tokens
Model allows: 262,144 tokens
Memory · disk: 243.1 GB · 558 GB
Architecture: Qwen3MoeForCausalLM
Licence: apache-2.0

Versions of Qwen3 235B

The same model packaged differently: a quantized version needs less GPU memory and runs on a cheaper machine.

Version	Runtime	Weights	GPU memory	Cheapest machine now
OriginalQwen/Qwen3-235B-A22B-Thinking-2507	vLLM	470 GB	526.4 GB	$11.77/h 8x RTX PRO 6000
FP8Qwen/Qwen3-235B-A22B-Thinking-2507-FP8	vLLM	236 GB	266.7 GB	$6.17/h 4x RTX PRO 6000

Hardware and deploy

Endpoint name

$12.19/h from your balance while it runs, billed by the hour; stop it from its page. GridPup rents the machine with vLLM, which downloads the model from Hugging Face (usually ready in 10 to 15 minutes), and gives you an https address, keys and a Playground.

Loading…