Models / Inkling-Small / Inkling-Small ~266B

thinkingmachines/Inkling-Small-NVFP4

Vision + text · served with vLLM · ↓ 474.8K downloads a month · View on Hugging Face

Weights: 171 GB
GPU memory needed: about 193.5 GB
Conversation length: 8,192 tokens
Memory · disk: 93.4 GB · 228 GB
Architecture: InklingForConditionalGeneration
Licence: apache-2.0

Versions of Inkling-Small ~266B

The same model packaged differently: a quantized version needs less GPU memory and runs on a cheaper machine.

Version	Runtime	Weights	GPU memory	Cheapest machine now
Originalthinkingmachines/Inkling-Small	vLLM	532 GB	594.8 GB	$11.77/h 8x RTX PRO 6000
NVFP4thinkingmachines/Inkling-Small-NVFP4	vLLM	171 GB	193.5 GB	$4.73/h 8x RTX 5090

Hardware and deploy

Endpoint name

$6.53/h from your balance while it runs, billed by the hour; stop it from its page. GridPup rents the machine with vLLM, which downloads the model from Hugging Face (usually ready in 10 to 15 minutes), and gives you an https address, keys and a Playground.

Loading…