Models / Laguna-S-2.1 / Laguna-S-2.1 ~118B

poolside/Laguna-S-2.1-NVFP4

Text generation · served with vLLM · ↓ 86.2K downloads a month · View on Hugging Face

Weights: 100 GB
GPU memory needed: about 114.8 GB
Conversation length: 8,192 tokens
Model allows: 1,048,576 tokens
Memory · disk: 57.8 GB · 150 GB
Architecture: LagunaForCausalLM
Licence: openmdw-1.1

Versions of Laguna-S-2.1 ~118B

The same model packaged differently: a quantized version needs less GPU memory and runs on a cheaper machine.

Version	Runtime	Weights	GPU memory	Cheapest machine now
Originalpoolside/Laguna-S-2.1	vLLM	235 GB	265.3 GB	$5.33/h 8x Nvidia A100
NVFP4poolside/Laguna-S-2.1-NVFP4	vLLM	100 GB	114.8 GB	$1.38/h 8x RTX 3090

Hardware and deploy

Endpoint name

$2.79/h from your balance while it runs, billed by the hour; stop it from its page. GridPup rents the machine with vLLM, which downloads the model from Hugging Face (usually ready in 10 to 15 minutes), and gives you an https address, keys and a Playground.

Loading…