Models / LFM2 / LFM2 1.2B

LiquidAI/LFM2-1.2B-RAG

Text generation · served with vLLM · ↓ 721 downloads a month · View on Hugging Face

Weights: 2.3 GB
GPU memory needed: about 5.1 GB
Conversation length: 8,192 tokens
Model allows: 128,000 tokens
Memory · disk: 16 GB · 43 GB
Architecture: Lfm2ForCausalLM
Licence: other

Versions of LFM2 1.2B

The same model packaged differently: a quantized version needs less GPU memory and runs on a cheaper machine.

Version	Runtime	Weights	GPU memory	Cheapest machine now
OriginalLiquidAI/LFM2-1.2B	vLLM	2.3 GB	5.1 GB	$0.10/h RTX 3060
ToolLiquidAI/LFM2-1.2B-Tool	vLLM	2.3 GB	5.1 GB	$0.10/h RTX 3060
ExtractLiquidAI/LFM2-1.2B-Extract	vLLM	2.3 GB	5.1 GB	$0.10/h RTX 3060
RAGLiquidAI/LFM2-1.2B-RAG	vLLM	2.3 GB	5.1 GB	$0.10/h RTX 3060

Hardware and deploy

Endpoint name

$0.63/h from your balance while it runs, billed by the hour; stop it from its page. GridPup rents the machine with vLLM, which downloads the model from Hugging Face (usually ready in 10 to 15 minutes), and gives you an https address, keys and a Playground.

Loading…