Loading…
Loading…
Text generation · served with vLLM · ↓ 284 downloads a month · View on Hugging Face
taide/Llama3-TAIDE-LX-8B-Chat-Alpha1 needs about 21.5 GB of GPU memory for conversations of up to 8,192 tokens (an estimate: its settings are behind its licence). It runs on one RTX A5000 from $0.24/h right now; best value: RTX 5090 at $0.70/h.
The model's publisher asks users to accept its licence (other). GridPup cannot download this one yet: choose an ungated version below.
The publisher has not let GridPup download this licence-gated model yet. An ungated version of it (above) can be deployed.
The memory is estimated from the weights: GridPup cannot read this model's settings until its licence is accepted.
Prices are per hour for the whole machine and its disk, right now. Speed is Vast's DLPerf score of the machine, relative to the cheapest. Best value: the most speed per dollar. Only machines with a Vast reliability above 95% that download at 400 Mbit/s or more are offered: the machine fetches the model itself.