CohereLabs/aya-23-8B

Text generation · served with vLLM · ↓ 7.9K downloads a month · View on Hugging Face

The model's publisher asks users to accept its licence (cc-by-nc-4.0). GridPup cannot download this one yet: choose an ungated version below.

Weights: 16 GB
GPU memory needed: about 21.5 GB (estimate)
Conversation length: 8,192 tokens
Memory · disk: 16 GB · 58 GB
Architecture: CohereForCausalLM
Licence: cc-by-nc-4.0

Hardware and deploy

The publisher has not let GridPup download this licence-gated model yet. An ungated version of it (above) can be deployed.

The memory is estimated from the weights: GridPup cannot read this model's settings until its licence is accepted.

Prices are per hour for the whole machine and its disk, right now. Speed is Vast's DLPerf score of the machine, relative to the cheapest. Best value: the most speed per dollar. Only machines with a Vast reliability above 95% that download at 400 Mbit/s or more are offered: the machine fetches the model itself.

Loading…