Llama 3.1 8B

Price

Made by

Meta

Input

$0.18 per million tokens

Output

$0.35 per million tokens

Context

32K tokens

Can

Text

Use it from your code

GridPup's API speaks OpenAI's format: use any OpenAI SDK with the base URL https://api.gridpup.com/v1/ai and a GridPup API key with Also use AI models. The answer tells you what it cost. More in the API docs.

from openai import OpenAI

client = OpenAI(base_url="https://api.gridpup.com/v1/ai", api_key="gp_live_…")

r = client.chat.completions.create(
    model="@cf/meta/llama-3.1-8b-instruct-fp8",
    messages=[{"role": "user", "content": "Explain a KV cache in two sentences."}],
)
print(r.choices[0].message.content)
print("cost:", r.usage.cost_usd, "USD")

Questions

How much does Llama 3.1 8B cost?

$0.18 per million input tokens and $0.35 per million output tokens, charged per request from your prepaid balance. You need a small balance to start ($1 for most models); there is no monthly fee.

Who runs it?

Meta made Llama 3.1 8B. GridPup serves it through Cloudflare's AI Gateway, so you use it with one GridPup balance instead of an account with Meta.

Does it work with the OpenAI SDK?

Yes: set base_url to https://api.gridpup.com/v1/ai and the model to @cf/meta/llama-3.1-8b-instruct-fp8.

Similar chat and reasoning models

• Llama 3.2 1BMeta$0.033 per million input tokens
• gpt-oss 20B on GroqOpenAI$0.091 per million input tokens
• Gemma 4 26B A4BGoogle$0.12 per million input tokens
• gpt-oss 20BOpenAI$0.24 per million input tokens
• Llama 3.2 3BMeta$0.061 per million input tokens
• Qwen3 30B A3BQwen$0.061 per million input tokens

All chat and reasoning models and prices