Loading…
Loading…
Inkling 2 Small is a multimodal Mixture-of-Experts model from Thinking Machines Lab with 594B total and 18B active parameters and up to 1M tokens of context. It accepts text and image inputs and generates text, with built-in reasoning and tool calling. By thinkingmachines, on GridPup at $0.38 per million input tokens and $1.26 per million output tokens, paid from your GridPup balance per request. No subscription.
| A 1,000-word answer to a 200-word question | $0.0018 |
|---|---|
| 1,000 such answers | $1.78 |
| Summarising a 50-page document (25,000 words) in 500 words | $0.013 |
GridPup's API speaks OpenAI's format: use any OpenAI SDK with the base URL https://api.gridpup.com/v1/ai and a GridPup API key with Also use AI models. The answer tells you what it cost. More in the API docs.
from openai import OpenAI
client = OpenAI(base_url="https://api.gridpup.com/v1/ai", api_key="gp_live_…")
r = client.chat.completions.create(
model="@cf/thinkingmachines/inkling-2-small",
messages=[{"role": "user", "content": "Explain a KV cache in two sentences."}],
)
print(r.choices[0].message.content)
print("cost:", r.usage.cost_usd, "USD")base_url to https://api.gridpup.com/v1/ai and the model to @cf/thinkingmachines/inkling-2-small.