Skip to main content

Pick a model, then check it against the bill

Every agent runs on one model, chosen in Setup → AI → Model or left to the organization's default. The picker offers only what the organization has turned on, so the list an author sees is the first place a provider being off shows up. AI providers is where that offering is set; this page is about choosing well within it.

Setup → AI: the model picker grouped by provider, the reasoning level, and the limits beneathSetup → AI: the model picker grouped by provider, the reasoning level, and the limits beneath

Pin or default

An agent with no model pinned runs the organization's default: the preferred catalog model if its provider is configured, otherwise the most capable model of any configured provider. The picker always shows the model the next turn will actually execute - never a stale label - and a pinned model whose provider has since been turned off stays visible, flagged as unavailable, with the remedy beside it.

Pin a model when the agent's job depends on it. Leave the default for agents whose work is routine, so that a provider change is one change.

A rough guide

WorkChoose
Routing, classification, short replies, high volumeA small fast model from the vendor you already pay
Judgement, multi-step tool use, long documentsA frontier model with a large context window
Reading imagesA model with image input - the picker's hint says which; a model without it drops the image and says so
Deterministic flow steps with no model fieldThe default model

Cost scales with tokens in and out, and a tool-heavy turn is several model rounds, each carrying the whole context again. A 1M-token window is room, not a target: Long conversations explains how a turn is trimmed to fit, and the organization can cap the window below the model's own.

Reasoning

Reasoning lets the model think before it answers. Four levels: Off answers directly and is the cost-safe default; Low, Medium and High buy a thinking budget that grows with each step, spent as output tokens. Each vendor implements it its own way - Anthropic's thinking budget, OpenAI's reasoning effort, Google's thinking budget - and a model whose vendor rejects the setting fails the turn with the vendor's own error rather than quietly ignoring it. Raise it for an agent whose mistakes are reasoning mistakes; leave it off for one whose mistakes are missing facts.

Context windows

Each catalog entry declares its window, from 8K to 1M tokens, and a per-call output ceiling derived from it. An organization-wide Context window setting caps every agent's turn below the model's own; a per-turn meter in each session shows how much of the window that turn used and what was trimmed to fit.

What it costs, honestly

Catalog prices are metadata for estimation, not a rate card: they change when vendors change them, and a model outside the catalog has no price rather than a price of zero. What you can trust is spend: Settings → Plan & usage → Cost shows managed calls as charged actuals and own-key calls as an estimate against your provider's invoice, per agent, so a model choice is something you check against evidence after a week rather than guess. See Cost & budgets.

What runs where the agent does not choose

Flow language-model steps without a selected model, conversation titles, summaries, and evaluations use the default model. The same provider availability rules apply, so turning a provider off affects these features too.