Mistral Small
Mistral Small (September 17, 2024) is a 22B mid-tier model with improved reasoning, alignment, and code at about 80% lower list pricing than its predecessor in Mistral's September 2024 table.
- Input and output price
- Input $0.10, Output $0.30, Per 1M tokens
- 24h uptime
- Loading AI Gateway uptime
import { streamText } from 'ai'
const result = streamText({ model: 'mistral/mistral-small', prompt: 'Why is the sky blue?'})Copy link to headingProviders
Route requests across multiple providers. Copy a provider slug to set your preference. Visit the docs for more info. Using a provider means you agree to their terms, listed under Legal.
| Provider |
|---|
Copy link to headingPlayground
Try out Mistral Small by Mistral. Usage is billed to your team at API rates. Free users (those who haven't made a payment) get $5 of credits every 30 days.
Mistral Small
Copy link to headingUptime24 hours
Direct request success rate on AI Gateway and per-provider. Visit the docs for more info.
Copy link to headingThroughput24 hours
P50 throughput on live AI Gateway traffic, in tokens per second (TPS). Visit the docs for more info.
Copy link to headingLatency24 hours
P50 time to first token (TTFT) on live AI Gateway traffic, in milliseconds. View the docs for more info.
Copy link to headingAbout Mistral Small
Released September 17, 2024, the Mistral Small update was primarily a pricing event, with an approximately 80% reduction in input and output token pricing compared to the prior release. Simultaneous capability improvements in human alignment, reasoning, and code generation made this a significant upgrade rather than just a price cut.
At 22B parameters, Mistral Small sits between Mistral NeMo (12B) and Mistral Large 2 in the lineup Mistral described in September 2024. Mistral Small targets translation, summarization, and sentiment analysis.
The pricing cut plus capability improvements made Mistral Small a common pick for production workloads that previously ran larger, more expensive Mistral endpoints.
Copy link to headingWhat To Consider When Choosing a Provider
- Configuration: At 22B parameters, Mistral Small sits between Mistral NeMo 12B and Mistral Large 2 as a mid-point in the lineup, per Mistral's September 2024 post.
- Zero Data Retention: Zero Data Retention is available for this model. It is offered on a per-provider and model basis. See the documentation for details.
- Authentication: AI Gateway authenticates requests using an API key or OIDC token. You do not need to manage provider credentials directly.
Copy link to headingWhen to Use Mistral Small
Best for
- Translation and summarization at scale: High-volume translation, summarization, and sentiment analysis workloads
- 22B mid-tier production: Workloads that need competitive per-token pricing
- Mid-point between NeMo and Large: Applications where this capability fit is right
- Cost optimization: For workloads previously using larger Mistral models
Consider alternatives when
- Higher reasoning capability: For workloads that need more depth (consider Mistral Large 3 or Magistral)
- Tekken tokenizer compression: You need multilingual compression advantages (consider Mistral NeMo)
- Vision input: Your workload needs image input (consider Pixtral models)
Copy link to headingConclusion
Mistral Small's September 17, 2024 update cut list pricing and improved alignment, reasoning, and code quality in Mistral's post. An 80% cost reduction shipped alongside those capability changes. Mistral Small remains a fit for teams that want a 22B mid-tier model through AI Gateway.