[Mistral](/ai-gateway/models/labs/mistral) # Ministral 8B Ministral 8B brings an interleaved sliding-window attention architecture to edge inference, delivering faster and more memory-efficient processing across its full context window of 128K tokens at $0.15 per million tokens. Your use is subject to Mistral's [Terms](https://mistral.ai/terms) & [Privacy](https://mistral.ai/terms#privacy-policy) Policies. Tool UseVision (Image) [Use with AI Gateway](https://vercel.com/d?to=%2F%5Bteam%5D%2F%7E%2Fai%3Futm_source%3Dgateway-model-page%26utm_campaign%3Dai-gateway-models&title=Get+Started+with+Vercel+AI+Gateway) [View docs](https://vercel.com/docs/ai-gateway) AI SDKChat CompletionsMessagesResponses ``` 1import { streamText } from 'ai' 2 3const result = streamText({ 4 model: 'mistral/ministral-8b', 5 prompt: 'Why is the sky blue?' 6}) ``` [Read docs](https://vercel.com/docs/ai-gateway/sdks-and-apis/ai-sdk) [Overview](/ai-gateway/models/ministral-8b) [API](/ai-gateway/models/ministral-8b/api) [About](/ai-gateway/models/ministral-8b/about) [Providers](/ai-gateway/models/ministral-8b/providers) [Throughput](/ai-gateway/models/ministral-8b/throughput) [Latency](/ai-gateway/models/ministral-8b/latency) [Uptime](/ai-gateway/models/ministral-8b/uptime) [Status](/ai-gateway/models/ministral-8b/status) [Similar](/ai-gateway/models/ministral-8b/similar) [FAQ](/ai-gateway/models/ministral-8b/faq) ## [Copy link to heading](#playground)Playground Try out Ministral 8B by Mistral. Usage is billed to your team at API rates. Free users (those who haven't made a payment) get $5 of credits every 30 days. ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75)Ministral 8B ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=96&q=75) Ministral 8B ## [Copy link to heading](#providers)Providers Route requests across multiple providers. Copy a provider slug to set your preference. Visit the [docs](/docs/ai-gateway/provider-options) for more info. Using a provider means you agree to their terms, listed under Legal. | Provider | | --- | | Context | Max Output | Latency | Throughput | Input | Output | Cache | Web Search | Capabilities | ZDR | No Training | Release Date | | | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | | ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) [Mistral](/ai-gateway/models/providers/mistral) Legal:[Terms](https://mistral.ai/terms)•[Privacy](https://mistral.ai/terms#privacy-policy) | 128K | 4K | 0.3s | 157tps | $0.15/M | $0.15/M | | — | | | | 10/16/2024 | | | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | ## [Copy link to heading](#throughput)Throughput24 hours 1W 1D P50 throughput on live AI Gateway traffic, in tokens per second (TPS). Visit the [docs](https://vercel.com/docs/ai-gateway/models-and-providers/metrics) for more info. ## [Copy link to heading](#latency)Latency24 hours 1W 1D P50 time to first token (TTFT) on live AI Gateway traffic, in milliseconds. View the [docs](https://vercel.com/docs/ai-gateway/models-and-providers/metrics) for more info. ## [Copy link to heading](#uptime)Uptime24 hours 1W 1D 1H Direct request success rate on AI Gateway and per-provider. Visit the [docs](https://vercel.com/docs/ai-gateway/models-and-providers/uptime) for more info. 1W 1D 1H ## [Copy link to heading](#more-models-by-mistral)More models by Mistral All Text Code Embed | Model | | --- | | Context | Latency | Throughput | Input | Output | Cache | Web Search | Capabilities | Providers | ZDR | No Training | Release Date | | | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | | ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) [mistral/mistral\-large-3](/ai-gateway/models/mistral-large-3) | 256K | 0.4s | 51tps | $0.50/M | $1.50/M | | — | | ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) | | | 12/02/2025 | | | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | | ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) [mistral/ministral-14b](/ai-gateway/models/ministral-14b) | 256K | 0.3s | 101tps | $0.20/M | $0.20/M | | — | | ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) | | | 12/02/2025 | | | ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) [mistral/mistral-medium](/ai-gateway/models/mistral-medium) | 128K | 0.3s | 116tps | $0.40/M | $2/M | | — | | ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) | | | 05/07/2025 | | | ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) [mistral/ministral-3b](/ai-gateway/models/ministral-3b) | 128K | 0.3s | 207tps | $0.10/M | $0.10/M | | — | | ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) | | | 10/16/2024 | | | ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) [mistral/mistral-small](/ai-gateway/models/mistral-small) | 32K | 0.4s | | $0.10/M | $0.30/M | | — | | ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) | | | 09/17/2024 | | | ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) [mistral/mistral-embed](/ai-gateway/models/mistral-embed) | | | | $0.10/M | | | — | | ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) | | | 12/11/2023 | | ## [Copy link to heading](#about-ministral-8b)About Ministral 8B Released October 16, 2024, Ministral 8B sits between the 3B and 14B models in Mistral's edge lineup. What sets Ministral 8B apart is its architecture: an interleaved sliding-window attention mechanism engineered for inference speed and memory efficiency. Standard full-attention transformers require every token to attend to every other token, scaling quadratically with sequence length. Sliding-window attention limits each token's attention span, cutting memory usage. The interleaved design alternates between full-attention and windowed layers, preserving the ability to reason over long-range dependencies while keeping the memory footprint practical. Ministral 8B uses its full context window of 128K tokens and supports function calling, knowledge retrieval, and commonsense reasoning. Ministral 8B carries dual licensing: the Mistral Commercial License for production and the Mistral Research License for non-commercial work. This offers more flexibility than the 3B variant. ## [Copy link to heading](#what-to-consider-when-choosing-a-provider)What To Consider When Choosing a Provider - Configuration: For workloads processing long documents or extended conversation histories, Ministral 8B's sliding-window architecture reduces the memory pressure typical of long-context inference. - Zero Data Retention: Zero Data Retention is available for this model. It is offered on a per-provider and model basis. See the [documentation](https://vercel.com/docs/ai-gateway/security-and-compliance/zdr) for details. - Authentication: AI Gateway authenticates requests using an [API key](https://vercel.com/docs/ai-gateway/authentication-and-byok#api-key-authentication) or [OIDC token](https://vercel.com/docs/ai-gateway/authentication-and-byok#oidc-token-authentication). You do not need to manage provider credentials directly. ## [Copy link to heading](#when-to-use-ministral-8b)When to Use Ministral 8B ### Best for - Long-context processing: Sliding-window attention keeps memory footprint manageable when processing long inputs - Deeper reasoning than 3B: Tasks requiring more depth than Ministral 3B can provide - Function calling and tool use: With better accuracy than the 3B variant - Dual licensing research use cases: Covered by the Commercial and Research licenses ### Consider alternatives when - Smallest footprint and lowest cost: You need the absolute minimum (consider Ministral 3B) - Image understanding: Vision is required (consider Ministral 14B) ## [Copy link to heading](#conclusion)Conclusion Ministral 8B earns its place through architectural innovation rather than just parameter scaling. The sliding-window attention design makes long-context inference more memory-efficient than standard transformers at this size.