Llama 3.3 70B Instruct
Llama 3.3 70B Instruct is Meta's refined text-only model. It targets 405B-class results at 70B serving cost, with improved instruction following and multilingual capability.
- Input and output price
- Input $0.72, Output $0.72, Per 1M tokens
- 24h uptime
- Loading AI Gateway uptime
import { streamText } from 'ai'
const result = streamText({ model: 'meta/llama-3.3-70b', prompt: 'Why is the sky blue?'})Copy link to headingProviders
Route requests across multiple providers. Copy a provider slug to set your preference. Visit the docs for more info. Using a provider means you agree to their terms, listed under Legal.
Copy link to headingPlayground
Try out Llama 3.3 70B Instruct by Meta. Usage is billed to your team at API rates. Free users (those who haven't made a payment) get $5 of credits every 30 days.
Llama 3.3 70B Instruct
Llama 3.3 70B Instruct
Copy link to headingUptime24 hours
Direct request success rate on AI Gateway and per-provider. Visit the docs for more info.
Copy link to headingThroughput24 hours
P50 throughput on live AI Gateway traffic, in tokens per second (TPS). Visit the docs for more info.
Copy link to headingLatency24 hours
P50 time to first token (TTFT) on live AI Gateway traffic, in milliseconds. View the docs for more info.
Copy link to headingMore models by Meta
| Model |
|---|
| — | $0.01/img | — | | 08/26/2026 | ||||||||||
| 1M | 3.1 s | 138 tps | $0.10/M | $0.20/M | Read$0.002/M | — | +2 | | 08/05/2026 | |||||
| 1M | 3.0 s | 190 tps | $1.25/M | $4.25/M | Read$0.15/M | — | +2 | | 08/05/2026 | |||||
| 1M | 7.9 s | 246 tps | $1.25/M | $4.25/M | Read$0.15/M | — | +2 | | 07/09/2026 | |||||
| 1M | 2.9 s | 89 tps | $0.10/M | $0.20/M | Read$0.002/M | — | +2 | | — | |||||
| 1M | 3.6 s | 135 tps | $1.25/M | $4.25/M | Read$0.15/M | — | +2 | | — |
Copy link to headingAbout Llama 3.3 70B Instruct
Meta released Llama 3.3 70B Instruct on December 6, 2024 as the final model in its 2024 Llama release cadence. The 3.3 70B is text-only, but it represents a targeted refinement of the 70B tier. Llama 3.3 70B Instruct delivers similar performance to the 3.1 405B at a fraction of the serving cost.
The core improvements center on instruction following and multilingual capability. Instruction following (the model's ability to accurately execute detailed or constrained directions) is one of the most important capabilities in production deployments where system prompts encode complex behavioral rules. The multilingual improvements matter for enterprise applications serving global audiences: better handling of non-English instructions reduces the engineering overhead of maintaining separate language-specific prompts.
Llama Stack, which Meta standardized throughout 2024 as a set of interfaces for RAG and agentic applications, is fully compatible with the 3.3 70B. Teams already using Llama Stack distributions for toolchain orchestration can upgrade to the 3.3 generation without rearchitecting their integration layer.
Copy link to headingWhat To Consider When Choosing a Provider
- Configuration: If you're migrating from Llama 3.1 70B, test your existing prompts against 3.3 70B before you switch. Improved instruction following can change output style enough that you'll adjust prompts. Compare $0.72 and $0.72.
- Zero Data Retention: Zero Data Retention is available for this model. It is offered on a per-provider and model basis. See the documentation for details.
- Authentication: AI Gateway authenticates requests using an API key or OIDC token. You do not need to manage provider credentials directly.
Copy link to headingWhen to Use Llama 3.3 70B Instruct
Best for
- 405B quality at 70B cost: Applications that previously required the 405B for output quality but where serving a 400B+ parameter model is economically prohibitive
- Complex system prompts: Workloads depending on precise instruction following for customer support bots, structured data extraction, and multi-step reasoning chains
- Multilingual production deployments: Improved non-English instruction handling reduces prompt engineering overhead
- Upgrading from 3.1 70B: Teams that want clear quality gains without moving to a larger, more expensive model
Consider alternatives when
- Vision required: Image understanding is part of the task and 3.3 70B is text-only, so Llama 3.2 90B handles multimodal inputs
- Maximum reasoning depth: Cost is not the constraint and Llama 3.1 405B remains the largest open model
- Native multimodal architecture: Rather than adapter-based vision, consider Llama 4 Maverick or Scout
Copy link to headingConclusion
Llama 3.3 70B Instruct is the practical high-capability choice for organizations that need 405B-level instruction quality at 70B serving economics. Improved instruction following makes it well-suited to production systems with complex behavioral specifications.