Intelligence
9
score
Llama 3.1 Instruct 405B scores 9 (estimated) on the Artificial Analysis Intelligence Index, placing …
vs class avg: 17
Meta•Open weights•July 23, 2024
Llama 3.1 405B
Intelligence, Performance & Price Analysis
Source:Artificial Analysis scrapeType:Open weights
Speed
84.7
output tokens/sec
Llama 3.1 Instruct 405B generates output at 84.7 tokens per second (based on the median across …
Latency
2.45s
TTFT
Llama 3.1 Instruct 405B has a time to first token (TTFT) of 2. …
Input Price#43/43
$2.75
/ 1M tokens
Llama 3.1 Instruct 405B costs $2.75 per 1M input tokens (at the higher end, median: $0.60) and $6. …
Output Price#39/43
$6.50
/ 1M tokens
Llama 3.1 Instruct 405B costs $2.75 per 1M input tokens (at the higher end, median: $0.60) and $6. …
Decision Overview
Ethen's intelligence-driven routing assessment for this model
Overall verdict
Budget-friendly / task-specific model
Best for high-volume, simple, or domain-specific tasks where cost or speed matters more than deep reasoning.
Best for
- Simple Q&A
- High-throughput chat
- Classification
- Extraction
- High-value tasks where quality outweighs cost
Weak or unsuitable
- Complex reasoning
- Creative writing
- Multi-step tasks
- Routine high-volume generation
- Simple extraction or labeling
Routing recommendation
1
Lower-cost models for repetitive or high-volume work
2
Cache-backed reuse for repeated prompts
Cost pressure
Premium pricing — $2.75 / M input, $6.50 / M output. Use cheaper routes for repetitive or low-risk work.
Model-fit matrix
Use this model where capability pays for itself; route away where volume, latency, or budget dominate.
| Use case | Fit | Reason | Routing note |
|---|---|---|---|
| Complex reasoning & agentic workflows | Weak | Intelligence score 9 is better suited for straightforward tasks than multi-step reasoning. | Avoid routing complex agentic tasks to this model. |
| High-volume chat & customer-facing | Strong | Output speed 84.7 tokens/sec is adequate for chat. | Suitable for chat; monitor latency under concurrent load. |
| Latency-sensitive applications | Strong | TTFT 2.45s — adequate latency for most interactive use cases. | Suitable for real-time; test with your specific workload. |
| Cost-sensitive pipelines | Moderate | Output pricing at $6.50 is premium. Route high-volume simple tasks to cheaper alternatives. | Use only for high-value tasks; route simple queries to budget models. |
Cost pressure
HighPricing is premium — input $2.75, output $6.50. This model is expensive for high-volume or output-heavy workloads.
Cheaper substitutes
- Lower-cost models for repetitive or high-volume work
- Cache-backed reuse for repeated prompts
Route away when
- Output-heavy tasks
- High-frequency chat at scale
- Simple queries that cheaper models handle well
Highlights
Key benchmark results at a glance.
Intelligence
Intelligence position
Artificial Analysis Intelligence Index · Higher is better · Evaluation results measured independently by Artificial Analysis
Llama 3.1 Instruct 405B scores 9 (estimated) on the Artificial Analysis Intelligence Index, placing it below average among other open weight non-reasoning models of similar size (median: 17).
Speed
Speed position
Output tokens per second · Higher is better · Evaluation results measured independently by Artificial Analysis
Llama 3.1 Instruct 405B generates output at 84.7 tokens per second (based on the median across providers serving the model), which is well above average compared to other open weight non-reasoning models of similar size (median: 58.3 t/s).
Context, Cost & Pricing
Price/value position
Weighted average cost (USD) per Intelligence Index task · Lower is better · Evaluation results measured independently by Artificial Analysis
Pricing is premium — input $2.75, output $6.50. This model is expensive for high-volume or output-heavy workloads.
Intelligence & Quality
Benchmark scores and quality indices measuring model capability.
AA-Omniscience Index
AA-Omniscience Index (higher is better) measures knowledge reliability and hallucination. It rewards correct answers, penalizes hallucinations, and has no penalty for refusing to answer. Scores range from -100 to 100, where 0 means as many correct as incorrect answers, and negative scores mean more incorrect than correct. · Evaluation results measured independently by Artificial Analysis
Source and methodology are summarized below
Chart source and provenance are listed in Methodology & sources below.
Bars intentionally show many models at once so the page feels like a benchmark report rather than a dashboard.
Artificial Analysis Intelligence Index by Open Weights / Proprietary
Artificial Analysis Intelligence Index v4.1 incorporates 9 evaluations: GDPval-AA v2, 𝜏³-Banking, Terminal-Bench v2.1, SciCode, Humanity's Last Exam, GPQA Diamond, CritPt, AA-Omniscience, AA-LCR · Evaluation results measured independently by Artificial Analysis
Source and methodology are summarized below
Chart source and provenance are listed in Methodology & sources below.
Higher values indicate stronger overall capability. Bars show how models compare on composite intelligence metrics.
Artificial Analysis Intelligence Index
Artificial Analysis Intelligence Index v4.1 incorporates 9 evaluations: GDPval-AA v2, 𝜏³-Banking, Terminal-Bench v2.1, SciCode, Humanity's Last Exam, GPQA Diamond, CritPt, AA-Omniscience, AA-LCR · Evaluation results measured independently by Artificial Analysis
Source and methodology are summarized below
Chart source and provenance are listed in Methodology & sources below.
Higher values indicate stronger overall capability. Bars show how models compare on composite intelligence metrics.
Artificial Analysis Openness Index: Score
Openness Index assesses model openness on a 0 to 100 normalized scale (higher is more open) · Evaluation results measured independently by Artificial Analysis
Source and methodology are summarized below
Chart source and provenance are listed in Methodology & sources below.
Bars intentionally show many models at once so the page feels like a benchmark report rather than a dashboard.
Intelligence
Artificial Analysis Intelligence Index · Higher is better · Evaluation results measured independently by Artificial Analysis
Source and methodology are summarized below
Chart source and provenance are listed in Methodology & sources below.
Higher values indicate stronger overall capability. Bars show how models compare on composite intelligence metrics.
Speed & Throughput
Output tokens per second and generation throughput.
Output Speed
Output tokens per second · Higher is better · Evaluation results measured independently by Artificial Analysis
Source and methodology are summarized below
Chart source and provenance are listed in Methodology & sources below.
Speed should be read together with latency and cost; fast output does not always mean better user-perceived performance.
Speed
Output tokens per second · Higher is better · Evaluation results measured independently by Artificial Analysis
Source and methodology are summarized below
Chart source and provenance are listed in Methodology & sources below.
Speed should be read together with latency and cost; fast output does not always mean better user-perceived performance.
Latency & Response Time
Time to first token and end-to-end response latency.
End-to-End Response Time
Seconds to output 500 tokens, including reasoning model 'thinking' time · Lower is better · Evaluation results measured independently by Artificial Analysis
Source and methodology are summarized below
Chart source and provenance are listed in Methodology & sources below.
Bars intentionally show many models at once so the page feels like a benchmark report rather than a dashboard.
Latency: Time To First Answer Token
Seconds to first answer token received · Accounts for reasoning model 'thinking' time · Evaluation results measured independently by Artificial Analysis
Source and methodology are summarized below
Chart source and provenance are listed in Methodology & sources below.
Latency includes thinking / reasoning time when applicable. Lower is better for interactive use cases.
Context, Cost & Pricing
Context window size, cost per task, and token pricing.
Context Window
Context window: tokens limit · Higher is better · Evaluation results measured independently by Artificial Analysis
Source and methodology are summarized below
Chart source and provenance are listed in Methodology & sources below.
Larger context windows enable complex multi-turn tasks but may increase latency and cost for long inputs.
Cost per Intelligence Index Task
Weighted average cost (USD) per Artificial Analysis Intelligence Index task, segmented by token type. Lower is better · Evaluation results measured independently by Artificial Analysis
Source and methodology are summarized below
Chart source and provenance are listed in Methodology & sources below.
Higher values indicate stronger overall capability. Bars show how models compare on composite intelligence metrics.
Ethen Gateway should route away from this model when the task is simple, repetitive, or likely to generate many output tokens.
Cost per Task
Weighted average cost (USD) per Intelligence Index task · Lower is better · Evaluation results measured independently by Artificial Analysis
Source and methodology are summarized below
Chart source and provenance are listed in Methodology & sources below.
Ethen Gateway should route away from this model when the task is simple, repetitive, or likely to generate many output tokens.
Cost to Run Artificial Analysis Intelligence Index
Cost (USD) to run all evaluations in the Artificial Analysis Intelligence Index · Evaluation results measured independently by Artificial Analysis
Source and methodology are summarized below
Chart source and provenance are listed in Methodology & sources below.
Higher values indicate stronger overall capability. Bars show how models compare on composite intelligence metrics.
Ethen Gateway should route away from this model when the task is simple, repetitive, or likely to generate many output tokens.
Pricing: Cache Hit, Input, and Output
Price (USD per M Tokens) · Evaluation results measured independently by Artificial Analysis
Source and methodology are summarized below
Chart source and provenance are listed in Methodology & sources below.
Bars intentionally show many models at once so the page feels like a benchmark report rather than a dashboard.
Time per Intelligence Index Task
Weighted average decode time (minutes) per task; excludes TTFT and overhead time · Lower is better · Evaluation results measured independently by Artificial Analysis
Source and methodology are summarized below
Chart source and provenance are listed in Methodology & sources below.
Higher values indicate stronger overall capability. Bars show how models compare on composite intelligence metrics.
Architecture & Scale
Model size, parameters, and architectural details.
Model Size: Total and Active Parameters
Comparison between total model parameters and parameters active during inference · Evaluation results measured independently by Artificial Analysis
Source and methodology are summarized below
Chart source and provenance are listed in Methodology & sources below.
Larger models generally perform better but cost more to serve. Active parameter count matters for inference efficiency.
Specifications
Technical Specifications
Llama 3.1 Instruct 405B scores 9 (estimated) on the Artificial Analysis Intelligence Index, placing it below average among other open weight non-reasoning models of similar size (median: 17). Llama 3.1 Instruct 405B generates output at 84.7 tokens per second (based on the median across providers serving the model), which is well above average compared to other open weight non-reasoning models of similar size (median: 58.3 t/s). Llama 3.1 Instruct 405B costs $2.75 per 1M input tokens (at the higher end, median: $0.60) and $6.50 per 1M output tokens (at the higher end, median: $2.40), based on the median across providers serving the model.
Llama 3.1 405B
- Model type
- Open weights
- Reasoning
- No
- Input modalities
- Llama 3.1 Instruct 405B supports text only input.
- Output modalities
- Llama 3.1 Instruct 405B supports text only output.
- Context window
- 130k tokens
- Open weights / source
- Yes, Llama 3.1 Instruct 405B is open weights. The model weights are publicly available and can be downloaded for self-hosting.
- Parameters
- Llama 3.1 Instruct 405B has 405 billion parameters.
- License
- Llama 3.1 Instruct 405B is released under the LLAMA 3.1 COMMUNITY LICENSE AGREEMENT license. This license allows commercial use.
- Knowledge cutoff
- Llama 3.1 Instruct 405B has a knowledge cutoff of December 2023. The model's training data includes information up to this date.
- API availability
- Yes, Llama 3.1 Instruct 405B is available via API through 4 providers.
Methodology & Provenance
This page is rendered from the normalized profile and page JSON for Llama 3.1 405B.
Benchmark values are preserved as normalized; only layout, disclosure ordering, and typography are adjusted for readability.
Source file: md/scrape/artificial_analysis_model_pages/artificialanalysis_ai__models__llama-3-1-instruct-405b__337c1b3b5c.html · Canonical URL: https://artificialanalysis.ai/models/llama-3-1-instruct-405b
Normalized at: 2026-07-08T03:24:56+00:00 Technical specs, comparison summary, and FAQs are passed through from the normalized data without rewriting.
Ranks shown on summary cards come directly from the normalized profile. No rank or class display is synthesized in the renderer.
Visible FAQ answers and FAQ JSON-LD are emitted from the same normalized FAQ array, so structured data stays aligned with the rendered accordion.
Time per Intelligence Index Task: https://artificialanalysis.ai/models/llama-3-1-instruct-405b
Frequently Asked Questions
Llama 3.1 Instruct 405B was released on July 23, 2024.
Llama 3.1 Instruct 405B was created by Meta.
Llama 3.1 Instruct 405B scores 9 (estimated) on the Artificial Analysis Intelligence Index, placing it below average among other open weight non-reasoning models of similar size (median: 17).