score
Devstral Small (Jul '25) scores 9 (estimated) on the Artificial Analysis Intelligence Index, …
vs class avg: 6
Intelligence, Performance & Price Analysis
score
Devstral Small (Jul '25) scores 9 (estimated) on the Artificial Analysis Intelligence Index, …
vs class avg: 6
output tokens/sec
Devstral Small (Jul '25) generates output at 70.2 tokens per second (based on Mistral's API), which …
TTFT
Devstral Small (Jul '25) has a time to first token (TTFT) of 1. …
/ 1M tokens
Devstral Small (Jul '25) costs $0.10 per 1M input tokens (better than average, median: $0. …
/ 1M tokens
Devstral Small (Jul '25) costs $0.10 per 1M input tokens (better than average, median: $0. …
Ethen's intelligence-driven routing assessment for this model
Overall verdict
Budget-friendly / task-specific model
Best for high-volume, simple, or domain-specific tasks where cost or speed matters more than deep reasoning.
Routing recommendation
Use the fit matrix to compare against cheaper routes when volume rises
Cost pressure
Competitive pricing — $0.10 / M input, $0.30 / M output. Cost pressure is low enough for sustained production use.
Use this model where capability pays for itself; route away where volume, latency, or budget dominate.
| Use case | Fit | Reason | Routing note |
|---|---|---|---|
| Complex reasoning & agentic workflows | Weak | Intelligence score 9 is better suited for straightforward tasks than multi-step reasoning. | Avoid routing complex agentic tasks to this model. |
| High-volume chat & customer-facing | Strong | Output speed 70.2 tokens/sec is adequate for chat. | Suitable for chat; monitor latency under concurrent load. |
| Latency-sensitive applications | Strong | TTFT 1.13s — adequate latency for most interactive use cases. | Suitable for real-time; test with your specific workload. |
| Cost-sensitive pipelines | Excellent | Output pricing at $0.30 is very competitive for high-volume workloads. | Excellent for budget-constrained pipelines; enable caching to reduce costs further. |
Cost pressure
LowPricing is competitive — input $0.10, output $0.30. Suitable for sustained production use.
No cheaper substitute is supported by the current price data.
Key benchmark results at a glance.
Intelligence
Artificial Analysis Intelligence Index · Higher is better · Evaluation results measured independently by Artificial Analysis
Devstral Small (Jul '25) scores 9 (estimated) on the Artificial Analysis Intelligence Index, placing it well above average among other open weight non-reasoning models of similar size (median: 6).
Speed
Output tokens per second · Higher is better · Evaluation results measured independently by Artificial Analysis
Devstral Small (Jul '25) generates output at 70.2 tokens per second (based on Mistral's API), which is below average compared to other open weight non-reasoning models of similar size (median: 102.7 t/s).
Context, Cost & Pricing
Weighted average cost (USD) per Intelligence Index task · Lower is better · Evaluation results measured independently by Artificial Analysis
Pricing is competitive — input $0.10, output $0.30. Suitable for sustained production use.
Benchmark scores and quality indices measuring model capability.
AA-Omniscience Index (higher is better) measures knowledge reliability and hallucination. It rewards correct answers, penalizes hallucinations, and has no penalty for refusing to answer. Scores range from -100 to 100, where 0 means as many correct as incorrect answers, and negative scores mean more incorrect than correct. · Evaluation results measured independently by Artificial Analysis
Chart source and provenance are listed in Methodology & sources below.
Artificial Analysis Intelligence Index v4.1 incorporates 9 evaluations: GDPval-AA v2, 𝜏³-Banking, Terminal-Bench v2.1, SciCode, Humanity's Last Exam, GPQA Diamond, CritPt, AA-Omniscience, AA-LCR · Evaluation results measured independently by Artificial Analysis
Chart source and provenance are listed in Methodology & sources below.
Artificial Analysis Intelligence Index v4.1 incorporates 9 evaluations: GDPval-AA v2, 𝜏³-Banking, Terminal-Bench v2.1, SciCode, Humanity's Last Exam, GPQA Diamond, CritPt, AA-Omniscience, AA-LCR · Evaluation results measured independently by Artificial Analysis
Chart source and provenance are listed in Methodology & sources below.
Openness Index assesses model openness on a 0 to 100 normalized scale (higher is more open) · Evaluation results measured independently by Artificial Analysis
Chart source and provenance are listed in Methodology & sources below.
Artificial Analysis Intelligence Index · Higher is better · Evaluation results measured independently by Artificial Analysis
Chart source and provenance are listed in Methodology & sources below.
Output tokens per second and generation throughput.
Output tokens per second · Higher is better · Evaluation results measured independently by Artificial Analysis
Chart source and provenance are listed in Methodology & sources below.
Output tokens per second · Higher is better · Evaluation results measured independently by Artificial Analysis
Chart source and provenance are listed in Methodology & sources below.
Time to first token and end-to-end response latency.
Seconds to output 500 tokens, including reasoning model 'thinking' time · Lower is better · Evaluation results measured independently by Artificial Analysis
Chart source and provenance are listed in Methodology & sources below.
Seconds to first answer token received · Accounts for reasoning model 'thinking' time · Evaluation results measured independently by Artificial Analysis
Chart source and provenance are listed in Methodology & sources below.
Context window size, cost per task, and token pricing.
Context window: tokens limit · Higher is better · Evaluation results measured independently by Artificial Analysis
Chart source and provenance are listed in Methodology & sources below.
Weighted average cost (USD) per Artificial Analysis Intelligence Index task, segmented by token type. Lower is better · Evaluation results measured independently by Artificial Analysis
Chart source and provenance are listed in Methodology & sources below.
Weighted average cost (USD) per Intelligence Index task · Lower is better · Evaluation results measured independently by Artificial Analysis
Chart source and provenance are listed in Methodology & sources below.
Cost (USD) to run all evaluations in the Artificial Analysis Intelligence Index · Evaluation results measured independently by Artificial Analysis
Chart source and provenance are listed in Methodology & sources below.
Price (USD per M Tokens) · Evaluation results measured independently by Artificial Analysis
Chart source and provenance are listed in Methodology & sources below.
Weighted average decode time (minutes) per task; excludes TTFT and overhead time · Lower is better · Evaluation results measured independently by Artificial Analysis
Chart source and provenance are listed in Methodology & sources below.
Model size, parameters, and architectural details.
Comparison between total model parameters and parameters active during inference · Evaluation results measured independently by Artificial Analysis
Chart source and provenance are listed in Methodology & sources below.
Devstral Small (Jul '25) scores 9 (estimated) on the Artificial Analysis Intelligence Index, placing it well above average among other open weight non-reasoning models of similar size (median: 6). Devstral Small (Jul '25) generates output at 70.2 tokens per second (based on Mistral's API), which is below average compared to other open weight non-reasoning models of similar size (median: 102.7 t/s). Devstral Small (Jul '25) costs $0.10 per 1M input tokens (better than average, median: $0.15) and $0.30 per 1M output tokens (better than average, median: $0.32), based on Mistral's API.
This page is rendered from the normalized profile and page JSON for Devstral Small.
Benchmark values are preserved as normalized; only layout, disclosure ordering, and typography are adjusted for readability.