upcube
NVIDIA•Open weights•October 15, 2024

Llama 3.1 Nemotron 70B

Intelligence, Performance & Price Analysis

Source:Artificial Analysis scrapeType:Open weights
Intelligence
8

score

Llama 3.1 Nemotron Instruct 70B scores 8 (estimated) on the Artificial Analysis Intelligence Index, …

vs class avg: 7

Speed
301.5

output tokens/sec

Llama 3.1 Nemotron Instruct 70B generates output at 301.5 tokens per second (based on the median …

Latency
5.72s

TTFT

Llama 3.1 Nemotron Instruct 70B has a time to first token (TTFT) of 5. …

Input Price#33/39
$1.20

/ 1M tokens

Llama 3.1 Nemotron Instruct 70B costs $1.20 per 1M input tokens (somewhat higher than average, …

Output Price#27/39
$1.20

/ 1M tokens

Llama 3.1 Nemotron Instruct 70B costs $1.20 per 1M input tokens (somewhat higher than average, …

Decision Overview

Ethen's intelligence-driven routing assessment for this model

Overall verdict

Budget-friendly / task-specific model

Best for high-volume, simple, or domain-specific tasks where cost or speed matters more than deep reasoning.

Best for

  • Simple Q&A
  • High-throughput chat
  • Classification
  • Extraction
  • Low-latency chat
  • High-value tasks where quality outweighs cost

Weak or unsuitable

  • Complex reasoning
  • Creative writing
  • Multi-step tasks
  • Routine high-volume generation
  • Simple extraction or labeling

Routing recommendation

1

Cheaper routes for predictable extraction, labeling, or summarization

2

Cache-backed reuse for repeated prompts

Cost pressure

Premium pricing — $1.20 / M input, $1.20 / M output. Use cheaper routes for repetitive or low-risk work.

Model-fit matrix

Use this model where capability pays for itself; route away where volume, latency, or budget dominate.

Use caseFitReasonRouting note
Complex reasoning & agentic workflowsWeakIntelligence score 8 is better suited for straightforward tasks than multi-step reasoning.Avoid routing complex agentic tasks to this model.
High-volume chat & customer-facingStrongOutput speed 301.5 tokens/sec is adequate for chat.Suitable for chat; monitor latency under concurrent load.
Latency-sensitive applicationsModerateTTFT 5.72s — latency may be noticeable in interactive use.Consider routing latency-critical paths to faster models.
Cost-sensitive pipelinesStrongOutput pricing at $1.20 is reasonable for moderate volume.Suitable for production; review costs as volume grows.

Cost pressure

High

Pricing is premium — input $1.20, output $1.20. This model is expensive for high-volume or output-heavy workloads.

Cheaper substitutes

  • Lower-cost models for repetitive or high-volume work
  • Cache-backed reuse for repeated prompts

Route away when

  • Output-heavy tasks
  • High-frequency chat at scale
  • Simple queries that cheaper models handle well

Highlights

Key benchmark results at a glance.

Intelligence

Intelligence position

Open section

Artificial Analysis Intelligence Index · Higher is better · Evaluation results measured independently by Artificial Analysis

Llama 3.1 Nemotron Instruct 70B scores 8 (estimated) on the Artificial Analysis Intelligence Index, placing it above average among other open weight non-reasoning models of similar size (median: 7).

0204060Claude Fable 5 (with fallback): 6060AClaude Fable 5 (with fal…GPT-5.5 (xhigh): 5555AIGPT-5.5 (xhigh)GLM-5.2 (max): 5151?GLM-5.2 (max)Gemini 3.5 Flash: 5050GGemini 3.5 FlashMiniMax-M3: 4444?MiniMax-M3DeepSeek V4 Pro (max): 4444DDeepSeek V4 Pro (max)Kimi K2.6: 4444KKimi K2.6Muse Spark: 4343?Muse SparkNemotron 3 Ultra: 3838NNemotron 3 UltraGrok 4.3 (high): 3838xGrok 4.3 (high)gpt-oss-120b (high): 2424AIgpt-oss-120b (high)Llama 3.1 Nemotron 70B: 7.67.6MLlama 3.1 Nemotron 70B

Speed

Speed position

Open section

Output tokens per second · Higher is better · Evaluation results measured independently by Artificial Analysis

Llama 3.1 Nemotron Instruct 70B generates output at 301.5 tokens per second (based on the median across providers serving the model), which is well above average compared to other open weight non-reasoning models of similar size (median: 81.5 t/s).

088175263350gpt-oss-120b (high): 314314AIgpt-oss-120b (high)Llama 3.1 Nemotron 70B: 301301MLlama 3.1 Nemotron 70BNemotron 3 Ultra: 250250NNemotron 3 UltraGLM-5.2 (max): 218218?GLM-5.2 (max)Gemini 3.5 Flash: 192192GGemini 3.5 FlashLing 2.6 Flash: 177177?Ling 2.6 FlashGrok 4.3 (high): 164164xGrok 4.3 (high)Llama 4 Scout: 109109MLlama 4 ScoutMiniMax-M3: 9999?MiniMax-M3Qwen3 Coder Next: 8989QQwen3 Coder NextGPT-5.5 (xhigh): 8888AIGPT-5.5 (xhigh)Llama 3.3 70B: 8686MLlama 3.3 70B

Context, Cost & Pricing

Price/value position

Open section

Weighted average cost (USD) per Intelligence Index task · Lower is better · Evaluation results measured independently by Artificial Analysis

Pricing is premium — input $1.20, output $1.20. This model is expensive for high-volume or output-heavy workloads.

$0.00$1.00$2.00$3.00$4.00$5.00DeepSeek V4 Pro (max): $0.04$0.04DDeepSeek V4 Pro (max)gpt-oss-120b (high): $0.06$0.06AIgpt-oss-120b (high)MiniMax-M3: $0.12$0.12?MiniMax-M3Grok 4.3 (high): $0.14$0.14xGrok 4.3 (high)Nemotron 3 Ultra: $0.24$0.24NNemotron 3 UltraKimi K2.6: $0.35$0.35KKimi K2.6GLM-5.2 (max): $0.37$0.37?GLM-5.2 (max)Gemini 3.5 Flash: $0.59$0.59GGemini 3.5 FlashGPT-5.5 (xhigh): $0.86$0.86AIGPT-5.5 (xhigh)Claude Fable 5 (with fallback): $2.75$2.75AClaude Fable 5 (with fal…

Intelligence & Quality

Benchmark scores and quality indices measuring model capability.

AA-Omniscience Index

AA-Omniscience Index (higher is better) measures knowledge reliability and hallucination. It rewards correct answers, penalizes hallucinations, and has no penalty for refusing to answer. Scores range from -100 to 100, where 0 means as many correct as incorrect answers, and negative scores mean more incorrect than correct. · Evaluation results measured independently by Artificial Analysis

Source and methodology are summarized below

Chart source and provenance are listed in Methodology & sources below.

-200204060Claude Fable 5 (with fallback): 4040AClaude Fable 5 (with fal…Gemini 3.5 Flash: 2323GGemini 3.5 FlashGPT-5.5 (xhigh): 2020AIGPT-5.5 (xhigh)Grok 4.3 (high): 1818xGrok 4.3 (high)Kimi K2.6: 6.46.4KKimi K2.6Muse Spark: 4.14.1?Muse SparkGLM-5.2 (max): 44?GLM-5.2 (max)MiniMax-M3: 1.41.4?MiniMax-M3Nemotron 3 Ultra: -0.8-0.8NNemotron 3 UltraDeepSeek V4 Pro (max): -10-10DDeepSeek V4 Pro (max)

Artificial Analysis Intelligence Index by Open Weights / Proprietary

Artificial Analysis Intelligence Index v4.1 incorporates 9 evaluations: GDPval-AA v2, 𝜏³-Banking, Terminal-Bench v2.1, SciCode, Humanity's Last Exam, GPQA Diamond, CritPt, AA-Omniscience, AA-LCR · Evaluation results measured independently by Artificial Analysis

Source and methodology are summarized below

Chart source and provenance are listed in Methodology & sources below.

0204060Claude Fable 5 (with fallback): 6060AClaude Fable 5 (with fal…GPT-5.5 (xhigh): 5555AIGPT-5.5 (xhigh)GLM-5.2 (max): 5151?GLM-5.2 (max)Gemini 3.5 Flash: 5050GGemini 3.5 FlashMiniMax-M3: 4444?MiniMax-M3DeepSeek V4 Pro (max): 4444DDeepSeek V4 Pro (max)Kimi K2.6: 4444KKimi K2.6Muse Spark: 4343?Muse SparkNemotron 3 Ultra: 3838NNemotron 3 UltraGrok 4.3 (high): 3838xGrok 4.3 (high)

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index v4.1 incorporates 9 evaluations: GDPval-AA v2, 𝜏³-Banking, Terminal-Bench v2.1, SciCode, Humanity's Last Exam, GPQA Diamond, CritPt, AA-Omniscience, AA-LCR · Evaluation results measured independently by Artificial Analysis

Source and methodology are summarized below

Chart source and provenance are listed in Methodology & sources below.

0204060Claude Fable 5 (with fallback): 6060AClaude Fable 5 (with fal…GPT-5.5 (xhigh): 5555AIGPT-5.5 (xhigh)GLM-5.2 (max): 5151?GLM-5.2 (max)Gemini 3.5 Flash: 5050GGemini 3.5 FlashMiniMax-M3: 4444?MiniMax-M3DeepSeek V4 Pro (max): 4444DDeepSeek V4 Pro (max)Kimi K2.6: 4444KKimi K2.6Muse Spark: 4343?Muse SparkNemotron 3 Ultra: 3838NNemotron 3 UltraGrok 4.3 (high): 3838xGrok 4.3 (high)

Artificial Analysis Openness Index: Score

Openness Index assesses model openness on a 0 to 100 normalized scale (higher is more open) · Evaluation results measured independently by Artificial Analysis

Source and methodology are summarized below

Chart source and provenance are listed in Methodology & sources below.

050100Nemotron 3 Ultra: 8383NNemotron 3 UltraDeepSeek V4 Pro (max): 5050DDeepSeek V4 Pro (max)Llama 3.1 Nemotron 70B: 4444MLlama 3.1 Nemotron 70BGLM-5.2 (max): 4444?GLM-5.2 (max)Qwen3 Coder Next: 4242QQwen3 Coder Nextgpt-oss-120b (high): 3939AIgpt-oss-120b (high)Ling 2.6 Flash: 3939?Ling 2.6 FlashLlama 3.3 70B: 3939MLlama 3.3 70BKimi K2.6: 3333KKimi K2.6MiniMax-M3: 3333?MiniMax-M3

Intelligence

Artificial Analysis Intelligence Index · Higher is better · Evaluation results measured independently by Artificial Analysis

Source and methodology are summarized below

Chart source and provenance are listed in Methodology & sources below.

0204060Claude Fable 5 (with fallback): 6060AClaude Fable 5 (with fal…GPT-5.5 (xhigh): 5555AIGPT-5.5 (xhigh)GLM-5.2 (max): 5151?GLM-5.2 (max)Gemini 3.5 Flash: 5050GGemini 3.5 FlashMiniMax-M3: 4444?MiniMax-M3DeepSeek V4 Pro (max): 4444DDeepSeek V4 Pro (max)Kimi K2.6: 4444KKimi K2.6Muse Spark: 4343?Muse SparkNemotron 3 Ultra: 3838NNemotron 3 UltraGrok 4.3 (high): 3838xGrok 4.3 (high)

Speed & Throughput

Output tokens per second and generation throughput.

Output Speed

Output tokens per second · Higher is better · Evaluation results measured independently by Artificial Analysis

Source and methodology are summarized below

Chart source and provenance are listed in Methodology & sources below.

088175263350gpt-oss-120b (high): 314314AIgpt-oss-120b (high)Llama 3.1 Nemotron 70B: 301301MLlama 3.1 Nemotron 70BNemotron 3 Ultra: 250250NNemotron 3 UltraGLM-5.2 (max): 218218?GLM-5.2 (max)Gemini 3.5 Flash: 192192GGemini 3.5 FlashLing 2.6 Flash: 177177?Ling 2.6 FlashGrok 4.3 (high): 164164xGrok 4.3 (high)Llama 4 Scout: 109109MLlama 4 ScoutMiniMax-M3: 9999?MiniMax-M3Qwen3 Coder Next: 8989QQwen3 Coder Next

Speed

Output tokens per second · Higher is better · Evaluation results measured independently by Artificial Analysis

Source and methodology are summarized below

Chart source and provenance are listed in Methodology & sources below.

088175263350gpt-oss-120b (high): 314314AIgpt-oss-120b (high)Llama 3.1 Nemotron 70B: 301301MLlama 3.1 Nemotron 70BNemotron 3 Ultra: 250250NNemotron 3 UltraGLM-5.2 (max): 218218?GLM-5.2 (max)Gemini 3.5 Flash: 192192GGemini 3.5 FlashGrok 4.3 (high): 164164xGrok 4.3 (high)MiniMax-M3: 9999?MiniMax-M3GPT-5.5 (xhigh): 8888AIGPT-5.5 (xhigh)Kimi K2.6: 7676KKimi K2.6DeepSeek V4 Pro (max): 7272DDeepSeek V4 Pro (max)

Latency & Response Time

Time to first token and end-to-end response latency.

End-to-End Response Time

Seconds to output 500 tokens, including reasoning model 'thinking' time · Lower is better · Evaluation results measured independently by Artificial Analysis

Source and methodology are summarized below

Chart source and provenance are listed in Methodology & sources below.

0s2.5s5s7.5s10sClaude Fable 5 (with fallback): 7.1s7.1sAClaude Fable 5 (with fal…DeepSeek V4 Pro (max): 7s7sDDeepSeek V4 Pro (max)Kimi K2.6: 6.6s6.6sKKimi K2.6Devstral 2: 6.6s6.6s?Devstral 2Llama 3.3 70B: 5.8s5.8sMLlama 3.3 70BGPT-5.5 (xhigh): 5.7s5.7sAIGPT-5.5 (xhigh)Qwen3 Coder Next: 5.6s5.6sQQwen3 Coder NextMiniMax-M3: 5s5s?MiniMax-M3Llama 4 Scout: 4.6s4.6sMLlama 4 ScoutGrok 4.3 (high): 3s3sxGrok 4.3 (high)

Latency: Time To First Answer Token

Seconds to first answer token received · Accounts for reasoning model 'thinking' time · Evaluation results measured independently by Artificial Analysis

Source and methodology are summarized below

Chart source and provenance are listed in Methodology & sources below.

0s25s50s75s100sDeepSeek V4 Pro (max): 61s61sDDeepSeek V4 Pro (max)Kimi K2.6: 58s58sKKimi K2.6MiniMax-M3: 20s20s?MiniMax-M3GLM-5.2 (max): 9.2s9.2s?GLM-5.2 (max)Nemotron 3 Ultra: 9.1s9.1sNNemotron 3 Ultragpt-oss-120b (high): 6.4s6.4sAIgpt-oss-120b (high)Llama 4 Scout: 0s0sMLlama 4 ScoutDevstral 2: 0s0s?Devstral 2Ling 2.6 Flash: 0s0s?Ling 2.6 FlashLlama 3.3 70B: 0s0sMLlama 3.3 70B

Context, Cost & Pricing

Context window size, cost per task, and token pricing.

Context Window

Context window: tokens limit · Higher is better · Evaluation results measured independently by Artificial Analysis

Source and methodology are summarized below

Chart source and provenance are listed in Methodology & sources below.

02.5M5M7.5M10MLlama 4 Scout: 10M10MMLlama 4 ScoutGemini 3.5 Flash: 1M1MGGemini 3.5 FlashClaude Fable 5 (with fallback): 1M1MAClaude Fable 5 (with fal…GLM-5.2 (max): 1M1M?GLM-5.2 (max)DeepSeek V4 Pro (max): 1M1MDDeepSeek V4 Pro (max)Grok 4.3 (high): 1M1MxGrok 4.3 (high)MiniMax-M3: 1M1M?MiniMax-M3GPT-5.5 (xhigh): 922k922kAIGPT-5.5 (xhigh)Nemotron 3 Ultra: 262k262kNNemotron 3 UltraMuse Spark: 262k262k?Muse Spark

Cost per Intelligence Index Task

Weighted average cost (USD) per Artificial Analysis Intelligence Index task, segmented by token type. Lower is better · Evaluation results measured independently by Artificial Analysis

Source and methodology are summarized below

Chart source and provenance are listed in Methodology & sources below.

00.51Claude Fable 5 (with fallback): 0.40.4AClaude Fable 5 (with fal…GPT-5.5 (xhigh): 0.10.1AIGPT-5.5 (xhigh)Gemini 3.5 Flash: 0.10.1GGemini 3.5 FlashGLM-5.2 (max): 00?GLM-5.2 (max)Kimi K2.6: 00KKimi K2.6Nemotron 3 Ultra: 00NNemotron 3 UltraQwen3 Coder Next: 00QQwen3 Coder NextMiniMax-M3: 00?MiniMax-M3Grok 4.3 (high): 00xGrok 4.3 (high)DeepSeek V4 Pro (max): 00DDeepSeek V4 Pro (max)

Cost per Task

Weighted average cost (USD) per Intelligence Index task · Lower is better · Evaluation results measured independently by Artificial Analysis

Source and methodology are summarized below

Chart source and provenance are listed in Methodology & sources below.

$0.00$1.00$2.00$3.00$4.00$5.00Claude Fable 5 (with fallback): $2.75$2.75AClaude Fable 5 (with fal…GPT-5.5 (xhigh): $0.86$0.86AIGPT-5.5 (xhigh)Gemini 3.5 Flash: $0.59$0.59GGemini 3.5 FlashGLM-5.2 (max): $0.37$0.37?GLM-5.2 (max)Kimi K2.6: $0.35$0.35KKimi K2.6Nemotron 3 Ultra: $0.24$0.24NNemotron 3 UltraGrok 4.3 (high): $0.14$0.14xGrok 4.3 (high)MiniMax-M3: $0.12$0.12?MiniMax-M3gpt-oss-120b (high): $0.06$0.06AIgpt-oss-120b (high)DeepSeek V4 Pro (max): $0.04$0.04DDeepSeek V4 Pro (max)

Cost to Run Artificial Analysis Intelligence Index

Cost (USD) to run all evaluations in the Artificial Analysis Intelligence Index · Evaluation results measured independently by Artificial Analysis

Source and methodology are summarized below

Chart source and provenance are listed in Methodology & sources below.

0200400600Claude Fable 5 (with fallback): 508508AClaude Fable 5 (with fal…GPT-5.5 (xhigh): 132132AIGPT-5.5 (xhigh)Gemini 3.5 Flash: 114114GGemini 3.5 FlashQwen3 Coder Next: 3939QQwen3 Coder NextNemotron 3 Ultra: 3434NNemotron 3 UltraGLM-5.2 (max): 3333?GLM-5.2 (max)Kimi K2.6: 2525KKimi K2.6MiniMax-M3: 1515?MiniMax-M3Grok 4.3 (high): 1313xGrok 4.3 (high)DeepSeek V4 Pro (max): 7.27.2DDeepSeek V4 Pro (max)

Pricing: Cache Hit, Input, and Output

Price (USD per M Tokens) · Evaluation results measured independently by Artificial Analysis

Source and methodology are summarized below

Chart source and provenance are listed in Methodology & sources below.

0250k500k750k1MClaude Fable 5 (with fallback): 6161AClaude Fable 5 (with fal…GPT-5.5 (xhigh): 3636AIGPT-5.5 (xhigh)Gemini 3.5 Flash: 1111GGemini 3.5 FlashGLM-5.2 (max): 6.16.1?GLM-5.2 (max)Kimi K2.6: 5.15.1KKimi K2.6Grok 4.3 (high): 44xGrok 4.3 (high)Nemotron 3 Ultra: 3.63.6NNemotron 3 UltraLlama 3.1 Nemotron 70B: 2.42.4MLlama 3.1 Nemotron 70BQwen3 Coder Next: 1.91.9QQwen3 Coder NextLlama 3.3 70B: 1.91.9MLlama 3.3 70Bcache Hitinputoutput

Time per Intelligence Index Task

Weighted average decode time (minutes) per task; excludes TTFT and overhead time · Lower is better · Evaluation results measured independently by Artificial Analysis

Source and methodology are summarized below

Chart source and provenance are listed in Methodology & sources below.

0510Kimi K2.6: 8.28.2KKimi K2.6DeepSeek V4 Pro (max): 6.86.8DDeepSeek V4 Pro (max)Claude Fable 5 (with fallback): 4.84.8AClaude Fable 5 (with fal…MiniMax-M3: 3.93.9?MiniMax-M3GPT-5.5 (xhigh): 33AIGPT-5.5 (xhigh)GLM-5.2 (max): 2.82.8?GLM-5.2 (max)Qwen3 Coder Next: 2.62.6QQwen3 Coder NextGemini 3.5 Flash: 2.22.2GGemini 3.5 Flashgpt-oss-120b (high): 1.91.9AIgpt-oss-120b (high)Grok 4.3 (high): 1.61.6xGrok 4.3 (high)

Architecture & Scale

Model size, parameters, and architectural details.

Model Size: Total and Active Parameters

Comparison between total model parameters and parameters active during inference · Evaluation results measured independently by Artificial Analysis

Source and methodology are summarized below

Chart source and provenance are listed in Methodology & sources below.

0250k500k750k1MDeepSeek V4 Pro (max): 1.6k1.6kDDeepSeek V4 Pro (max)Kimi K2.6: 1k1kKKimi K2.6GLM-5.2 (max): 753753?GLM-5.2 (max)Nemotron 3 Ultra: 550550NNemotron 3 UltraMiniMax-M3: 428428?MiniMax-M3Devstral 2: 125125?Devstral 2gpt-oss-120b (high): 117117AIgpt-oss-120b (high)Llama 4 Scout: 109109MLlama 4 ScoutLing 2.6 Flash: 107107?Ling 2.6 FlashQwen3 Coder Next: 8080QQwen3 Coder Nextpassive Paramsactive Params

Specifications

Technical Specifications

Llama 3.1 Nemotron Instruct 70B scores 8 (estimated) on the Artificial Analysis Intelligence Index, placing it above average among other open weight non-reasoning models of similar size (median: 7). Llama 3.1 Nemotron Instruct 70B generates output at 301.5 tokens per second (based on the median across providers serving the model), which is well above average compared to other open weight non-reasoning models of similar size (median: 81.5 t/s). Llama 3.1 Nemotron Instruct 70B costs $1.20 per 1M input tokens (somewhat higher than average, median: $0.53) and $1.20 per 1M output tokens (better than average, median: $1.05), based on the median across providers serving the model.

Llama 3.1 Nemotron 70B

Model type
Open weights
Reasoning
No
Input modalities
Llama 3.1 Nemotron Instruct 70B supports text only input.
Output modalities
Llama 3.1 Nemotron Instruct 70B supports text only output.
Context window
130k tokens
Open weights / source
Yes, Llama 3.1 Nemotron Instruct 70B is open weights. The model weights are publicly available and can be downloaded for self-hosting.
Parameters
Llama 3.1 Nemotron Instruct 70B has 70 billion parameters.
License
Llama 3.1 Nemotron Instruct 70B is released under the LLAMA 3.1 COMMUNITY LICENSE AGREEMENT license. This license allows commercial use.
Knowledge cutoff
Llama 3.1 Nemotron Instruct 70B has a knowledge cutoff of December 2023. The model's training data includes information up to this date.
API availability
Yes, Llama 3.1 Nemotron Instruct 70B is available via API through 1 provider.

Methodology & Provenance

This page is rendered from the normalized profile and page JSON for Llama 3.1 Nemotron 70B.

Benchmark values are preserved as normalized; only layout, disclosure ordering, and typography are adjusted for readability.

Frequently Asked Questions