↓ Lower is betters TTFT287 models

Latency Leaderboard

Time to first answer token (TTFT). Lower values mean quicker initial response.

Leading models

Top 8 ranked models by latency · s TTFT

Rank order preserved
1?North Mini Code
0.30s
2GGemini 2.5 Flash-Lite
0.32s
3?Command A+
0.41s
4NNVIDIA Nemotron Nano 12B v2 VL
0.43s
5GGemini 2.5 Flash
0.49s
6xGrok Build 0.1 0616
0.54s
7xGrok 4.20 0309 v2
0.56s
8?LFM2 24B A2B
0.57s
287 models with data263 without data
RankModelProviderTypeLatency(s TTFT)
1North Mini Code
?Cohere
Open weights0.30s
2Gemini 2.5 Flash-Lite
GGoogle
Open weights0.32s
3Command A+
?Cohere
Open weights0.41s
4NVIDIA Nemotron Nano 12B v2 VL
NNVIDIA
Open weights0.43s
5Gemini 2.5 Flash
GGoogle
Open weights0.49s
6Grok Build 0.1 0616
xxAI
Open weights0.54s
7Grok 4.20 0309 v2
xxAI
Open weights0.56s
8LFM2 24B A2B
?Liquid AI
Open weights0.57s
9NVIDIA Nemotron 3 Nano
NNVIDIA
Open weights0.60s
10GPT-5.4 nano
AIOpenAI
Open weights0.61s
11GPT-4.1 nano
AIOpenAI
Open weights0.62s
12GPT-5.4 mini
AIOpenAI
Open weights0.65s
13Llama 3.2 11B (Vision)
MMeta
Open weights0.68s
14Ministral 3 3B
?Mistral
Open weights0.68s
15DeepSeek R1 Distill Llama 70B
MDeepSeek
Open weights0.71s
16GPT-5.4 (Non-reasoning)
AIOpenAI
Open weights0.71s
17Mistral Small 3.2
MiMistral
Open weights0.72s
18Grok 4.3 (Non-reasoning)
xxAI
Open weights0.73s
19Grok 3 mini Reasoning (high)
xxAI
Open weights0.74s
20Mistral Small 3.1
MiMistral
Open weights0.74s
21Mistral Small (Feb)
MiMistral
Open weights0.75s
22gpt-oss-20b (high)
AIOpenAI
Open weights0.77s
23Mistral Small 3
MiMistral
Open weights0.77s
24Mistral Small 4
MiMistral
Open weights0.78s
25Mistral Small 4
MiMistral
Open weights0.79s
26gpt-oss-120b (low)
AIOpenAI
Open weights0.80s
27Mistral Small (Sep)
MiMistral
Open weights0.80s
28Qwen3.5 4B
QAlibaba
Open weights0.80s
29GPT-4o (Nov)
AIOpenAI
Open weights0.81s
30GPT-5 (ChatGPT)
AIOpenAI
Open weights0.81s
31Ministral 3 8B
?Mistral
Open weights0.82s
32Phi-4 Multimodal
?Microsoft
Open weights0.82s
33Mistral 7B
MiMistral
Open weights0.83s
34GLM-4.7
?Z AI
Open weights0.84s
35gpt-oss-20b (low)
AIOpenAI
Open weights0.84s
36Granite 4.1 8B
?IBM
Open weights0.84s
37Llama 3.2 1B
MMeta
Open weights0.84s
38Phi-4 Mini
?Microsoft
Open weights0.84s
39Cogito v2.1
?Deep Cogito
Open weights0.85s
40Llama 4 Scout
MMeta
Open weights0.86s
41Ministral 3 14B
?Mistral
Open weights0.86s
42gpt-oss-120b (high)
AIOpenAI
Open weights0.87s
43Gemini 3.5 Flash (minimal)
GGoogle
Open weights0.88s
44Gemini 3 Flash
GGoogle
Open weights0.89s
45Claude 4.5 Haiku
AAnthropic
Open weights0.92s
46GLM-4.7
?Z AI
Open weights0.92s
47GPT-5 mini (minimal)
AIOpenAI
Open weights0.92s
48Step 3.7 Flash
?StepFun
Open weights0.92s
49GPT-4o (May)
AIOpenAI
Open weights0.93s
50GPT-5 nano (minimal)
AIOpenAI
Open weights0.94s

Page 1 of 11 · 550 results