Benchmarks

Intelligence Benchmark

The Intelligence Benchmark measures overall model capability using a composite of evaluations across reasoning, coding, agentic tasks, instruction following, and multimodal understanding. Scores are derived from normalized evaluations on the Ethen Intelligence Index. Higher scores indicate stronger general-purpose capability.

Speed Benchmark

The Speed Benchmark measures output token generation throughput in tokens per second. Speed is measured under standard conditions and reflects the model's raw generation efficiency. Higher throughput generally means faster responses for chat and generation-heavy workloads.

Latency Benchmark

The Latency Benchmark measures time to first answer token (TTFT), representing how quickly a model begins generating after receiving a prompt. Lower latency is critical for interactive and real-time applications. Measured values include reasoning prep time where applicable.

Pricing Benchmark

The Pricing Benchmark compares model input and output token prices. Input price is the cost per million tokens sent to the model; output price is the cost per million tokens generated. Lower prices mean more cost-effective operation at scale.

Cost Efficiency Benchmark

The Cost Efficiency Benchmark evaluates models on combined input and output pricing. This is not a single numerical score but a comparative view across both pricing dimensions, helping identify models that offer the best value for different workload profiles.

Context Window Benchmark

The Context Window Benchmark compares the maximum context length each model supports. A larger context window allows the model to process longer documents, maintain extended conversation history, and handle complex multi-turn tasks without truncation.