Benchmark explorer.
LiveBench Research2.0 · 2026-10-14 (dataset 2026-09-02) · Higher is better
Source ↗Method
Single-run mean task score, 0–100.
Score × cost
Where performance meets price
LiveBench Research · 1M input + 250K output tokens · uncached USD
22 priced resultsPareto frontier
DeepSeek: DeepSeek V4.1 Flash ↗86.8% LiveBench Research · $0.0684 workload · Baidu · via OpenRouter
Evaluation: Effort: max · single run. Price: $0.0342 input / $0.1368 output per 1M tokens · baidu/fp8 · quantization=fp8.
Numbers match the model key. Shared positions show an index range.
Model key Score / workload
- NVIDIA: Nemotron 3.5 Lightning40% / $0.055
- DeepSeek: DeepSeek V4.1 Flash86.8% / $0.0684
- GLM-5.3-Flash70.1% / $0.0817
- OpenAI: GPT-6 Luna43.5% / $0.1125
- DeepSeek-V4.1-Flash-101779.5% / $0.135
- Google: Gemma 4 31B44.4% / $0.185
- Qwen: Qwen3.8 Flash74.6% / $0.2675
- Qwen3.8-27B59.4% / $0.3515
- DeepSeek-V4-Flash-Vision-Exp69.2% / $0.3773
- GLM-5.373.2% / $0.429
- Reflection: Beam 1.0 501B A23B72.8% / $0.50
- Xiaomi: MiMo-V2.6-Pro76.7% / $0.5828
- Step-5-Preview72.8% / $1.675
- OpenAI: GPT-6.1 Sol83.5% / $2.25
- Google: Gemini 4 Argon83.1% / $2.25
- Meta: Muse Spark Open80.3% / $2.3125
- Kimi-K379% / $2.575
- Qwen: Qwen3.8 2.4T A95B69.9% / $3.50
- Anthropic: Claude Sonnet 5.583.6% / $4.50
- Anthropic: Claude Opus 5.585% / $9.00
- OpenAI: GPT-6 Astra85.2% / $11.25
- Anthropic: Claude Fable 5.182% / $22.50
Pareto frontier
- NVIDIA: Nemotron 3.5 LightningScore40%Workload cost$0.055Darkbloom · via OpenRouter · darkbloom/int4 · quantization=int4Evaluation: Effort: max · single run. Price: $0.025 input / $0.12 output per 1M tokens · darkbloom/int4 · quantization=int4.
- DeepSeek: DeepSeek V4.1 FlashScore86.8%Workload cost$0.0684Baidu · via OpenRouter · baidu/fp8 · quantization=fp8Evaluation: Effort: max · single run. Price: $0.0342 input / $0.1368 output per 1M tokens · baidu/fp8 · quantization=fp8.
Frontier: no result is cheaper with an equal or better score, or equally priced with a better score. Each point uses its lowest generally available workload price from one endpoint; evaluation and provider configurations remain visible.
| # | Model | LiveBench Research | Configuration | API rate / unit | Source |
|---|---|---|---|---|---|
| 1 | Claude Opus 5Anthropic | 88.9% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 18, 2026 |
| 2 | Muse Wonder 1.0Meta | 88% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 18, 2026 |
| 3 | Claude Fable 5Anthropic | 86.9% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 18, 2026 |
| 4 | DeepSeek: DeepSeek V4.1 Flashdeepseek | 86.8% | Effort: max · single runIndependent result | $0.0239 in / $0.375 out/ 1M tokens · OpenInference · via OpenRouteropen-inference/fp4 · quantization=fp4 | Result ↗Oct 18, 2026 |
| 5 | Grok 4.7xAI | 86.4% | Effort: xhigh · single runIndependent result | See provider quotes | Result ↗Oct 18, 2026 |
| 6 | Grok 4.5xAI | 85.9% | Effort: xhigh · single runIndependent result | See provider quotes | Result ↗Oct 18, 2026 |
| 7 | OpenAI: GPT-6 Astraopenai | 85.2% | Effort: max · single runIndependent result | $5.00 in / $25.00 out/ 1M tokens · OpenAI · via OpenRouteropenai/flex · tier=flex · prompt ≤ 272000 tokens | Result ↗Oct 18, 2026 |
| 8 | Anthropic: Claude Opus 5.5anthropic | 85% | Effort: max · single runIndependent result | $4.00 in / $20.00 out/ 1M tokens · Amazon Bedrock · via OpenRouteramazon-bedrock | Result ↗Oct 18, 2026 |
| 9 | Grok 4.6xAI | 84.5% | Effort: xhigh · single runIndependent result | See provider quotes | Result ↗Oct 18, 2026 |
| 10 | Anthropic: Claude Sonnet 5.5anthropic | 83.6% | Effort: max · single runIndependent result | $2.00 in / $10.00 out/ 1M tokens · Amazon Bedrock · via OpenRouteramazon-bedrock | Result ↗Oct 18, 2026 |
| 11 | OpenAI: GPT-6.1 Solopenai | 83.5% | Effort: max · single runIndependent result | $1.00 in / $5.00 out/ 1M tokens · OpenAI · via OpenRouteropenai/flex · tier=flex · prompt ≤ 272000 tokens | Result ↗Oct 18, 2026 |
| 12 | Google: Gemini 4 Argongoogle | 83.1% | Effort: high · single runIndependent result | $1.00 in / $5.00 out/ 1M tokens · Google AI Studio · via OpenRoutergoogle-ai-studio/flex · tier=flex | Result ↗Oct 18, 2026 |
| 13 | Claude Sonnet 5Anthropic | 82.8% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 18, 2026 |
| 14 | Anthropic: Claude Fable 5.1anthropic | 82% | Effort: max · single runIndependent result | $10.00 in / $50.00 out/ 1M tokens · Amazon Bedrock · via OpenRouteramazon-bedrock | Result ↗Oct 18, 2026 |
| 15 | Claude Opus 4.8Anthropic | 81.8% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 18, 2026 |
| 16 | Meta: Muse Spark Openmeta | 80.3% | Effort: max · single runIndependent result | $1.25 in / $4.25 out/ 1M tokens · baseten · via Hugging Face | Result ↗Oct 18, 2026 |
| 17 | DeepSeek-V4.1-Flash-1017deepseek-ai | 79.5% | Effort: max · single runIndependent result | $0.07 in / $0.50 out/ 1M tokens · Relace · via OpenRouterrelace | Result ↗Oct 18, 2026 |
| 18 | Gemini 3.8 FlashGoogle | 79.1% | Effort: high · single runIndependent result | See provider quotes | Result ↗Oct 18, 2026 |
| 19 | Kimi-K3moonshotai | 79% | Effort: max · single runIndependent result | $0.238 in / $16.00 out/ 1M tokens · Wafer · via OpenRouterwafer · quantization=mxfp4 | Result ↗Oct 18, 2026 |
| 20 | Xiaomi: MiMo-V2.6-Proxiaomi | 76.7% | Effort: high · single runIndependent result | $0.387 in / $0.783 out/ 1M tokens · DeepInfra · via OpenRouterdeepinfra/fp8 · quantization=fp8 | Result ↗Oct 18, 2026 |
| 21 | Gemini 3.7 FlashGoogle | 76.5% | Effort: high · single runIndependent result | See provider quotes | Result ↗Oct 18, 2026 |
| 22 | Qwen: Qwen3.8 Flashqwen | 74.6% | Effort: max · single runIndependent result | $0.15 in / $0.47 out/ 1M tokens · Alibaba · via OpenRouteralibaba/us-east-1 | Result ↗Oct 18, 2026 |
| 23 | smaug-flashUnknown | 74.1% | Effort not specified · single runIndependent result | See provider quotes | Result ↗Oct 18, 2026 |
| 24 | Claude Haiku 5.5Anthropic | 73.7% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 18, 2026 |
| 25 | GLM-5.3zai-org | 73.2% | Effort: max · single runIndependent result | $0.079 in / $1.40 out/ 1M tokens · Wafer · via OpenRouterwafer/us · quantization=fp4 | Result ↗Oct 18, 2026 |
| 26 | Reflection: Beam 1.0 501B A23Breflection | 72.8% | Effort: max · single runIndependent result | $0.25 in / $1.00 out/ 1M tokens · Nebius · via OpenRouternebius/fp8 · quantization=fp8 | Result ↗Oct 18, 2026 |
| 27 | Step-5-Previewstepfun-ai | 72.8% | Effort: max · single runIndependent result | $1.00 in / $2.70 out/ 1M tokens · DeepInfra | Result ↗Oct 18, 2026 |
| 28 | Nemotron 3.5 Super VLNVIDIA | 70.9% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 18, 2026 |
| 29 | GLM-5.3-Flashzai-org | 70.1% | Effort: max · single runIndependent result | $0.0517 in / $0.12 out/ 1M tokens · OpenInference · via OpenRouteropen-inference/fp4 · quantization=fp4 | Result ↗Oct 18, 2026 |
| 30 | Qwen: Qwen3.8 2.4T A95Bqwen | 69.9% | Effort: max · single runIndependent result | $2.00 in / $6.00 out/ 1M tokens · Alibaba · via OpenRouteralibaba | Result ↗Oct 18, 2026 |
| 31 | GPT-6 SolOpenAI | 69.3% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 18, 2026 |
| 32 | DeepSeek-V4-Flash-Vision-Expdeepseek-ai | 69.2% | Effort: max · single runIndependent result | $0.2156 in / $0.6468 out/ 1M tokens · DeepInfra · via OpenRouterdeepinfra/fp8 · quantization=fp8 | Result ↗Oct 18, 2026 |
| 33 | Muse Spark 1.3Meta | 68.6% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 18, 2026 |
| 34 | MiniMax M3MiniMax | 68% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 18, 2026 |
| 35 | Muse Spark 1.2Meta | 67.7% | Effort: xhigh · single runIndependent result | See provider quotes | Result ↗Oct 18, 2026 |
| 36 | Gemini 3.1 ProGoogle | 65.7% | Effort: high · single runIndependent result | See provider quotes | Result ↗Oct 18, 2026 |
| 37 | Claude Sonnet 4.6Anthropic | 63.6% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 18, 2026 |
| 38 | GPT-5.5OpenAI | 61.6% | Effort: xhigh · single runIndependent result | See provider quotes | Result ↗Oct 18, 2026 |
| 39 | GPT-5.6 TerraOpenAI | 60.4% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 18, 2026 |
| 40 | InklingThinking Machines | 59.9% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 18, 2026 |
| 41 | Qwen3.8-27BQwen | 59.4% | Effort: max · single runIndependent result | $0.039 in / $1.25 out/ 1M tokens · Chutes · via OpenRouterchutes/fp8 · quantization=fp8 | Result ↗Oct 18, 2026 |
| 42 | GPT-5.6 SolOpenAI | 54.5% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 18, 2026 |
| 43 | GPT-5.6 LunaOpenAI | 51% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 18, 2026 |
| 44 | Google: Gemma 4 31Bgoogle | 44.4% | Effort: max · single runIndependent result | $0.10 in / $0.34 out/ 1M tokens · CoreWeave · via OpenRoutercoreweave/fp4 · quantization=fp4 | Result ↗Oct 18, 2026 |
| 45 | OpenAI: GPT-6 Lunaopenai | 43.5% | Effort: max · single runIndependent result | $0.05 in / $0.25 out/ 1M tokens · OpenAI · via OpenRouteropenai/flex · tier=flex · prompt ≤ 272000 tokens | Result ↗Oct 18, 2026 |
| 46 | Nemotron 3 UltraNVIDIA | 43.2% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 18, 2026 |
| 47 | Claude Haiku 4.5Anthropic | 42.2% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 18, 2026 |
| 48 | NVIDIA: Nemotron 3.5 Lightningnvidia | 40% | Effort: max · single runIndependent result | $0.025 in / $0.12 out/ 1M tokens · Darkbloom · via OpenRouterdarkbloom/int4 · quantization=int4 | Result ↗Oct 18, 2026 |
| 49 | Mistral Large 4Mistral AI | 28.1% | Effort: high · single runIndependent result | See provider quotes | Result ↗Oct 18, 2026 |