Benchmark explorer.
LiveBench Browser Use2.0 · 2026-10-14 (dataset 2026-09-02) · Higher is better
Source ↗Method
Single-run mean task score, 0–100.
Score × cost
Where performance meets price
LiveBench Browser Use · 1M input + 250K output tokens · uncached USD
21 priced resultsPareto frontier
Anthropic: Claude Fable 5.1 ↗100% LiveBench Browser Use · $22.50 workload · Amazon Bedrock · via OpenRouter
Evaluation: Effort: max · single run. Price: $10.00 input / $50.00 output per 1M tokens · amazon-bedrock.
Numbers match the model key. Shared positions show an index range.
Model key Score / workload
- NVIDIA: Nemotron 3.5 Lightning0% / $0.055
- OpenAI: GPT-6 Luna72% / $0.1125
- DeepSeek: DeepSeek V4.1 Flash80% / $0.135
- GLM-5.3-Flash84% / $0.1375
- Qwen3.8-27B32% / $0.145
- Google: Gemma 4 31B4% / $0.185
- Qwen: Qwen3.8 Flash48% / $0.2675
- DeepSeek-V4-Flash-Vision-Exp64% / $0.3773
- Reflection: Beam 1.0 501B A23B0% / $0.50
- Xiaomi: MiMo-V2.6-Pro88% / $0.6475
- GLM-5.30% / $0.8763
- Step-5-Preview24% / $1.675
- Google: Gemini 4 Argon92% / $2.25
- OpenAI: GPT-6.1 Sol88% / $2.25
- Meta: Muse Spark Open36% / $2.3125
- Kimi-K316% / $2.529
- Qwen: Qwen3.8 2.4T A95B32% / $3.50
- Anthropic: Claude Sonnet 5.584% / $4.50
- Anthropic: Claude Opus 5.580% / $9.00
- OpenAI: GPT-6 Astra84% / $11.25
- Anthropic: Claude Fable 5.1100% / $22.50
Pareto frontier
- NVIDIA: Nemotron 3.5 LightningScore0%Workload cost$0.055Darkbloom · via OpenRouter · darkbloom/int4 · quantization=int4Evaluation: Effort: max · single run. Price: $0.025 input / $0.12 output per 1M tokens · darkbloom/int4 · quantization=int4.
- OpenAI: GPT-6 LunaScore72%Workload cost$0.1125OpenAI · via OpenRouter · openai/flex · tier=flex · prompt ≤ 272000 tokensEvaluation: Effort: max · single run. Price: $0.05 input / $0.25 output per 1M tokens · openai/flex · tier=flex · prompt ≤ 272000 tokens.
- DeepSeek: DeepSeek V4.1 FlashScore80%Workload cost$0.135Decart · via OpenRouter · decart/fp4 · quantization=fp4Evaluation: Effort: max · single run. Price: $0.09 input / $0.18 output per 1M tokens · decart/fp4 · quantization=fp4.
- GLM-5.3-FlashScore84%Workload cost$0.1375DeepInfra · via OpenRouter · deepinfra/fp4 · quantization=fp4Evaluation: Effort: max · single run. Price: $0.075 input / $0.25 output per 1M tokens · deepinfra/fp4 · quantization=fp4.
- Xiaomi: MiMo-V2.6-ProScore88%Workload cost$0.6475DeepInfra · via OpenRouter · deepinfra/fp8 · quantization=fp8Evaluation: Effort: high · single run. Price: $0.43 input / $0.87 output per 1M tokens · deepinfra/fp8 · quantization=fp8.
- Google: Gemini 4 ArgonScore92%Workload cost$2.25Google AI Studio · via OpenRouter · google-ai-studio/flex · tier=flexEvaluation: Effort: high · single run. Price: $1.00 input / $5.00 output per 1M tokens · google-ai-studio/flex · tier=flex.
- Anthropic: Claude Fable 5.1Score100%Workload cost$22.50Amazon Bedrock · via OpenRouter · amazon-bedrockEvaluation: Effort: max · single run. Price: $10.00 input / $50.00 output per 1M tokens · amazon-bedrock.
Frontier: no result is cheaper with an equal or better score, or equally priced with a better score. Each point uses its lowest generally available workload price from one endpoint; evaluation and provider configurations remain visible.
| # | Model | LiveBench Browser Use | Configuration | API rate / unit | Source |
|---|---|---|---|---|---|
| 1 | Anthropic: Claude Fable 5.1anthropic | 100% | Effort: max · single runIndependent result | $10.00 in / $50.00 out/ 1M tokens · Amazon Bedrock · via OpenRouteramazon-bedrock | Result ↗Oct 17, 2026 |
| 2 | Claude Opus 4.8Anthropic | 96% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 17, 2026 |
| 3 | Claude Fable 5Anthropic | 92% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 17, 2026 |
| 4 | Google: Gemini 4 Argongoogle | 92% | Effort: high · single runIndependent result | $1.00 in / $5.00 out/ 1M tokens · Google AI Studio · via OpenRoutergoogle-ai-studio/flex · tier=flex | Result ↗Oct 17, 2026 |
| 5 | GPT-6 SolOpenAI | 92% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 17, 2026 |
| 6 | Claude Haiku 5.5Anthropic | 88% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 17, 2026 |
| 7 | GPT-5.6 SolOpenAI | 88% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 17, 2026 |
| 8 | OpenAI: GPT-6.1 Solopenai | 88% | Effort: max · single runIndependent result | $1.00 in / $5.00 out/ 1M tokens · OpenAI · via OpenRouteropenai/flex · tier=flex · prompt ≤ 272000 tokens | Result ↗Oct 17, 2026 |
| 9 | Xiaomi: MiMo-V2.6-Proxiaomi | 88% | Effort: high · single runIndependent result | $0.43 in / $0.87 out/ 1M tokens · DeepInfra · via OpenRouterdeepinfra/fp8 · quantization=fp8 | Result ↗Oct 17, 2026 |
| 10 | Claude Opus 5Anthropic | 84% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 17, 2026 |
| 11 | Anthropic: Claude Sonnet 5.5anthropic | 84% | Effort: max · single runIndependent result | $2.00 in / $10.00 out/ 1M tokens · Amazon Bedrock · via OpenRouteramazon-bedrock | Result ↗Oct 17, 2026 |
| 12 | GLM-5.3-Flashzai-org | 84% | Effort: max · single runIndependent result | $0.06 in / $1.60 out/ 1M tokens · Reka · via OpenRouterreka | Result ↗Oct 17, 2026 |
| 13 | GPT-5.6 TerraOpenAI | 84% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 17, 2026 |
| 14 | OpenAI: GPT-6 Astraopenai | 84% | Effort: max · single runIndependent result | $5.00 in / $25.00 out/ 1M tokens · OpenAI · via OpenRouteropenai/flex · tier=flex · prompt ≤ 272000 tokens | Result ↗Oct 17, 2026 |
| 15 | Muse Spark 1.3Meta | 81% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 17, 2026 |
| 16 | Anthropic: Claude Opus 5.5anthropic | 80% | Effort: max · single runIndependent result | $4.00 in / $20.00 out/ 1M tokens · Amazon Bedrock · via OpenRouteramazon-bedrock | Result ↗Oct 17, 2026 |
| 17 | DeepSeek: DeepSeek V4.1 Flashdeepseek | 80% | Effort: max · single runIndependent result | $0.09 in / $0.18 out/ 1M tokens · Decart · via OpenRouterdecart/fp4 · quantization=fp4 | Result ↗Oct 17, 2026 |
| 18 | Claude Sonnet 5Anthropic | 76% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 17, 2026 |
| 19 | OpenAI: GPT-6 Lunaopenai | 72% | Effort: max · single runIndependent result | $0.05 in / $0.25 out/ 1M tokens · OpenAI · via OpenRouteropenai/flex · tier=flex · prompt ≤ 272000 tokens | Result ↗Oct 17, 2026 |
| 20 | Muse Wonder 1.0Meta | 72% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 17, 2026 |
| 21 | Claude Sonnet 4.6Anthropic | 68% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 17, 2026 |
| 22 | GPT-5.6 LunaOpenAI | 68% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 17, 2026 |
| 23 | DeepSeek-V4-Flash-Vision-Expdeepseek-ai | 64% | Effort: max · single runIndependent result | $0.2156 in / $0.6468 out/ 1M tokens · DeepInfra · via OpenRouterdeepinfra/fp8 · quantization=fp8 | Result ↗Oct 17, 2026 |
| 24 | Gemini 3.8 FlashGoogle | 64% | Effort: high · single runIndependent result | See provider quotes | Result ↗Oct 17, 2026 |
| 25 | Grok 4.6xAI | 64% | Effort: xhigh · single runIndependent result | See provider quotes | Result ↗Oct 17, 2026 |
| 26 | Grok 4.7xAI | 60% | Effort: xhigh · single runIndependent result | See provider quotes | Result ↗Oct 17, 2026 |
| 27 | Gemini 3.7 FlashGoogle | 56% | Effort: high · single runIndependent result | See provider quotes | Result ↗Oct 17, 2026 |
| 28 | GPT-5.5OpenAI | 48% | Effort: xhigh · single runIndependent result | See provider quotes | Result ↗Oct 17, 2026 |
| 29 | Qwen: Qwen3.8 Flashqwen | 48% | Effort: max · single runIndependent result | $0.15 in / $0.47 out/ 1M tokens · Alibaba · via OpenRouteralibaba/us-east-1 | Result ↗Oct 17, 2026 |
| 30 | Grok 4.5xAI | 44% | Effort: xhigh · single runIndependent result | See provider quotes | Result ↗Oct 17, 2026 |
| 31 | Claude Haiku 4.5Anthropic | 40% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 17, 2026 |
| 32 | Meta: Muse Spark Openmeta | 36% | Effort: max · single runIndependent result | $1.25 in / $4.25 out/ 1M tokens · baseten · via Hugging Face | Result ↗Oct 17, 2026 |
| 33 | Qwen3.8-27BQwen | 32% | Effort: max · single runIndependent result | $0.02 in / $0.50 out/ 1M tokens · Tenstorrent · via OpenRoutertenstorrent/fp4 · quantization=fp4 | Result ↗Oct 17, 2026 |
| 34 | Qwen: Qwen3.8 2.4T A95Bqwen | 32% | Effort: max · single runIndependent result | $2.00 in / $6.00 out/ 1M tokens · Alibaba · via OpenRouteralibaba | Result ↗Oct 17, 2026 |
| 35 | Muse Spark 1.2Meta | 29.4% | Effort: xhigh · single runIndependent result | See provider quotes | Result ↗Oct 17, 2026 |
| 36 | Step-5-Previewstepfun-ai | 24% | Effort: max · single runIndependent result | $1.00 in / $2.70 out/ 1M tokens · DeepInfra | Result ↗Oct 17, 2026 |
| 37 | InklingThinking Machines | 16% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 17, 2026 |
| 38 | Kimi-K3moonshotai | 16% | Effort: max · single runIndependent result | $0.27 in / $14.00 out/ 1M tokens · Relace · via OpenRouterrelace/fp4 · quantization=fp4 | Result ↗Oct 17, 2026 |
| 39 | MiniMax M3MiniMax | 8% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 17, 2026 |
| 40 | Mistral Large 4Mistral AI | 8% | Effort: high · single runIndependent result | See provider quotes | Result ↗Oct 17, 2026 |
| 41 | Gemini 3.1 ProGoogle | 4% | Effort: high · single runIndependent result | See provider quotes | Result ↗Oct 17, 2026 |
| 42 | Google: Gemma 4 31Bgoogle | 4% | Effort: max · single runIndependent result | $0.10 in / $0.34 out/ 1M tokens · CoreWeave · via OpenRoutercoreweave/fp4 · quantization=fp4 | Result ↗Oct 17, 2026 |
| 43 | Nemotron 3.5 Super VLNVIDIA | 4% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 17, 2026 |
| 44 | Reflection: Beam 1.0 501B A23Breflection | 0% | Effort: max · single runIndependent result | $0.25 in / $1.00 out/ 1M tokens · Nebius · via OpenRouternebius/fp8 · quantization=fp8 | Result ↗Oct 17, 2026 |
| 45 | GLM-5.3zai-org | 0% | Effort: max · single runIndependent result | $0.0632 in / $4.40 out/ 1M tokens · Relace · via OpenRouterrelace | Result ↗Oct 17, 2026 |
| 46 | Nemotron 3 UltraNVIDIA | 0% | Effort: max · single runIndependent result | See provider quotes | Result ↗Oct 17, 2026 |
| 47 | NVIDIA: Nemotron 3.5 Lightningnvidia | 0% | Effort: max · single runIndependent result | $0.025 in / $0.12 out/ 1M tokens · Darkbloom · via OpenRouterdarkbloom/int4 · quantization=int4 | Result ↗Oct 17, 2026 |
| 48 | smaug-flashUnknown | 0% | Effort not specified · single runIndependent result | See provider quotes | Result ↗Oct 17, 2026 |