Side by side
See the difference.
Scores, capabilities and costs for the models you’re considering.
Scroll to compare models →
| 3 models | openaiOpenAI: o3 (batch)Remove × | googleGoogle: Gemini 4 ArgonRemove × | reflectionReflection: Beam 1.0 501B A23BRemove × |
|---|---|---|---|
| What’s different | o3 is a well-rounded and powerful model across domains. It sets a new standard for math, science, coding, and visual reasoning tasks. It also excels at technical writing and instruction-following.... | Long decode can use the unified 1M-token budget for output; reads video, audio and PDFs, with implicit-only caching. | Apache-2.0 text model with 501B total and 23B active parameters; ships BF16, FP8 and NVFP4 weights. |
| Date | Apr 16, 2025Listed | Sep 30, 2026Released | Oct 16, 2026Released |
API prices USD · provider configuration shown below | |||
| Listed rate | $1.00 in / $4.00 out/ 1M tokensOpenAI · via OpenRouter · all routes ↗openai | $1.00 in / $5.00 out/ 1M tokensGoogle AI Studio · via OpenRouter · all routes ↗google-ai-studio/flex · tier=flex | $0.25 in / $1.00 out/ 1M tokensNebius · via OpenRouter · all routes ↗nebius/fp8 · quantization=fp8 |
| Provider endpoints | 2 endpoints → | 8 endpoints → | 6 endpoints → |
Benchmarks Each result retains its evaluation configuration | |||
| AA Intelligence ↗4.3.2 | Not reported | 52.56 ↗Effort: high · HighIndependent result | 30.33 ↗Effort not specifiedIndependent result |
| AA-Briefcase ↗1.1 | Not reported | 1,485.76 ↗Effort: high · HighIndependent result | 976.2 ↗Effort not specifiedIndependent result |
| GDPval-AA ↗2.1 | Not reported | 1,623.11 ↗Effort: high · HighIndependent result | 1,177.08 ↗Effort not specifiedIndependent result |
| AutomationBench-AA ↗AA Index 4.3.2 collection | Not reported | 77.51% ↗Effort: high · HighIndependent result | 48.46% ↗Effort not specifiedIndependent result |
| Terminal-Bench 4.0 · AA ↗ | Not reported | 57.07% ↗Effort: high · HighHarness unreportedIndependent result | 3.03% ↗Effort not specifiedHarness unreportedIndependent result |
| SciCode ↗AA Index 4.3.2 collection | Not reported | 61.81% ↗AA · Under reviewEffort: high · HighIndependent result | 48.5% ↗AA · Under reviewEffort not specifiedIndependent result |
| Humanity’s Last Exam ↗AA Index 4.3.2 collection | Not reported | 57.09% ↗Effort: high · HighIndependent result | 34.66% ↗Effort not specifiedIndependent result |
| GDP.pdf ↗AA Index 4.3.2 collection | Not reported | 21.8% ↗Effort: high · HighIndependent result | 11.6% ↗Effort not specifiedIndependent result |
| CritPt ↗AA Index 4.3.2 collection | Not reported | 27.14% ↗AA · Under reviewEffort: high · HighIndependent result | 13.14% ↗AA · Under reviewEffort not specifiedIndependent result |
| AA-Omniscience ↗AA Index 4.3.2 collection | Not reported | 42.35 ↗Effort: high · HighIndependent result | 1.5 ↗Effort not specifiedIndependent result |
| AA-LCR ↗1.1 | Not reported | 79.67% ↗Effort: high · HighIndependent result | 78% ↗Effort not specifiedIndependent result |
| LiveBench ↗2.0 · 2026-10-14 (dataset 2026-09-02) | Not reported | 84.1% ↗Effort: high · single run · equal mean of 7 suitesIndependent result | 55.5% ↗Effort: max · single run · equal mean of 7 suitesIndependent result |
| LiveBench Design ↗2.0 · 2026-10-14 (dataset 2026-09-02) | Not reported | 73.7% ↗Effort: high · single runIndependent result | 67.9% ↗Effort: max · single runIndependent result |
| LiveBench Research ↗2.0 · 2026-10-14 (dataset 2026-09-02) | Not reported | 83.1% ↗Effort: high · single runIndependent result | 72.8% ↗Effort: max · single runIndependent result |
| LiveBench Browser Use ↗2.0 · 2026-10-14 (dataset 2026-09-02) | Not reported | 92% ↗Effort: high · single runIndependent result | 0% ↗Effort: max · single runIndependent result |
| LiveBench Coding ↗2.0 · 2026-10-14 (dataset 2026-09-02) | Not reported | 89.7% ↗Effort: high · single runIndependent result | 83.9% ↗Effort: max · single runIndependent result |
| LiveBench Agentic ↗2.0 · 2026-10-14 (dataset 2026-09-02) | Not reported | 69.9% ↗Effort: high · single runIndependent result | 17.3% ↗Effort: max · single runIndependent result |
| LiveBench Data Analysis ↗2.0 · 2026-10-14 (dataset 2026-09-02) | Not reported | 85.2% ↗Effort: high · single runIndependent result | 66.4% ↗Effort: max · single runIndependent result |
| LiveBench Reasoning ↗2.0 · 2026-10-14 (dataset 2026-09-02) | Not reported | 95.1% ↗Effort: high · single runIndependent result | 80.2% ↗Effort: max · single runIndependent result |
Specifications | |||
| Context window | 200K | 1M | 1M |
| Max output | 100K | 943.7K | 943.7K |
| Parameters | — | — | 501B |
| Tool calling | Supported | Supported | Supported |
| Structured output | Supported | Supported | Supported |
| Image input | Supported | Supported | Not reported |
| Audio input | Not reported | Supported | Not reported |
| Video input | Not reported | Supported | Not reported |
| Reasoning | Supported | Supported | Supported |
| Prompt caching | Supported | Supported | Supported |
| Open weights | Not reported | Not reported | Supported |