Side by side
See the difference.
Scores, capabilities and costs for the models you’re considering.
Scroll to compare models →
| 3 models | OpenAIGPT-5.6 SolRemove × | stepfun-aiStep-5-PreviewRemove × | reflectionReflection: Beam 1.0 501B A23BRemove × |
|---|---|---|---|
| What’s different | Reasoning | 600B total and 27B active parameters; accepts images and video, with FP8 and BF16 weights for deployment. | Apache-2.0 text model with 501B total and 23B active parameters; ships BF16, FP8 and NVFP4 weights. |
| Date | Oct 16, 2026Discovered | Sep 18, 2026Released | Oct 16, 2026Released |
API prices USD · provider configuration shown below | |||
| Listed rate | See provider quotes | $1.00 in / $2.70 out/ 1M tokensDeepInfra · all routes ↗ | $0.25 in / $1.00 out/ 1M tokensNebius · via OpenRouter · all routes ↗nebius/fp8 · quantization=fp8 |
| Provider endpoints | 0 endpoints → | 6 endpoints → | 6 endpoints → |
Benchmarks Each result retains its evaluation configuration | |||
| AA Intelligence ↗4.3.2 | Not reported | 43.73 ↗Effort not specifiedIndependent result | 30.33 ↗Effort not specifiedIndependent result |
| AA-Briefcase ↗1.1 | Not reported | 1,424.32 ↗Effort not specifiedIndependent result | 976.2 ↗Effort not specifiedIndependent result |
| GDPval-AA ↗2.1 | Not reported | 1,586.63 ↗Effort not specifiedIndependent result | 1,177.08 ↗Effort not specifiedIndependent result |
| AutomationBench-AA ↗AA Index 4.3.2 collection | Not reported | 50.96% ↗Effort not specifiedIndependent result | 48.46% ↗Effort not specifiedIndependent result |
| Terminal-Bench 4.0 · AA ↗ | Not reported | 33.33% ↗Effort not specifiedHarness unreportedIndependent result | 3.03% ↗Effort not specifiedHarness unreportedIndependent result |
| SciCode ↗AA Index 4.3.2 collection | Not reported | 58.91% ↗AA · Under reviewEffort not specifiedIndependent result | 48.5% ↗AA · Under reviewEffort not specifiedIndependent result |
| Humanity’s Last Exam ↗AA Index 4.3.2 collection | Not reported | 46.48% ↗Effort not specifiedIndependent result | 34.66% ↗Effort not specifiedIndependent result |
| GDP.pdf ↗AA Index 4.3.2 collection | Not reported | 14.8% ↗Effort not specifiedIndependent result | 11.6% ↗Effort not specifiedIndependent result |
| CritPt ↗AA Index 4.3.2 collection | Not reported | 20.86% ↗AA · Under reviewEffort not specifiedIndependent result | 13.14% ↗AA · Under reviewEffort not specifiedIndependent result |
| AA-Omniscience ↗AA Index 4.3.2 collection | Not reported | 16.38 ↗Effort not specifiedIndependent result | 1.5 ↗Effort not specifiedIndependent result |
| AA-LCR ↗1.1 | Not reported | 88.33% ↗Effort not specifiedIndependent result | 78% ↗Effort not specifiedIndependent result |
| LiveBench ↗2.0 · 2026-10-14 (dataset 2026-09-02) | 76.26% ↗Effort: max · single run · equal mean of 7 suitesIndependent result | 62.01% ↗Effort: max · single run · equal mean of 7 suitesIndependent result | 55.5% ↗Effort: max · single run · equal mean of 7 suitesIndependent result |
| LiveBench Design ↗2.0 · 2026-10-14 (dataset 2026-09-02) | 81.6% ↗Effort: max · single runIndependent result | 76.9% ↗Effort: max · single runIndependent result | 67.9% ↗Effort: max · single runIndependent result |
| LiveBench Research ↗2.0 · 2026-10-14 (dataset 2026-09-02) | 54.5% ↗Effort: max · single runIndependent result | 72.8% ↗Effort: max · single runIndependent result | 72.8% ↗Effort: max · single runIndependent result |
| LiveBench Browser Use ↗2.0 · 2026-10-14 (dataset 2026-09-02) | 88% ↗Effort: max · single runIndependent result | 24% ↗Effort: max · single runIndependent result | 0% ↗Effort: max · single runIndependent result |
| LiveBench Coding ↗2.0 · 2026-10-14 (dataset 2026-09-02) | 89.7% ↗Effort: max · single runIndependent result | 85.6% ↗Effort: max · single runIndependent result | 83.9% ↗Effort: max · single runIndependent result |
| LiveBench Agentic ↗2.0 · 2026-10-14 (dataset 2026-09-02) | 48.5% ↗Effort: max · single runIndependent result | 27.5% ↗Effort: max · single runIndependent result | 17.3% ↗Effort: max · single runIndependent result |
| LiveBench Data Analysis ↗2.0 · 2026-10-14 (dataset 2026-09-02) | 79.8% ↗Effort: max · single runIndependent result | 63.5% ↗Effort: max · single runIndependent result | 66.4% ↗Effort: max · single runIndependent result |
| LiveBench Reasoning ↗2.0 · 2026-10-14 (dataset 2026-09-02) | 91.7% ↗Effort: max · single runIndependent result | 83.8% ↗Effort: max · single runIndependent result | 80.2% ↗Effort: max · single runIndependent result |
Specifications | |||
| Context window | — | 1M | 1M |
| Max output | — | 64K | 943.7K |
| Parameters | — | — | 501B |
| Tool calling | Not reported | Supported | Supported |
| Structured output | Not reported | Supported | Supported |
| Image input | Not reported | Supported | Not reported |
| Video input | Not reported | Supported | Not reported |
| Reasoning | Supported | Supported | Supported |
| Prompt caching | Not reported | Supported | Supported |
| Open weights | Not reported | Supported | Supported |