Side by side
See the difference.
Scores, capabilities and costs for the models you’re considering.
Scroll to compare models →
| 2 models | meta-llamaMeta: Llama 3.1 8B InstructRemove × | anthropicAnthropic: Claude Opus 5.5Remove × |
|---|---|---|
| What’s different | Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to... | Always-on adaptive thinking defaults to medium effort; built for sustained work across large codebases and professional documents. |
| Date | Jul 23, 2024Listed | Sep 22, 2026Released |
API prices USD · provider configuration shown below | ||
| Listed rate | $0.02 in / $0.04 out/ 1M tokensDeepInfra · via OpenRouter · all routes ↗deepinfra/fp8 · quantization=fp8 | $4.00 in / $20.00 out/ 1M tokensAmazon Bedrock · via OpenRouter · all routes ↗amazon-bedrock |
| Provider endpoints | 6 endpoints → | 14 endpoints → |
Benchmarks Each result retains its evaluation configuration | ||
| AA Intelligence ↗4.3.2 | Not reported | 57.62 ↗Effort: max · Max, Default FallbackIndependent result |
| AA-Briefcase ↗1.1 | Not reported | 1,802.36 ↗Effort: max · Max, Default FallbackIndependent result |
| GDPval-AA ↗2.1 | Not reported | 1,866.27 ↗Effort: max · Max, Default FallbackIndependent result |
| AutomationBench-AA ↗AA Index 4.3.2 collection | Not reported | 69.54% ↗Effort: max · Max, Default FallbackIndependent result |
| Terminal-Bench 4.0 · AA ↗ | Not reported | 59.6% ↗Effort: max · Max, Default FallbackHarness unreportedIndependent result |
| SciCode ↗AA Index 4.3.2 collection | Not reported | 66.9% ↗AA · Under reviewEffort: max · Max, Default FallbackIndependent result |
| Humanity’s Last Exam ↗AA Index 4.3.2 collection | Not reported | 61.35% ↗Effort: max · Max, Default FallbackIndependent result |
| GDP.pdf ↗AA Index 4.3.2 collection | Not reported | 26.2% ↗Effort: max · Max, Default FallbackIndependent result |
| CritPt ↗AA Index 4.3.2 collection | Not reported | 31.71% ↗AA · Under reviewEffort: max · Max, Default FallbackIndependent result |
| AA-Omniscience ↗AA Index 4.3.2 collection | Not reported | 46.42 ↗Effort: max · Max, Default FallbackIndependent result |
| AA-LCR ↗1.1 | Not reported | 84.67% ↗Effort: max · Max, Default FallbackIndependent result |
| LiveBench ↗2.0 · 2026-10-14 (dataset 2026-09-02) | Not reported | 86.53% ↗Effort: max · single run · equal mean of 7 suitesIndependent result |
| LiveBench Design ↗2.0 · 2026-10-14 (dataset 2026-09-02) | Not reported | 86.9% ↗Effort: max · single runIndependent result |
| LiveBench Research ↗2.0 · 2026-10-14 (dataset 2026-09-02) | Not reported | 85% ↗Effort: max · single runIndependent result |
| LiveBench Browser Use ↗2.0 · 2026-10-14 (dataset 2026-09-02) | Not reported | 80% ↗Effort: max · single runIndependent result |
| LiveBench Coding ↗2.0 · 2026-10-14 (dataset 2026-09-02) | Not reported | 96.3% ↗Effort: max · single runIndependent result |
| LiveBench Agentic ↗2.0 · 2026-10-14 (dataset 2026-09-02) | Not reported | 85% ↗Effort: max · single runIndependent result |
| LiveBench Data Analysis ↗2.0 · 2026-10-14 (dataset 2026-09-02) | Not reported | 80.3% ↗Effort: max · single runIndependent result |
| LiveBench Reasoning ↗2.0 · 2026-10-14 (dataset 2026-09-02) | Not reported | 92.2% ↗Effort: max · single runIndependent result |
Specifications | ||
| Context window | 131.1K | 1M |
| Max output | 118K | 128K |
| Parameters | 8B | — |
| Tool calling | Supported | Supported |
| Structured output | Supported | Supported |
| Image input | Not reported | Supported |
| Reasoning | Not reported | Supported |
| Prompt caching | Supported | Supported |
| Open weights | Supported | Not reported |