Side by side

See the difference.

Scores, capabilities and costs for the models you’re considering.

Scroll to compare models →

Comparison of gemma-3-4b-it, OpenAI: GPT-6.1 Sol, Anthropic: Claude Sonnet 5.5
3 modelsUnknowngemma-3-4b-itRemove ×openaiOpenAI: GPT-6.1 SolRemove ×anthropicAnthropic: Claude Sonnet 5.5Remove ×
What’s different131.1K context · 118K max output · Structured outputRequires Responses API for tools; offers Ultrafast inference with US or EU data residency.Tuned for quick iteration on scoped fixes and documents; Anthropic favors Opus 5.5 for open-ended work needing sustained judgment.
DateOct 16, 2026DiscoveredSep 29, 2026ReleasedSep 28, 2026Released
Listed rate$0.05 in / $0.10 out/ 1M tokensExperiential · all routes ↗Standard list rate$1.00 in / $5.00 out/ 1M tokensOpenAI · via OpenRouter · all routes ↗openai/flex · tier=flex · prompt ≤ 272000 tokens$2.00 in / $10.00 out/ 1M tokensAmazon Bedrock · via OpenRouter · all routes ↗amazon-bedrock
Provider endpoints1 endpoint →10 endpoints →11 endpoints →
AA Intelligence ↗4.3.2Not reported51.83 ↗Effort: max · MaxIndependent result56 ↗Effort: max · Max, Default FallbackIndependent result
AA-Briefcase ↗1.1Not reported1,556.34 ↗Effort: max · MaxIndependent result1,816.92 ↗Effort: max · Max, Default FallbackIndependent result
GDPval-AA ↗2.1Not reported1,592.1 ↗Effort: max · MaxIndependent result1,837.82 ↗Effort: max · Max, Default FallbackIndependent result
AutomationBench-AA ↗AA Index 4.3.2 collectionNot reported64.87% ↗Effort: max · MaxIndependent result71.77% ↗Effort: max · Max, Default FallbackIndependent result
Terminal-Bench 4.0 · AA ↗Not reported56.06% ↗Effort: max · MaxHarness unreportedIndependent result63.64% ↗Effort: max · Max, Default FallbackHarness unreportedIndependent result
SciCode ↗AA Index 4.3.2 collectionNot reported54.17% ↗AA · Under reviewEffort: max · MaxIndependent result61% ↗AA · Under reviewEffort: max · Max, Default FallbackIndependent result
Humanity’s Last Exam ↗AA Index 4.3.2 collectionNot reported52.92% ↗Effort: max · MaxIndependent result54.96% ↗Effort: max · Max, Default FallbackIndependent result
GDP.pdf ↗AA Index 4.3.2 collectionNot reported31% ↗Effort: max · MaxIndependent result25.8% ↗Effort: max · Max, Default FallbackIndependent result
CritPt ↗AA Index 4.3.2 collectionNot reported31.71% ↗AA · Under reviewEffort: max · MaxIndependent result31.43% ↗AA · Under reviewEffort: max · Max, Default FallbackIndependent result
AA-Omniscience ↗AA Index 4.3.2 collectionNot reported41.53 ↗Effort: max · MaxIndependent result32.3 ↗Effort: max · Max, Default FallbackIndependent result
AA-LCR ↗1.1Not reported83% ↗Effort: max · MaxIndependent result82.67% ↗Effort: max · Max, Default FallbackIndependent result
LiveBench ↗2.0 · 2026-10-14 (dataset 2026-09-02)Not reported85.41% ↗Effort: max · single run · equal mean of 7 suitesIndependent result82.46% ↗Effort: max · single run · equal mean of 7 suitesIndependent result
LiveBench Design ↗2.0 · 2026-10-14 (dataset 2026-09-02)Not reported82.1% ↗Effort: max · single runIndependent result85% ↗Effort: max · single runIndependent result
LiveBench Research ↗2.0 · 2026-10-14 (dataset 2026-09-02)Not reported83.5% ↗Effort: max · single runIndependent result83.6% ↗Effort: max · single runIndependent result
LiveBench Browser Use ↗2.0 · 2026-10-14 (dataset 2026-09-02)Not reported88% ↗Effort: max · single runIndependent result84% ↗Effort: max · single runIndependent result
LiveBench Coding ↗2.0 · 2026-10-14 (dataset 2026-09-02)Not reported96% ↗Effort: max · single runIndependent result94.7% ↗Effort: max · single runIndependent result
LiveBench Agentic ↗2.0 · 2026-10-14 (dataset 2026-09-02)Not reported73% ↗Effort: max · single runIndependent result78.8% ↗Effort: max · single runIndependent result
LiveBench Data Analysis ↗2.0 · 2026-10-14 (dataset 2026-09-02)Not reported82.7% ↗Effort: max · single runIndependent result59.5% ↗Effort: max · single runIndependent result
LiveBench Reasoning ↗2.0 · 2026-10-14 (dataset 2026-09-02)Not reported92.6% ↗Effort: max · single runIndependent result91.6% ↗Effort: max · single runIndependent result
Context window131.1K1.1M1M
Max output118K128K128K
Parameters———
Tool callingNot reportedSupportedSupported
Structured outputSupportedSupportedSupported
Image inputNot reportedSupportedSupported
ReasoningNot reportedSupportedSupported
Prompt cachingNot reportedSupportedSupported

Add another model

Search all models →