AI Model Benchmarks & Pricing: 2026

Since this was written, OpenRouter's model feed lists Claude Fable 5.2 in place of Claude Fable 5 and Claude Fable 5.1; DeepSeek V4 Pro 0813 in place of DeepSeek V4 Pro; DeepSeek V4.1 Flash 1017 in place of DeepSeek V4.1 Flash; Gemini 4 Carbon in place of Gemini 2.5 Pro and Gemini 3.1 Pro Preview; 1 more model too.

The definitive benchmark and cost comparison for every frontier AI model, updated for 2026.

Gemini 3.1 Pro scores 94.3% on GPQA Diamond. Claude Opus 5.5 scores 67.7% on Humanity's Last Exam with tools, and Claude Fable 5 topped the September Chatbot Arena snapshot at 1507 ELO. GPT-6 Astra charges $50 per million output tokens. DeepSeek V4.1 Flash costs $0.30 per million input tokens, roughly 33x cheaper than OpenAI's flagship. The spread between the cheapest and most expensive frontier model has never been wider, and the performance gap between them has never been narrower.

This is the problem every engineering team, product builder, and business operator faces right now: the AI model market has fractured into dozens of competitive options, each with different pricing structures, benchmark strengths, context window sizes, and multimodal capabilities. Choosing the wrong model does not just cost money. It costs performance, latency, and competitive advantage. Choosing based on brand name alone means overpaying by 10x to 100x for workloads that a cheaper model handles equally well.

This guide provides one thing that does not exist anywhere else: a single, unified table comparing every major AI model across the benchmarks that matter and the costs that add up, all normalized to the same unit (per million tokens), all verified against each provider's own live pricing page, last checked September 2026.

Written by Yuma Heymans (@yumahey), who builds autonomous AI agent systems at O-mega and evaluates model performance across production workloads daily.

Contents

1. The Master Table: Every Model, Benchmarked and Priced
2. How to Read the Table: What Each Benchmark Measures
3. The Pricing Landscape: What Intelligence Actually Costs
4. Benchmark Deep Dives: Who Wins Where
5. The Cost-Performance Frontier: Best Value Models
6. Provider Profiles: The Full Breakdown
7. Open-Source vs Closed-Source: The Economic Divide
8. Context Windows and Long-Context Performance
9. The Multimodal Gap: Vision, Audio, and Beyond
10. How to Choose: A Decision Framework
11. What Changed Since January 2026
12. Where This Is Heading

---

1. The Master Table: Every Model, Benchmarked and Priced

This is the core of the guide. One table. Every major model. Benchmarks across the columns, costs in consistent units (per million tokens) on the right side. Models are sorted by Arena ELO where available, then by GPQA Diamond score as a tiebreaker. A dash (-) means the benchmark was not reported by the provider or is not applicable. The table is a fixed snapshot; for scores published after it, GenMagic, an AI studio built by O-mega's founder, keeps a continuously updated matrix of more than 4,700 benchmark scores across over 100 benchmarks, each linked to its original source.

Benchmark abbreviations: MMLU (Massive Multitask Language Understanding), GPQA-D (Graduate-Level Google-Proof QA, Diamond set), SWE-b (SWE-bench Verified, real-world coding), AIME (American Invitational Mathematics Examination), HLE (Humanity's Last Exam), Arena (Chatbot Arena ELO, verified September 2026).

Cost columns: All prices in USD per 1 million tokens. Input = prompt tokens sent to the model. Output = completion tokens generated. Ctx = maximum context window in thousands of tokens. V = vision/multimodal support (Y/N).

This table is the reference point for everything that follows. Each section below unpacks a different dimension of this comparison: what the benchmarks actually measure, where each provider wins and loses, and how to map these numbers to your specific use case.

For deeper analysis of individual models, we have published dedicated guides on Claude Opus 4.7, GPT-5.5, Gemini 3.1 Pro, and DeepSeek V4 that go much deeper into each model's architecture and practical performance.

---

2. How to Read the Table: What Each Benchmark Measures

The benchmarks in the master table are not interchangeable. Each one tests a fundamentally different capability, and understanding what they measure is essential for interpreting the scores correctly. A model that dominates AIME but underperforms on SWE-bench is not "better" or "worse" in any absolute sense. It is better at mathematical reasoning and worse at navigating real codebases with complex dependencies. These are different skills that matter to different workloads.

The reason we selected these six benchmarks (MMLU, GPQA Diamond, SWE-bench Verified, AIME, Humanity's Last Exam, and Chatbot Arena ELO) is that they span the full spectrum from broad knowledge to narrow expertise, from static evaluation to live human preference, and from theoretical problem-solving to practical software engineering. Together, they give a more complete picture than any single benchmark could.

MMLU (Massive Multitask Language Understanding)

MMLU tests breadth of knowledge across 57 academic subjects, from abstract algebra to world religions. It has been the default "general intelligence" benchmark since 2021, and most providers still report it. However, MMLU scores above 85% have become nearly meaningless as a differentiator. The gap between a 90% and a 92% tells you almost nothing about real-world performance. Gemini 3.1 Pro leads at 92.6%, but the practical difference between that and DeepSeek R1's 90.8% is negligible for most applications.

The more informative variant is MMLU-Pro, which adds harder questions and penalizes guessing more aggressively. DeepSeek R1 scores 84.0% on MMLU-Pro, while Llama 4 Maverick scores 80.5%. These numbers have more signal because the test is harder and the score distribution is wider.

GPQA Diamond (Graduate-Level Science)

GPQA Diamond is a dataset of 448 questions written by domain experts in physics, chemistry, and biology, specifically designed so that non-experts cannot answer them even with internet access. This makes it one of the purest tests of deep scientific reasoning. When Gemini 3.1 Pro scores 94.3% on GPQA Diamond, it means the model can reason through graduate-level science problems that stumped PhD students outside their specialization - Google DeepMind. The gap between Gemini 3.1 Pro (94.3%) and DeepSeek R1 (71.5%) on this benchmark is enormous and meaningful. For scientific research applications, coding biology pipelines, or any workload involving deep domain expertise, GPQA Diamond is the benchmark to watch.

SWE-bench Verified (Real-World Coding)

SWE-bench Verified asks models to solve actual GitHub issues from popular open-source repositories like Django, Flask, and scikit-learn. The model receives the issue description and must produce a working patch that passes the project's test suite. This is the closest benchmark we have to measuring real-world software engineering capability. It tests not just code generation but code comprehension, debugging, understanding existing test infrastructure, and producing minimal, correct patches.

The early-2026 leaders were remarkably close: Claude Opus 4.6 at 81.4%, Gemini 3.1 Pro at 80.6%, and Claude Sonnet 4 at 80.2% (with prompt modification), before GPT-5.5 (88.7%) and Claude Opus 4.7 (87.6%) pulled ahead. GPT-5 sits at 74.9%. DeepSeek R1 is far behind at 49.2%. If your primary use case is AI-assisted coding, SWE-bench Verified is the single most important number in the table. As we explored in our guide to AI coding agents, this benchmark has become the industry standard for evaluating coding capability.

AIME (Mathematical Reasoning)

The American Invitational Mathematics Examination is a competition-level math test that requires multi-step reasoning, creative problem-solving, and the ability to combine different mathematical techniques. AIME problems cannot be solved by pattern matching or lookup. They require genuine mathematical reasoning chains.

OpenAI's o3 leads here with 96.7% on AIME 2024, followed by GPT-5 at 94.6% on AIME 2025 (a harder set), and Gemini 2.5 Pro at 92.0%. The reasoning models (o3, o4-mini) tend to outperform general-purpose models on AIME because they can spend more compute on each problem through chain-of-thought reasoning.

Humanity's Last Exam (HLE)

HLE is the newest and hardest benchmark on this list. It consists of 2,500 questions contributed by experts across dozens of fields, designed to be answerable by humans but extremely challenging for AI. The name is deliberately provocative: the creators intended it to be "the last exam that AI cannot pass." That ceiling has now been broken. Claude Fable 5.1, released on September 1, 2026, scores 60.9% unaided and 65.0% with tools - Anthropic, and three weeks later Claude Opus 5.5 reached 67.7% with tools, the first published result to clear the two-thirds mark - Anthropic. Gemini 3.8 Flash reaches 54.9% on the verified subset at a fraction of the price - Google. The previous generation sits far below that line: Gemini 3.1 Pro at 44.4% and GPT-5.5 at 44.3% - Scale AI. This benchmark matters because it shows where the frontier actually is, and it moved roughly 20 points in four months.

Chatbot Arena ELO (Live Human Preference)

Unlike the other benchmarks, Chatbot Arena is not a fixed test. It is a live platform where humans have blind conversations with two anonymous models and vote for the one they prefer. ELO ratings emerge from hundreds of thousands of these comparisons. This makes Arena ELO the most "real-world" benchmark: it captures not just correctness but helpfulness, formatting, tone, instruction-following, and every other factor that determines whether a human actually prefers one model's output over another.

In the September 2026 snapshot, Claude Fable 5 led at 1507 ELO, followed by Opus 4.6 (thinking) at 1505, Fable 5.1 (max) at 1504 and Opus 4.7 (thinking) at 1502 - Arena.ai. Meta's Muse Spark 1.2 breaks the Anthropic run at 1499, Gemini 3.8 Flash (high) sits at 1494, Gemini 3.1 Pro Preview at 1489, and GPT-5.5 (high) at 1484. The clustering of scores at the top tells an important story: at the frontier, human preferences barely distinguish between the top models. The gap between #1 and #10 is just 15 ELO points, which is within statistical noise for many comparison types.

The key insight from the diagram above is that performance on knowledge benchmarks (MMLU, GPQA) correlates only weakly with performance on practical tasks (SWE-bench, AIME). A model can score 92% on MMLU and still fail to write a correct Django patch. This is why no single benchmark tells the whole story, and why the master table includes all six dimensions.

---

3. The Pricing Landscape: What Intelligence Actually Costs

The economics of AI inference have shifted dramatically over the course of 2026. The most striking trend is not that prices have dropped (they have, but that has been true for years). The striking trend is the decoupling of price from performance. In 2024, the most expensive model was almost always the best model. By late 2026, that correlation has broken.

Gemini 3.1 Pro delivers the highest GPQA Diamond score (94.3%) at $2.00/$12.00 per million tokens. Claude Fable 5 topped the September Arena ELO snapshot at $10.00/$50.00, five times the output price for 18 more ELO points. GPT-5.5 charges $5.00/$30.00 and sits 23 ELO points behind the leader on human preference. At the budget end, Claude Haiku 5.5 and GPT-6 Luna both cost $0.10/$0.50, DeepSeek V4.1 Flash costs $0.30/$1.20, and all three still handle most production workloads competently. The question is no longer "which model is best?" but "which model delivers sufficient quality for my specific use case at the lowest cost?"

This decoupling has structural causes. Google subsidizes Gemini pricing to drive Cloud Platform adoption. DeepSeek uses a mixture-of-experts architecture that activates only a fraction of total parameters per inference, dramatically reducing compute costs. Meta gives Llama 4 away for free because their business model is not API revenue. These are not temporary discounts. They are strategic pricing decisions backed by fundamentally different business models. We analyzed this dynamic in depth in our AI market power consolidation report.

The Three Pricing Tiers

The market has organized itself into three distinct pricing tiers, and understanding which tier your workload falls into determines whether you spend $100 or $10,000 per month on the same volume of inference.

Tier 1: Premium Flagships ($20-180/M output). GPT-6 Astra and Claude Fable 5.1, both at $10.00/$50.00, Claude Opus 5.5 at $4.00/$20.00, plus the older GPT-5.5, GPT-5.6 Sol, Claude Opus 4.7 and GPT-5.5 Pro. These models target workloads where quality is non-negotiable and cost is secondary: legal analysis, medical reasoning, financial modeling, complex agentic tasks. At GPT-5.5 Pro's $180/M output rate, processing 10 million output tokens costs $1,800. That is a meaningful expense, but for a hedge fund generating trade analysis or a pharmaceutical company screening drug interactions, the cost of a wrong answer dwarfs the cost of inference.

Tier 2: Performance Sweet Spot ($1-15/M output). Gemini 4 Argon, Gemini 3.1 Pro, Gemini 3.8 Flash, Claude Sonnet 5.5, GPT-6.1 Sol, GPT-6.1 Terra, GPT-5, o3, Gemini 2.5 Pro, Claude Haiku 4.5, Grok 4.3 and Grok 4.7. This tier offers 80-95% of frontier quality at 20-50% of the price. Gemini 3.1 Pro set the pattern here: it matches or exceeds Opus 4.7 on most benchmarks at less than half the output cost, and its successor Gemini 4 Argon cuts the output rate to $10.00. For production applications where quality matters but budgets exist, Tier 2 is where the action is.

Tier 3: Budget Workhorses ($0.30-2.50/M output). Claude Haiku 5.5, GPT-6 Luna, DeepSeek V4.1 Flash, Llama 4 Scout/Maverick, Mistral Large 3, Gemini 2.5 Flash, Gemini 2.5 Flash-Lite, Qwen 3.6 Plus. These models handle high-volume workloads where per-token cost dominates: content moderation, summarization, classification, data extraction, chatbot responses. DeepSeek V4.1 Flash at $1.20/M output can process the same 10 million output tokens for $12.00, and for $6.00 outside its peak window. That is 150x cheaper than GPT-5.5 Pro.

The spread between these tiers is not gradual. It is discontinuous. The jump from Tier 3 to Tier 2 is roughly 5-10x. The jump from Tier 2 to Tier 1 is another 4-5x. Choosing the wrong tier for your workload is the most expensive mistake you can make in AI infrastructure.

Hidden Costs: Caching, Batching, and Reasoning Tokens

The per-million-token prices in the master table are list prices. Actual costs can be significantly lower or significantly higher depending on three factors.

Prompt caching reduces input costs by 75-90% across all major providers. If your application sends similar prompts repeatedly (chatbots with system prompts, RAG pipelines with static context, agents with tool definitions), cached tokens cost a fraction of fresh tokens. Anthropic's prompt caching reduces cached input to $0.50/M instead of $5.00/M for Opus 4.7, and Fable 5.1 went further by pricing cache reads at 0.025x base rather than the usual 0.1x, which puts a cached input token at $0.25/M against a $10.00/M list price, a 97.5% discount - Anthropic Pricing. OpenAI applies a comparable 10x cut, with GPT-6 Astra's cached input at $1.00/M against $10.00/M standard - OpenAI Pricing. For high-volume production workloads, caching can reduce total costs by 50-70%.

Batch processing cuts all token costs by 50% with every major provider. If your workload tolerates latency (processing overnight, generating reports, analyzing documents in bulk), batch mode halves your bill. OpenAI calls it "Flex API," Anthropic calls it "Batch API," but the economics are identical - OpenAI Pricing.

Reasoning tokens can multiply costs by 5-50x for reasoning models. OpenAI's o3 and o4-mini, and Anthropic's "thinking" mode, generate internal reasoning tokens that count toward your output bill. A query that produces 500 visible output tokens might consume 10,000 reasoning tokens behind the scenes. This means the effective cost of an o3 query can be 10-20x the naive per-token calculation. The master table shows list prices per million tokens. For reasoning models, multiply output costs by your expected reasoning-to-output ratio.

As we detailed in our cost of AI agents report, the total cost of running an AI system in production goes well beyond raw token pricing. Orchestration overhead, retry logic, tool-calling loops, and context window management all add multipliers on top of the base model cost.

---

4. Benchmark Deep Dives: Who Wins Where

No single model wins everywhere. The frontier has fragmented into specialized strengths, and understanding which model dominates which capability is the difference between a well-architected system and a brute-force approach that overpays for irrelevant quality.

Coding: Claude and Gemini Lead, DeepSeek Lags

The SWE-bench Verified leaderboard tells a clear story for the generation that shipped through mid-2026. GPT-5.5 leads at 88.7%, followed by Claude Opus 4.7 at 87.6%, then DeepSeek V4 Pro-Max and Gemini 3.1 Pro tied at 80.6%, and Claude Sonnet 4.6 at 79.6% - TokenMix. Above roughly 88% the benchmark stops separating models, and the labs have moved their headline coding claims to harder agentic suites. Anthropic opened September with 55.8% on Terminal-Bench 4.0 and 73.4% on Cursor's independently run CursorBench for Fable 5.1, and Claude Sonnet 5.5 has since reached 70.6% on Terminal-Bench 4.0, ahead of Opus 5.5 at 66.4% - Anthropic. For Fable 5.1 Anthropic also reports 52.6% on Terminal-Bench-Science against 24.7% for Fable 5, a more than twofold jump in a single release - Anthropic. DeepSeek R1, despite its strength in math and reasoning, scores only 49.2% on SWE-bench, making it a poor choice for code-heavy workloads.

The practical implication is significant. For AI-powered coding tools, IDE integrations, and automated code review systems, the top 5 models now all exceed 78% on real-world GitHub issue resolution. The gap between GPT-5.5 (88.7%) and the previous generation leaders like GPT-5 (74.9%) represents a 14-point improvement in under a year. That translates to roughly one in seven additional real-world coding problems solved correctly per generation leap.

What makes the coding benchmark results particularly interesting is the convergence at the top. GPT-5.5, Claude Opus 4.7, DeepSeek V4 Pro-Max, and Gemini 3.1 Pro all cluster between 80-89% on SWE-bench Verified, despite vastly different architectures and pricing. DeepSeek V4 Pro achieves 80.6% at just $1.32/$3.96 per million tokens (half that off-peak), making it arguably the best cost-per-coding-quality option in the market. The models that lag (DeepSeek R1 at 49.2%, Nova Premier at 42.4%) are either older reasoning-focused models or not optimized for agentic code generation. For more on how coding agents leverage these capabilities, see our long-running coding agents guide.

Science and Reasoning: Google Dominates

On GPQA Diamond, the top three models have converged to within 1.1 percentage points: Gemini 3.1 Pro at 94.3%, Claude Opus 4.7 at 94.2%, and GPT-5.5 at 93.6% - llm-stats.com. GPT-5.4 follows at 92.0%, and DeepSeek V4 Pro reaches 90.1%. The gap between the top model and #5 is just 4.2 points, suggesting that graduate-level science reasoning is now a commodity capability among frontier models. The notable outlier is the Flash line, which achieves near-frontier scientific reasoning at a fraction of the price: Gemini 3 Flash hit 90.4% on its way through, and its successor Gemini 3.8 Flash now sells at $0.75/$3.75 per million tokens.

On Humanity's Last Exam, the picture is more spread and the leaders have turned over completely: Claude Opus 5.5 now leads at 67.7% with tools, ahead of Claude Fable 5.1 (60.9% unaided, 65.0% with tools) and Gemini 3.8 Flash at 54.9% on the verified subset. Grok 4 Heavy at 50.7% was the first model to break 50%, and the generation below it (Gemini 3.1 Pro at 44.4%, GPT-5.5 at 44.3%) is now roughly 20 points off the pace - Scale AI. For scientific research applications, the convergence at the top means price becomes the differentiator: Gemini 3.1 Pro achieves essentially identical GPQA performance to Claude Opus 4.7 at less than half the output cost ($12 vs $25).

We covered Gemini 3.1 Pro's scientific capabilities in detail in our complete guide, including benchmarks on specialized medical, legal, and financial reasoning tasks.

Mathematics: OpenAI's Reasoning Models Excel

AIME scores now show a much tighter race than a year ago. o3 leads at 96.7% on AIME 2024, but Llama 4 Maverick reaches 96.1%, Claude Opus 4.7 hits 95.2%, GPT-5 scores 94.6% on AIME 2025, Claude Sonnet 4.6 reaches 94.0%, and o4-mini achieves 92.7% - BenchLM.ai. Even the budget reasoning model o4-mini, shut down on the API on October 23, 2026, surpassed what had been frontier performance a year earlier. Gemini 3.1 Pro scores 91.2% on AIME 2025, and Gemini 2.5 Flash manages 88.0% at just $0.30/$2.50 per million tokens.

The pattern here is important: mathematical reasoning is no longer the exclusive domain of expensive reasoning models. Llama 4 Maverick matches o3 within 0.6 points at $0.35/$1 (roughly 12x cheaper on output). Claude Sonnet 4.6 reaches 94% at $3/$15 (a fraction of the effective cost of o3 with reasoning tokens). The tradeoff of paying premium prices for dedicated reasoning compute is shrinking as general-purpose models absorb mathematical capability.

For applications that require mathematical precision (financial modeling, actuarial calculations, physics simulations, engineering analysis), the reasoning models justify their premium. For general-purpose applications where occasional math is needed but not the primary workload, the standard models at 85-90% AIME accuracy are sufficient and dramatically cheaper.

Human Preference: Anthropic Leads, but the Gap Is Closing

The Chatbot Arena tells the most nuanced story. Claude Fable 5 led the September snapshot at 1507 ELO, but the top 10 models are clustered within a 15-point band. This clustering means that for most conversational use cases, the differences between frontier models are imperceptible to users. The practical implication: if you are building a chatbot or conversational AI product, any Tier 1 or top Tier 2 model delivers essentially equivalent user satisfaction. Choose based on price and secondary factors (latency, API reliability, specific capability strengths), not Arena ELO.

The Arena also reveals an interesting pattern: thinking/reasoning modes consistently score higher than standard modes for the same model. Claude Opus 4.6 in thinking mode (1505) outscores standard mode (1498), and the same holds for Opus 4.7 (1502 versus 1494). This suggests that users prefer more thorough, step-by-step responses, even when they did not explicitly request chain-of-thought reasoning.

---

5. The Cost-Performance Frontier: Best Value Models

The most important question for production deployments is not "which model is best?" but "which model gives me the most performance per dollar?" This requires plotting models on a cost-performance frontier and identifying which ones sit on the efficient boundary (delivering the most capability for their price point) versus which ones are dominated (outperformed by cheaper alternatives).

The Frontier Analysis

When you plot Arena ELO against output cost per million tokens, three models stand out as being on the efficient frontier, meaning no other model offers better performance at the same or lower cost.

Gemini 3.1 Pro ($12/M output, 1489 ELO, 94.3% GPQA, 80.6% SWE-bench) was the single best value proposition at the frontier for most of 2026. It matches Claude Opus 4.7 on GPQA (94.3% vs 94.2%) at less than half the output cost. Unless you specifically need Anthropic's superior coding performance (87.6% vs 80.6% on SWE-bench) or are locked into the OpenAI ecosystem, Gemini 3.1 Pro has been the default choice for quality-sensitive production workloads, and its successor Gemini 4 Argon now offers Google's flagship tier at a lower $10/M output rate.

Grok 4.3 ($2.50/M output, 1M context, vision) offers surprisingly strong capability at a price point that undercuts most competitors. At $1.25/$2.50 per million tokens for prompts under 200K (double that above it), it is cheaper than Claude Haiku 4.5 ($1.00/$5.00) while supporting a 1M context window and vision capabilities. xAI has not published extensive benchmark results, which makes independent evaluation difficult, but the price-to-feature ratio is compelling - xAI Models.

DeepSeek V4.1 Flash ($1.20/M output, 1M context) remains a cost leader for bulk workloads among models of its capability class, though Claude Haiku 5.5 and GPT-6 Luna now undercut it at $0.50/M output. At roughly 42x cheaper than GPT-6 Astra on output tokens, and 83x cheaper if your jobs run outside DeepSeek's peak window, it handles classification, summarization, extraction, and moderate-complexity generation tasks at costs that make per-query budgeting almost irrelevant. The tradeoff is clear: no publicly reported benchmark scores on the standard suite, although V4.1 Flash now accepts images on the main endpoint and has absorbed the retired experimental deepseek-v4-flash-vision-exp model - DeepSeek Pricing. For workloads where volume is high and peak-hour timing is flexible, few models compete on price.

Models That Are Dominated

Several models in the table are "dominated," meaning another model offers better performance at the same or lower price. These are not bad models, but they are suboptimal choices for new deployments.

GPT-5.5 at $5.00/$30.00 presents a nuanced case. It leads on SWE-bench (88.7% vs 80.6%) and scores competitively on GPQA (93.6% vs 94.3%), but Gemini 3.1 Pro at $2.00/$12.00 matches or exceeds it on scientific reasoning while costing less than half as much. For coding-heavy workloads, GPT-5.5's SWE-bench lead justifies the premium. For everything else, Gemini 3.1 Pro dominates on value, and Gemini 4 Argon now undercuts it on output.

Claude Opus 4 and Opus 4.1 at $15.00/$75.00 are dominated by their own successors, and Anthropic has now retired both on the first-party API, leaving them reachable only through Amazon Bedrock and Google Cloud - Anthropic Pricing. Opus 4.5 through Opus 5 deliver better performance at $5.00/$25.00, and Opus 5.5 at $4.00/$20.00. If you are still routing to Opus 4 in production, migrating up the Opus line saves 67% to 73% with no quality loss.

Nova Premier at $2.50/$12.50 has no publicly reported benchmark scores and sits at a price point where Gemini 3.1 Pro ($2.00/$12.00) offers documented superior performance for less money. Amazon's Nova models serve a purpose within the AWS ecosystem (Bedrock integration, data residency guarantees), but on pure cost-performance, they are not competitive.

The chart above shows ELO points per dollar of output cost, a rough measure of value. Gemini 3.8 Flash leads it: 1494 ELO, within 13 points of the outright leader, at $3.75/M output. DeepSeek V4 Pro sits just behind on the strength of its price alone (1434 ELO at $3.96/M). The premium flagships deliver the lowest points-per-dollar, and Claude Fable 5 is the extreme case at 30: it held the #1 Arena position in September, and you pay $50/M output for the 13-point margin over a Flash model.

---

6. Provider Profiles: The Full Breakdown

Each AI lab brings a distinct strategy, architecture, and business model to the market. Understanding these differences helps explain the pricing and performance patterns in the master table, and helps predict where each provider is headed next.

OpenAI: The Broadest Portfolio

OpenAI runs the largest model portfolio of any provider, with more than 20 actively supported text models spanning from GPT-5 Nano ($0.05/$0.40, until December 11, 2026) to GPT-5.5 Pro ($30.00/$180.00). This breadth is a strategic advantage: developers can start with a cheap model and scale up to more powerful ones without switching providers or rewriting integrations.

The GPT-5.5 family, launched April 23, 2026, held the flagship slot for most of the year with 92.4% MMLU, 93.6% GPQA Diamond, and a chart-topping 88.7% on SWE-bench Verified - OpenAI. It supports 1M token context, native vision, and a 60% reduction in hallucination rates compared to GPT-5.4. Two further generations have landed since: the GPT-5.6 line (Sol at $4.00/$20.00, Terra at $2.00/$12.00, Luna at $0.20/$1.20) in July, and GPT-6 Astra in September 2026 at $10.00/$50.00 - OpenAI Pricing. The GPT-6 tier below Astra followed within weeks: GPT-6 Luna at $0.10/$0.50, then GPT-6.1 Sol at $2/$10 and GPT-6.1 Terra at $1/$5, each with a 1,050,000-token window and image input, cutting the matching GPT-5.6 rates roughly in half - OpenAI. Astra's model card lists a 1,050,000-token context window, 128,000 max output tokens and an April 30, 2026 knowledge cutoff - OpenAI. Astra is the first OpenAI release priced above the GPT-5.5 standard tier, and its cached input at $1.00/M makes long, repetitive agent loops far cheaper than the list price suggests. The pricing at $5.00/$30.00 (standard) positions it as a premium offering, and the $30.00/$180.00 Pro tier targets research and enterprise workloads where cost is no object. As we analyzed in our GPT-5.5 benchmarks guide, the model's real-world performance justifies the premium for coding workloads but not as a general-purpose default given Gemini 3.1 Pro's comparable reasoning at half the price.

OpenAI's reasoning models (o3, o4-mini) were the strongest options for mathematical and logical reasoning tasks, with o3's 96.7% AIME score unmatched by any competitor. Both are now leaving the API: o4-mini was shut down on October 23, 2026, and o3 is removed on December 11, 2026, with GPT-5.6 Sol as OpenAI's named replacement - OpenAI Deprecations. The tradeoff is the reasoning token overhead, which can multiply effective costs significantly.

The GPT-4.1 family is now legacy and on its way out, after a long run as long-context specialists. GPT-4.1 supports 1M tokens at $2.00/$8.00 until its scheduled removal on January 14, 2027, while GPT-4.1 Nano ($0.10/$0.40) was shut down on October 23, 2026. GPT-5 Nano undercut both at $0.05/$0.40, but it leaves with GPT-5 itself on December 11, 2026, so new builds should start on GPT-6 Luna rather than on either older line.

Anthropic: Quality Leader, Premium Pricing

Anthropic's strategy is vertical: each model is highly optimized for quality and older ones stay served rather than being churned. The lineup now runs from Haiku 5.5 at $0.10/$0.50 up through Sonnet 5.5 at $2/$10 and Opus 5.5 at $4/$20 to Claude Fable 5.1 and the trusted-access Mythos 5.1 at $10.00/$50.00, with only Opus 4, Opus 4.1, Sonnet 4 and Haiku 3.5 retired from the first-party API - Anthropic Pricing. Every model in it performs at or near the top of its price class.

Claude Opus 4.7, released April 16, 2026, scores 92.8% MMLU, 94.2% GPQA Diamond, 87.6% SWE-bench Verified (second only to GPT-5.5), and 95.2% on AIME 2025 - llm-stats.com. It held a top-five Arena position at 1502 ELO in thinking mode in the September snapshot, achieves 70% on CursorBench (vs 58% for Opus 4.6), 90.9% on BigLaw Bench, and a remarkable 98.5% on XBOW visual-acuity (vs 54.5% for its predecessor) - Anthropic. The tokenizer introduced with Opus 4.7 and carried into every later Claude generates approximately 30% more tokens for the same text, which raises effective per-request costs even though the per-token price is unchanged.

Claude Sonnet 5.5 at $2.00/$10.00 is now the workhorse model that most production deployments should consider, and it carries one of the few genuine price cuts of the year: Sonnet 5's $2/$10 rate was announced as introductory pricing through August 31, 2026, Anthropic then confirmed that the scheduled increase to $3/$15 on September 1 would not happen, and Sonnet 5.5 kept that rate while halving cache reads to $0.10 per million tokens - Anthropic. That makes the current Sonnet a third cheaper than Claude Sonnet 4.6 at $3.00/$15.00, which sits at 1454 Arena ELO, competitive with GPT-5.5 (1484) at half the output cost. For workloads that do not need the absolute frontier, the Sonnet tier delivers 95% of the quality at a fraction of the price.

Claude Haiku 5.5 at $0.10/$0.50 (for prompts up to 100,000 tokens, $0.50/$2.50 above that) replaced Haiku 4.5's $1.00/$5.00 and now matches GPT-6 Luna's rate while undercutting Gemini 2.5 Flash ($0.30/$2.50). Anthropic puts it at around 75% cheaper to run than Haiku 4.5, which ends Haiku's run as the most expensive "budget" model across providers - Anthropic.

Google: The Price-Performance King

Google's Gemini lineup is the most strategically aggressive in the market. Gemini 3.1 Pro at $2.00/$12.00 delivers the highest GPQA Diamond score (94.3%), the largest standard context window (2M tokens), and competitive Arena ELO (1489), all at a price that undercuts both OpenAI and Anthropic's flagships by 50-60%. Its successor, Gemini 4 Argon, launched on October 13, 2026 as Google's new flagship at an introductory $2/$10, ranked #1 on the Vals Index, with a 1,048,576-token window shared by input and output - Google. Budget for the step-up: Google's pricing page holds that rate only through November 30, 2026, and Argon doubles to $4.00/$20.00 on December 1, 2026 - Google Gemini Pricing.

This pricing is not sustainable on a standalone basis. Google subsidizes Gemini to drive adoption of Google Cloud Platform, where the real revenue is in compute, storage, and enterprise services. For users, this subsidy is a gift. For competitors, it is an existential pressure on margins.

The Flash family is where Google now iterates fastest, and it has become the real story. Google shipped its third Flash release in six weeks with Gemini 3.8 Flash on September 2, 2026, holding the price flat at $0.75/$3.75 while pushing the score to 54.9% on HLE-Verified - Google. That rate is explicitly introductory: Google's own pricing page states it runs through December 31, 2026 and doubles to $1.50/$7.50 on January 1, 2027, which is a rare published price increase in a market that has only moved down, and worth budgeting for now. Further down the ladder, Gemini 2.5 Flash and Gemini 3.5 Flash-Lite at $0.30/$2.50 and Gemini 3.1 Flash-Lite at $0.25/$1.50 (scheduled to shut down on May 7, 2027) offer 1M context and vision at a price point that competes with open-source inference costs. Google also applies a unique long-context surcharge: Gemini 3.1 Pro moves to $4.00/$18.00 for prompts exceeding 200K tokens, and Gemini 2.5 Pro to $2.50/$15.00. This means the 2M context window is available but expensive to fully utilize - Google Gemini Pricing.

For a detailed breakdown of Gemini's budget model, see our Gemini 3.1 Flash-Lite guide.

DeepSeek: The Cost Disruptor

DeepSeek has fundamentally changed the pricing conversation, though its launch promotions have since expired and the list prices are higher than the discounted rates it opened with. The V4.1 Flash model, which replaced V4 Flash in October, at $0.30/$1.20 per million tokens is still among the cheapest production-grade models from any major provider. The V4 Pro at $1.32/$3.96 offers higher quality at prices below most Western competitors. DeepSeek is also the only major provider that prices by clock: it charges half rates outside a peak window of 01:00 to 04:00 and 06:00 to 10:00 UTC on weekdays, which takes V4.1 Flash to $0.15/$0.60 for any batch job you can schedule around it - DeepSeek Pricing.

The cost structure is possible because of DeepSeek's mixture-of-experts (MoE) architecture, which activates only a small fraction of the model's total parameters for each token. The V3 model, for example, has 671 billion total parameters but activates only 37 billion per token. This architectural choice reduces inference compute by roughly 10x compared to dense models of equivalent quality - DeepSeek GitHub.

The newer DeepSeek V4 Pro represents a massive leap over R1: it scores 90.1% on GPQA Diamond, 80.6% on SWE-bench Verified (matching Gemini 3.1 Pro), and 87.5% on MMLU-Pro - BenchLM.ai. At $1.32/$3.96 per million tokens, or half that off-peak, V4 Pro remains one of the best cost-per-quality options for coding tasks, though Gemini 3.8 Flash at $0.75/$3.75 has closed most of the price gap from the other direction. The older R1 reasoning model scores 90.8% on MMLU and 97.3% on MATH-500 but only 49.2% on SWE-bench and 71.5% on GPQA Diamond, revealing its age. Our DeepSeek V4 guide covers the full capabilities and limitations.

The caveat with DeepSeek is data residency. All inference runs on Chinese infrastructure, which creates compliance challenges for European and American enterprises subject to data sovereignty regulations. For more on this topic, see our AI sovereignty guide.

Meta: Free and Open, But Lagging on Benchmarks

Meta's Llama 4 family (Scout and Maverick, released April 2025) is open-weight, meaning the model weights are freely downloadable and can be self-hosted. Pricing varies by API provider: DeepInfra and Fireworks offer the cheapest rates (DeepInfra lists Scout at $0.10 input and $0.30 output - DeepInfra Pricing), while Together AI charges 60-80% more.

Llama 4 Scout is the long-context specialist with a native 10M token context window, the largest of any model in the market. In practice, most API providers cap this at 128K-320K tokens, but for self-hosted deployments, the full 10M window is available. Scout runs on a single GPU with only 17 billion active parameters (out of 109B total), making it remarkably efficient to serve.

Llama 4 Maverick is the quality-focused variant with 400B total parameters (17B active). It scores 85.5% on MMLU and 69.8% on GPQA Diamond, placing it behind the closed-source leaders but ahead of most open-weight alternatives. Maverick does not yet have SWE-bench or AIME results published.

The strategic value of Llama 4 is not benchmark leadership. It is cost and control. Self-hosted Llama 4 costs only the price of GPU compute, with no per-token API fees. For organizations processing billions of tokens per month, self-hosting Llama 4 can reduce costs by 90%+ compared to API-based alternatives. The tradeoff is operational complexity: you need GPU infrastructure, model serving expertise, and ongoing maintenance.

Meta's frontier ambitions have since moved to the Muse Spark line, which was the only non-Anthropic entry in the September Arena top five: Muse Spark 1.2 sat at 1499 ELO, ahead of both standard Opus 4.7 and Gemini 3.8 Flash - Arena.ai. On October 15, 2026 Meta then published the weights of Muse Spark Open, an 816-billion-parameter model with 42 billion active, under a Muse Model License that requires a "Built with Muse Spark Open" notice and sets terms for model-as-a-service providers above $20 million in revenue - Hugging Face. Llama 4 remains the lighter open-weight workhorse underneath it.

xAI: The Wildcard

xAI's Grok 4.3, launched May 6, 2026, is still served and is still the cheapest thing xAI sells at frontier scale. At $1.25/$2.50 per million tokens with a 1M context window and vision support, it is priced aggressively below every other frontier model except DeepSeek. It has since been joined by Grok 4.5, Grok 4.6 and, in September, the flagship Grok 4.7, all at $2.00/$6.00 with a 500K context window and a hard doubling to $4.00/$12.00 above 200K tokens, so xAI's newer models are more capable but carry a smaller window and a steeper cliff than the 4.3 they replaced - xAI Models. The catch across the line: xAI has not published detailed benchmark results, making independent evaluation difficult.

What we know from the Arena: Grok 4.20 beta1 scores 1479 ELO (tied with GPT-5.4 high), suggesting competitive quality. The previous Grok 3 (Think) claimed 93.3% on AIME 2025 at launch, but only at xAI's highest test-time compute setting (cons@64), with most comparisons presented as charts - xAI.

xAI also retired several models (Grok 4, Grok 4.1 Fast, Grok 3) on May 15, 2026, and its models page now points every text and code workload at Grok 4.7 as the single primary offering - xAI Models. This simplification contrasts with OpenAI's portfolio approach. Tool use (web search, X search, code execution) adds $2.50-$5.00 per 1,000 calls on top of token costs.

Mistral: Europe's Contender

Mistral Large 3 at $0.50/$1.50 offers a 128K context window and vision support at a price point that competes with Google's Flash models. Mistral claims performance "at or above 90% of Claude Sonnet 3.7 on benchmarks across the board," though exact numbers were published only in images, not text. As the leading European AI lab, Mistral benefits from EU data sovereignty requirements that steer European enterprises toward European providers. Their pricing is the most aggressive of any Western lab, likely reflecting both efficient architecture and strategic positioning - Mistral AI Pricing.

The Codestral model deserves specific mention for coding workloads. At $0.30/$0.90 with a 256K context window, Codestral is purpose-built for code generation, completion, and explanation. It supports fill-in-the-middle (FIM) tasks that are essential for IDE integrations where the model must generate code that fits between existing blocks. For teams building developer tools on a budget, Codestral offers a focused coding capability at a fraction of the cost of general-purpose frontier models. The trade-off is capability breadth: Codestral is optimized for code and underperforms on general reasoning or multimodal tasks.

Mistral's open-weight releases also matter. Mistral Small 3 at $0.10/$0.30 is publicly available as open weights, meaning it can be self-hosted at near-zero marginal cost. For European organizations that need both budget pricing and data residency guarantees, running Mistral Small 3 on European cloud infrastructure is the cleanest compliance solution in the market.

Cohere and AI21: Enterprise Specialists

Two providers occupy a specific niche: enterprise deployments where retrieval-augmented generation (RAG) and business document processing are the primary workloads.

Cohere's Command A at $2.50/$10.00 is a 111 billion parameter open-weights model with a 256K context window, purpose-built for enterprise search and document processing. Cohere's differentiation is not raw benchmark scores but the surrounding platform: Embed for generating embeddings, Rerank for improving retrieval precision, and a deployment stack designed for enterprise compliance. Command A's open-weight availability means large enterprises can self-host on private infrastructure without API dependency. Note that Cohere's published self-serve rates now cover only the legacy Command and Command R family (Command R+ 08-2024 at $2.50/$10.00, Command R at $0.50/$1.50), with flagship generative pricing routed through enterprise sales, so treat the figure above as a reference point rather than a rate card - Cohere Pricing.

AI21 Labs' Jamba Large 1.7 uses a hybrid Mamba-Transformer architecture that handles long documents unusually efficiently. The Mamba layers process sequences with linear scaling (rather than the quadratic scaling of standard attention), which means Jamba maintains performance across its 256K context window without the degradation seen in some attention-only models. At $2.00/$8.00, it positions below Cohere Command A while offering competitive long-document capability. For enterprise document review pipelines processing hundreds of thousands of pages monthly, Jamba's architectural efficiency can translate to meaningful cost savings.

Neither Cohere nor AI21 compete at the frontier on general benchmarks. They compete on workflow integration, enterprise tooling, and specific retrieval tasks where their architectures have genuine advantages. If your primary workload is enterprise search, knowledge management, or document processing at scale, both deserve evaluation alongside the general-purpose models in the master table.

Qwen: China's API-Accessible Contender

Alibaba's Qwen 3.6 Plus at $0.33/$1.95 rounds out the budget tier from a major Chinese lab. With a 128K context window and vision support, it competes directly with Mistral Large 3 and Gemini 2.5 Flash on price. The Qwen-Turbo variant at $0.03/$0.13 is the cheapest model from any major provider with vision support, making it a genuine option for very-high-volume image processing workloads where cost dominates all other considerations - Qwen API Platform.

Like DeepSeek, Qwen models run on Chinese infrastructure, creating the same data residency concerns for regulated industries. However, the Qwen model weights are openly published on Hugging Face, which means enterprises with compliance requirements can self-host on their own infrastructure in any jurisdiction. This combination of open weights and low API pricing makes Qwen particularly compelling for Asia-Pacific deployments where latency to Alibaba's servers is lower and regulatory considerations differ from the US and EU context.

---

7. Open-Source vs Closed-Source: The Economic Divide

The division between open-weight and closed-source models creates fundamentally different economic structures for AI deployments. Understanding this divide is essential for making infrastructure decisions that compound correctly over time.

Open-weight models (Llama 4, DeepSeek, Mistral, Qwen) let you download and self-host the model. You pay for GPU compute, not per-token API fees. Closed-source models (GPT-5.5, Claude Opus, Gemini) are accessible only through APIs, where you pay per token consumed. The break-even point between these approaches depends on your monthly token volume, required quality level, and operational capability.

The structural economics favor self-hosting above approximately 500 million tokens per month. Below that threshold, API costs are low enough that the operational overhead of managing GPU infrastructure (provisioning, monitoring, scaling, updating) exceeds the savings. Above it, the fixed cost of GPU compute is amortized across enough tokens that per-token costs drop below API prices.

The specific numbers: a single NVIDIA A100 GPU ($2-3/hour on cloud providers) can serve Llama 4 Scout at roughly 50-80 tokens per second. At sustained utilization, that is approximately 4-6 million tokens per hour, or 100-150 million tokens per day. The cost works out to roughly $0.02-0.04 per million tokens, which is 3-7x cheaper than even DeepSeek's API pricing and 100x cheaper than GPT-5.5.

The tradeoff is real: self-hosted models require MLOps expertise, fail less gracefully than managed APIs, and lag behind the frontier on benchmarks. Llama 4 Maverick (85.5% MMLU) does not match Gemini 3.1 Pro (92.6% MMLU) on quality. But for workloads where 85% accuracy is sufficient and volume is high, the cost savings are transformative. We explored this dynamic in depth in our analysis of how LLM inference is reshaping software economics.

The third option is increasingly popular: open-weight models via third-party API providers (DeepInfra, Fireworks, Together AI, Groq). These providers host Llama 4 and DeepSeek models on their own infrastructure and charge per-token rates that are cheaper than the original provider's API but more expensive than self-hosting. Llama 4 Scout via DeepInfra costs $0.10/M input, which matches the cheapest closed-source APIs but is 3-5x more expensive than self-hosting. This middle ground suits teams that need budget pricing without the operational burden of managing GPUs.

---

8. Context Windows and Long-Context Performance

Context window size has standardized rapidly. In 2024, a 128K context window was exceptional. In 2026, it is the baseline. Most frontier models support 1M tokens, with outliers pushing to 2M (Gemini 3.1 Pro) and 10M (Llama 4 Scout, though practically limited by providers).

The standardization at 1M tokens does not mean all models perform equally with long contexts. There is a significant difference between a model that accepts 1M tokens and a model that usefully processes them. The benchmark to watch here is MRCR v2 (Multi-Round Coreference Resolution), which tests whether models can retrieve and reason about specific information buried deep in long contexts.

Claude Opus 4.6 scores 76% on MRCR v2 (8-needle, 1M tokens), meaning it correctly resolves references spread across a million-token conversation about three-quarters of the time - Anthropic. Gemini 3.1 Pro scores 84.9% on MRCR v2 (8-needle, 128K tokens), but this is a different context length, making direct comparison difficult. Gemini 2.5 Pro scores 91.5% on MRCR at 128K, suggesting stronger retrieval in shorter contexts.

Google's long-context surcharge reveals an important economic truth about long-context processing. Gemini 3.1 Pro doubles its prices (from $2.00/$12.00 to $4.00/$18.00) for prompts exceeding 200K tokens. This surcharge reflects the actual compute cost: processing a 1M token prompt requires significantly more memory and computation than processing a 10K token prompt, even at the same quality level. Other providers absorb this cost into their flat per-token pricing, but the economics are the same under the hood.

For applications that genuinely need long-context processing (legal document review, codebase analysis, book-length summarization), the relevant comparison is not just the context window size but the effective cost and quality at that context length. Gemini 3.1 Pro at $4.00/$18.00 (long context pricing) processes 1M tokens for roughly $22 total. Claude Opus 4.7 at $5.00/$25.00 processes the same context for roughly $30, and Anthropic charges no surcharge on it: every Claude from 4.6 onward except Haiku 5.5 (which moves to $0.50/$2.50 above 100,000 prompt tokens) bills the full 1M window at the standard per-token rate, so a 900K request costs the same per token as a 9K one - Anthropic Pricing. GPT-5.5 at $5.00/$30.00 costs $35 for the same workload. The quality differences at these extreme context lengths are harder to benchmark, but MRCR scores suggest Gemini has an edge.

The practical advice: if your prompts consistently stay under 128K tokens, context window size is irrelevant, and you should choose based on quality and cost. If you regularly process 200K-1M token prompts, Google and Anthropic are the only providers with proven long-context performance. If you need 1M+ tokens, Llama 4 Scout's 10M native context (self-hosted) or Gemini 3.1 Pro's 2M window are your only real options.

---

9. The Multimodal Gap: Vision, Audio, and Beyond

Most frontier models now support vision (image input processing). The master table marks this with a "Y" in the vision column. But "supports vision" is a spectrum, not a binary. Some models process images as a basic capability. Others can reason about charts, extract text from screenshots, analyze medical imaging, or interpret complex diagrams with high accuracy.

The standout result here is Claude Opus 4.7's 98.5% on XBOW visual-acuity, a benchmark that tests fine-grained visual perception. For context, Opus 4.6 scored only 54.5% on the same benchmark. This is the largest single-generation improvement on any benchmark in the table, and it signals that Anthropic invested heavily in visual processing for the 4.7 release.

GPT-5.5 supports vision across its full context window and can process video frames as sequences of images. Gemini 3.1 Pro natively processes images, audio, and video. Llama 4 Scout and Maverick both support image input. The notable exceptions are DeepSeek (V4 Pro has no vision; only V4.1 Flash, which absorbed the experimental deepseek-v4-flash-vision-exp variant, accepts images) and Mistral (Large 3 supports vision, but smaller models do not).

For production applications that process images (document OCR, UI analysis, medical imaging, retail product recognition), the choice narrows to models with proven vision quality. Claude Opus 4.7 leads on fine-grained visual tasks. Gemini 3.1 Pro offers the broadest multimodal coverage (images, audio, video) at the best price. GPT-5.5 provides strong vision in a well-documented API. DeepSeek V4 Pro and most open-source models are not viable for vision-heavy workloads.

Audio processing is a separate dimension that most benchmarks do not cover. Gemini is the only provider that natively accepts audio input in its API (audio tokens are priced at 2-7x the text rate). Other providers require separate speech-to-text preprocessing (Whisper, Deepgram) before feeding text to the LLM, adding latency and cost.

---

10. How to Choose: A Decision Framework

The master table contains 35 models across 9 providers. No one needs all of them. The right model depends on three variables: your primary workload, your monthly token volume, and your tolerance for operational complexity.

By Workload Type

Coding and software engineering. Use Claude Opus 5.5 (66.4% Terminal-Bench 4.0 at $4/$20), Claude Fable 5.1 (73.4% CursorBench) or GPT-6 Astra for maximum quality, or GPT-5.5 (88.7% SWE-bench) and Claude Opus 4.7 (87.6% SWE-bench) if you are optimizing the older tier. For budget-conscious coding, DeepSeek V4 Pro reaches 80.6% at $1.32/$3.96, and Claude Sonnet 5.5 posts 70.6% on Terminal-Bench 4.0 at $2/$10. The gap between Tier 1 ($20-50/M) and Tier 2 ($3-15/M) coding models is now just 8-9 percentage points on SWE-bench, making the cheaper options viable for most automated coding workloads. For AI agent platforms like O-mega that run autonomous coding tasks, model routing between these tiers based on task complexity delivers optimal cost-performance.

Scientific research and reasoning. Use Gemini 3.1 Pro or its successor Gemini 4 Argon. 3.1 Pro's 94.3% GPQA Diamond score is the highest in the master table, a tenth of a point ahead of Claude Opus 4.7, and Argon is built by Google for deep mathematical and scientific problem solving. At $2/$12 and $2/$10, both undercut the competing frontier flagships. The 2M context window handles full research papers and datasets. For medical applications specifically, see our applied AI in medicine guide.

Mathematical and logical reasoning. Use o3 from OpenAI until its December 11, 2026 API shutdown, then the Sol line OpenAI names as its replacement, now led by GPT-6.1 Sol. The reasoning models' ability to spend variable compute on hard problems makes them uniquely suited for mathematical workloads. Be prepared for higher effective costs due to reasoning token overhead.

High-volume text processing (summarization, classification, extraction, moderation). Use Claude Haiku 5.5 or GPT-6 Luna ($0.10/$0.50), DeepSeek V4.1 Flash ($0.30/$1.20, half off-peak) or Llama 4 Scout ($0.10/$0.30 via API, cheaper self-hosted). At these price points, processing a million documents costs dollars, not thousands of dollars.

Conversational AI and chatbots. Any Tier 1 or top Tier 2 model works. The Arena ELO clustering at the top means users cannot distinguish between frontier models in blind tests. Choose based on price: Gemini 3.8 Flash ($0.75/$3.75) or Grok 4.3 ($1.25/$2.50) offer the best value for conversational workloads.

Enterprise with compliance requirements. Consider data residency. DeepSeek runs on Chinese infrastructure. Mistral runs on European infrastructure. OpenAI, Anthropic, and Google primarily run on US infrastructure with European availability zones. If your data cannot leave a specific jurisdiction, this constraint narrows the field immediately. We covered sovereign AI considerations in our complete guide.

By Monthly Volume

Under 10M tokens/month ($1-300/month at most price points). Use whatever model fits your workload best. Cost differences are negligible at this volume. Optimize for quality and developer experience.

10M-100M tokens/month ($10-3,000/month). Cost optimization matters. Use Tier 2 models (Gemini 4 Argon, Gemini 3.8 Flash, Claude Sonnet 5.5) for quality-sensitive tasks and Tier 3 models (Claude Haiku 5.5, DeepSeek V4.1 Flash, Gemini 2.5 Flash-Lite) for bulk processing. Enable prompt caching and batch processing to reduce costs by 50-70%.

100M-1B tokens/month ($100-30,000/month). Routing becomes essential. Use a model router that sends each request to the cheapest model capable of handling it. Simple classification tasks go to Claude Haiku 5.5 or DeepSeek V4.1 Flash. Complex reasoning goes to Gemini 4 Argon. Coding tasks go to Claude Sonnet 5.5. This routing approach typically reduces costs by 60-80% compared to using a single model for everything.

Over 1B tokens/month ($1,000-300,000/month). Self-hosting open-weight models becomes the dominant strategy. Run Llama 4 Maverick or DeepSeek on your own GPU infrastructure for bulk tasks, and route only the hardest queries to closed-source APIs. The combined approach reduces costs by 90%+ while maintaining quality for the tasks that need it.

The Decision Tree

The simplest decision framework:

1. Does your workload require frontier quality (legal, medical, financial, complex coding)? If yes, choose Gemini 4 Argon (Google's flagship at an introductory $2/$10) or Claude Opus 5.5 (Anthropic's lead model for agentic coding and knowledge work at $4/$20).
2. Does your workload process high volumes where cost dominates? If yes, choose Claude Haiku 5.5 or GPT-6 Luna (cheapest closed APIs at $0.10/$0.50), DeepSeek V4.1 Flash (half price off-peak) or Llama 4 Scout (cheapest self-hosted).
3. Does your workload require reasoning/math? If yes, choose o3 (until December 11, 2026) or GPT-6.1 Sol.
4. Does your workload require vision? If yes, eliminate DeepSeek V4 Pro from consideration (V4.1 Flash now reads images).
5. Are you in a regulated industry with data residency requirements? If yes, choose providers whose infrastructure matches your jurisdiction.

For most teams, the answer is not a single model but a routing strategy that uses 2-3 models at different price-quality points. The AI agent platforms that are winning in production, including O-mega, all implement some form of intelligent model routing to balance cost and quality across different task types.

---

11. What Changed Since January 2026

The AI model landscape moves fast enough that a guide from five months ago is already partially obsolete. Here are the most significant changes since the start of 2026, and why they matter for your deployment decisions.

New Model Releases (January-May 2026)

The pace of releases has been unprecedented. In just five months, every major lab has shipped at least one significant model update.

Anthropic released Claude Opus 4.6 (early 2026) and Claude Opus 4.7 (April 16, 2026) in rapid succession. Opus 4.6 introduced Terminal-Bench 2.0 leadership and the highest SWE-bench Verified score at the time (81.42%). Opus 4.7 followed just weeks later with dramatic vision improvements (XBOW visual-acuity jumping from 54.5% to 98.5%), CursorBench improvements (58% to 70%), and a new tokenizer that generates more tokens per response. The rapid iteration pace suggests Anthropic is on a monthly or near-monthly release cadence for 2026.

OpenAI launched GPT-5.5 (April 2026) as its new flagship, extending the GPT-5 family with improved reasoning and a 1M context window. The most notable aspect of GPT-5.5 is the introduction of a Pro tier at $30/$180 per million tokens, the most expensive per-token pricing from any major provider. This signals OpenAI's bet that a segment of the market will pay super-premium prices for the highest-quality inference.

Google shipped Gemini 3.1 Pro (February 2026) with benchmark scores that reshaped the competitive landscape: 94.3% GPQA Diamond, 80.6% SWE-bench, and 44.4% HLE. The 2M context window and $2/$12 pricing cemented Google's position as the price-performance leader. Google also released Gemini 3.1 Flash-Lite and announced the deprecation of Gemini 2.0 Flash-Lite (June 1, 2026).

DeepSeek released V4 Pro and V4 Flash with 1M context windows and aggressive promotional pricing (75% discount on V4 Pro until May 31). The V4 generation extends DeepSeek's lead as the cost leader, with V4 Flash at $0.14/$0.28 setting a new floor for API pricing.

xAI launched Grok 4.3 (May 6, 2026) and simultaneously deprecated Grok 4, Grok 4.1 Fast, and Grok 3 (May 15, 2026). The consolidation to a single model simplifies xAI's offering but reduces flexibility for developers who relied on specific Grok variants.

The Scaling Laws Debate Continues

The question of whether AI model capabilities are hitting diminishing returns has been debated since late 2024. As we analyzed in our scaling laws investigation, the evidence through 2026 is mixed.

On one hand, benchmark scores continue to improve: GPQA Diamond went from 84% (Gemini 2.5 Pro, March 2025) to 94.3% (Gemini 3.1 Pro, February 2026). SWE-bench Verified went from 63.8% (Gemini 2.5 Pro) to 81.4% (Claude Opus 4.6). Humanity's Last Exam went from 18.8% (Gemini 2.5 Pro) to 44.4% (Gemini 3.1 Pro). These are substantial improvements over 12 months.

On the other hand, the Chatbot Arena shows diminishing returns in human-perceived quality. The top 10 models are clustered within 25 ELO points, and users in blind tests increasingly cannot distinguish between them. This suggests that while technical capabilities continue to improve on measurable benchmarks, the perceived quality gap from the user's perspective is narrowing.

The practical implication: if your application is evaluated by benchmarks (coding accuracy, factual correctness, math scores), upgrading to the latest model delivers real improvements. If your application is evaluated by user satisfaction (chatbots, assistants, content generation), the incremental value of each new model release is smaller. For an in-depth look at how algorithmic improvements are driving progress beyond pure scale, see our state of algorithms report.

Price Trends

The overall direction is down at the bottom and, for the first time, up at the top. Frontier model pricing held flat for most of the year (GPT-5.5 at $5/$30, Claude Opus at $5/$25, Gemini 3.1 Pro at $2/$12, roughly the range frontier models have occupied since 2025) and then broke that ceiling in September, when both GPT-6 Astra and Claude Fable 5.1 launched at $10/$50, a doubling of the input rate and a 67% increase on output against the flagships they replaced. The tier just below moved the other way within weeks: Claude Opus 5.5 cut the Opus rate to $4/$20, 20% below Opus 5, and GPT-6.1 Sol halved GPT-5.6 Sol to $2/$10. The compression continues at the mid-tier and budget levels, which is what makes the tiers pull apart rather than converge.

DeepSeek's V4 Flash opened at $0.14/$0.28 before settling at a $0.44/$1.32 list price, and its October successor V4.1 Flash lists at $0.30/$1.20, with off-peak jobs at half that. GPT-5 Nano at $0.05/$0.40 is now the cheapest input rate from any major Western provider, undercutting Gemini 2.5 Flash-Lite at $0.10/$0.40 on input while matching it on output, until GPT-5 Nano leaves the API on December 11, 2026. Llama 4 Scout via API providers is available for as low as $0.10/$0.30. The budget output floor has dropped from roughly $0.50/M (late 2024) to $0.40/M, and it has now sat there for several quarters, which suggests the bottom of this market has found its level.

This asymmetric price compression means the cost-performance gap between tiers is widening. Frontier models are not getting cheaper, but mid-tier models are getting dramatically cheaper while maintaining quality. The result: the economic case for using frontier models for every task is weaker than ever. Intelligent routing between tiers saves more money today than at any point in AI history, and the September repricing at the top widened that gap rather than closing it.

---

12. Where This Is Heading

Predicting specific model releases is a fool's errand in this market. But the structural trends shaping the next 6-12 months are clear, and they have practical implications for infrastructure decisions you make today.

The Commoditization Thesis

The first-principles question is: what happens to pricing when intelligence becomes a commodity input?

The pattern from every previous technology wave is consistent. When a critical input (compute, storage, bandwidth, intelligence) transitions from scarce to abundant, three things happen simultaneously. The input price falls toward marginal cost of production. The businesses selling the raw input face margin compression. And the businesses that combine the cheap input with other scarce resources (domain expertise, customer relationships, regulatory knowledge, distribution) capture disproportionate value.

We are in the early stages of this transition for AI inference. The raw "intelligence" layer (the model API) is commoditizing. Frontier quality is available from at least five providers at roughly comparable levels. Budget quality is available for fractions of a cent per million tokens. The pricing trend line points toward continued compression, especially as open-weight models close the quality gap with closed-source offerings.

The businesses that will thrive are not the ones using the most expensive model. They are the ones that combine adequate intelligence with proprietary data, workflow integration, and domain-specific optimization. This is the thesis behind autonomous AI agent platforms, including O-mega, where the value is not in the model itself but in the orchestration, tool integration, memory, and domain adaptation built on top of the model layer. For a deeper exploration of this structural shift, see our analysis of AI agent orchestration.

What to Watch

Meta's Muse Spark line reached the Arena top five at 1499 ELO without published weights, and Meta has since answered the open question by releasing Muse Spark Open as downloadable weights. If its quality holds up in independent testing, it will compress frontier pricing further by making top-tier quality available for self-hosting.

Gemini's pricing strategy will shape the market. If Google continues to subsidize Gemini to drive Cloud Platform adoption, competitors will face sustained margin pressure. If Google raises prices to improve profitability, the competitive dynamics shift.

Reasoning model costs are the biggest unknown. o3 and Claude's thinking mode deliver measurably better results on hard problems, but at unpredictable and often high effective costs. The provider that makes reasoning affordable without sacrificing quality will capture significant market share.

Context window utilization is still nascent. Most applications do not yet fully exploit 1M+ token contexts. As more applications are designed for long-context workflows (multi-document analysis, full-codebase reasoning, long conversation histories), the providers with proven long-context performance (Google, Anthropic) will have an advantage.

As we covered in our guide to building AI agents, the choice of underlying model is just one component of a larger system design. The orchestration, memory, tool-calling, and feedback loop architecture often matter more than which specific model sits at the center.

---

Final Verdict: 2026 Model Recommendations

The table below summarizes the optimal model choice for each major use case. These recommendations are based on the benchmark data, pricing analysis, and provider profiles covered throughout this guide.

The single most important takeaway from this guide: there is no single best model. The "best" model depends entirely on your workload, volume, and requirements. The teams that win on AI infrastructure in 2026 are the ones that match the right model to the right task, using the cheapest adequate option for each query rather than defaulting to the most expensive frontier model for everything.

The data in this guide will be outdated within weeks. New models ship monthly. Prices change quarterly. Benchmarks evolve. But the structural framework for evaluating models (cost-performance frontiers, tier-based routing, benchmark-to-workload mapping) remains stable even as the specific numbers shift. Use this framework, update the numbers, and keep optimizing.

---

---

Every price and benchmark in this guide was re-verified against the providers' own pricing pages, model cards and announcements on September 8, 2026. Model releases, pricing changes, and benchmark updates happen monthly. Verify current details on each provider's pricing page before making infrastructure decisions. All pricing is in USD per million tokens unless otherwise noted.

What this article rests on

Every model figure above is read from its record, re-read from OpenRouter's model feed every 6 hours, so the figures on this page are current even where the prose around them is older. Prices are OpenRouter's listed price per million tokens: for a lab's closed models that is the lab's own list price, and for an open-weight model it is the price of the host OpenRouter routes to by default, which can differ from the lab's own API and from other hosts.

• GPT-6 Astra (OpenAI): $10 in and $50 out per million tokens, cached input $1, a 1.05M token window, listed 4 September 2026.
• anthropic/claude-fable-5.1: the feeds no longer list it; they list Claude Fable 5.2 in its place. The figures this article gives for it are as written.
• Gemini 3.8 Flash (Google): $0.75 in and $3.75 out per million tokens, cached input $0.075, a 1M token window, listed 2 September 2026.
• Claude Opus 5.5 (Anthropic): $4 in and $20 out per million tokens, cached input $0.20, a 1M token window, listed 22 September 2026.
• Gemini 4 Argon (Google): $2 in and $10 out per million tokens, cached input $0.10, a 1M token window, listed 13 October 2026.
• GPT-5.5 (OpenAI): $5 in and $30 out per million tokens, cached input $0.50, a 1.05M token window, listed 24 April 2026.
• GPT-5.4 (OpenAI): $2.50 in and $15 out per million tokens, cached input $0.25, a 1.05M token window, listed 5 March 2026.
• GPT-6.1 Sol (OpenAI): $2 in and $10 out per million tokens, cached input $0.10, a 1.05M token window, listed 29 September 2026.
• GPT-6.1 Terra (OpenAI): $1 in and $5 out per million tokens, cached input $0.05, a 1.05M token window, listed 26 October 2026.
• Claude Sonnet 5.5 (Anthropic): $2 in and $10 out per million tokens, cached input $0.10, a 1M token window, listed 28 September 2026.
• GPT-5 (OpenAI): $1.25 in and $10 out per million tokens, cached input $0.125, a 400K token window, listed 7 August 2025.
• google/gemini-2.5-pro: the feeds no longer list it; they list Gemini 4 Carbon in its place. The figures this article gives for it are as written.
• Llama 4 Maverick (Meta): $0.35 in and $1 out per million tokens, cached input $0.17, a 512K token window, listed 5 April 2025. Changed since: the input price was $0.1875 when this was written, now $0.35; the output price was $0.6525 when this was written, now $1.
• Llama 4 Scout (Meta): $0.10 in and $0.30 out per million tokens, a 320K token window, listed 5 April 2025.
• Claude Haiku 5.5 (Anthropic): $0.10 in and $0.50 out per million tokens, cached input $0.01, a 1M token window, listed 7 October 2026.
• GPT-6 Luna (OpenAI): $0.10 in and $0.50 out per million tokens, cached input $0.01, a 1.05M token window, listed 22 September 2026.
• Gemini 3.1 Flash Lite (Google): $0.25 in and $1.50 out per million tokens, cached input $0.025, a 1M token window, listed 7 May 2026.
• GPT-5.5 Pro (OpenAI): $30 in and $180 out per million tokens, a 1.05M token window, listed 24 April 2026.

Sourced facts

Each figure linked above is a fact checked against its source's own words, and the source is re-read daily.

• OpenAI deprecated the original gpt-5 snapshot (gpt-5-2025-08-07) on June 11, 2026 and will remove it from the API on December 11, 2026. OpenAI: "we notified developers using older GPT-5 and o3 model snapshots of their deprecation and removal from the API on December 11, 2026" (verified 2026-10-29, re-read 2026-11-12).

In this topic: AI models

• Best LLM for AI Agents: 20 Models Ranked (November 2026)
• Kimi K3.1 Pro: Benchmarks, Real Cost and Open Weights 2026
• Gemini 4 Argon vs Opus 5.5: Real Cost per Agent Task (2026)
• Muse Spark Open: Benchmarks, License, How to Run (2026)
• Gemini 4 Argon: Benchmarks, Real Cost and Access (2026)
• Meta Muse Wonder: Benchmarks, Pricing and Access (2026)
• GPT-6 Sol vs Astra vs Luna: Which Model to Use (2026)
• GPT-6.1 Sol vs Claude Opus 5.5: Real Cost per Task (2026)

Which AI model should your agents run on? Every guide on it