FRENES

The Lab · free tool

LLM benchmark: model rankings, scores and prices

This benchmark compares 164 language models on the scores published by Epoch AI and on their real price. Pick a measure, filter, and the chart shows the best-value models.

Horizontal axis: blended price (3 input tokens for 1 output token), log scale. Vertical axis: the chosen measure. In orange, the best-value frontier: no other model is both cheaper and better scored.
Models, prices and scores
ModelVendorContextInput $/MOutput $/MECIGPQA
Claude Opus 5.5Anthropic1,000k420168.890.6 %
GPT-6 AstraOpenAI1,050k1050168.895.8 %
GPT-6.1 SolOpenAI1,050k210168.495.4 %
Claude Fable 5.1Anthropic1,000k1050166.5—
Gemini 4 ArgonGoogle1,049k210166.596.4 %
Claude Sonnet 5.5Anthropic1,000k210166.295.6 %
Claude Opus 5Anthropic1,000k525163.993.9 %
GPT-6 SolOpenAI1,050k210163.794.3 %
Claude Fable 5Anthropic1,000k1050163.485.9 %
GPT-5.5 ProOpenAI1,050k30180162.9—
GPT-5.6 SolOpenAI1,050k420162.893.5 %
Muse WonderMeta1,049k420161.9—
GPT-5.6 TerraOpenAI1,050k212160.193.3 %
GPT-5.5OpenAI1,050k530159.790.7 %
GPT-5.4 ProOpenAI1,050k30180159.694.6 %
Claude Haiku 5.5Anthropic1,000k0.10.5159.389.7 %
Claude Opus 4.8Anthropic1,000k52515991 %
Gemini 3.7 FlashGoogle1,049k0.753.7515894.8 %
Kimi K3 ●openMoonshot AI1,049k0.23910.8157.993.1 %
Gemini 3.8 FlashGoogle1,049k0.8254.125157.495.4 %
GPT-5.4OpenAI1,050k2.515157.393.3 %
Muse Spark 1.3Meta1,049k1.254.25157.2—
GPT-5.3-CodexOpenAI400k1.7514157.1—
Claude Sonnet 5Anthropic1,000k210156.990.5 %
Claude Opus 4.7Anthropic1,000k525156.890.2 %
GPT-6 LunaOpenAI1,050k0.10.5156.890.5 %
Grok 4.6xAI500k26156.694 %
GPT-5.6 LunaOpenAI1,050k0.21.2156.591.6 %
GPT-5.2 ProOpenAI400k21168156.3—
GLM 5.3 ●openZ.ai (Zhipu)1,049k0.0791.415690.9 %
DeepSeek V4.1 Flash 1017 ●openDeepSeek1,049k0.150.6155.993.2 %
DeepSeek V4.1 Flash ●openDeepSeek1,049k0.021155.993.2 %
Claude Opus 4.6Anthropic1,000k525155.790.5 %
DeepSeek V4 Pro 0813 ●openDeepSeek1,049k0.661.98155.691.7 %
DeepSeek V4 Pro 0423 ●openDeepSeek1,049k0.2090.418155.691.7 %
Gemini 3.1 Pro PreviewGoogle1,049k212155.394.4 %
Muse Spark Open ●openMeta1,049k1.254.25155.1—
Qwen3.8 Max (0902)Alibaba (Qwen)1,000k26155.192.3 %
Muse Spark 1.2Meta1,049k1.254.25155.1—
Gemini 3.5 FlashGoogle1,049k1.59154.992.8 %
DeepSeek V4 Flash 0731 ●openDeepSeek1,049k0.0440.133154.891 %
DeepSeek V4 Flash 0423 ●openDeepSeek1,049k0.0910.182154.891 %
Gemini 3.6 FlashGoogle1,049k0.753.75154.594.1 %
Grok 4.7xAI500k26154.492.7 %
Grok 4.5xAI500k26154.193.4 %
Muse Spark 1.1Meta1,049k1.254.25154.1—
Qwen3.7 MaxAlibaba (Qwen)1,000k1.4754.42515490.9 %
GPT-5.2OpenAI400k1.7514153.791.4 %
GLM 5.3 Flash ●openZ.ai (Zhipu)1,049k0.150.5153.190.2 %
Claude Sonnet 4.6Anthropic1,000k315152.887.4 %
Grok 4.20xAI2,000k1.252.5152.1—
GLM 5.2 ●openZ.ai (Zhipu)1,049k0.0347151.991.9 %
Gemini 3 Flash PreviewGoogle1,049k0.53151.989.4 %
Qwen3.8 27B ●openAlibaba (Qwen)1,000k0.22.5151.7—
Kimi K2.6 ●openMoonshot AI262k0.653.41150.990.8 %
GPT-5 ProOpenAI400k15120150.6—
Inkling Small ●openThinking Machines Lab524k0.451.2150.388.5 %
Kimi K2.7 Code ●openMoonshot AI262k0.6733.1150.187.9 %
Claude Opus 4.5Anthropic200k525150.186.1 %
Mistral Large 4Mistral AI1,049k1.364.1815088.1 %
GPT-5OpenAI400k1.251015086.2 %
GLM 5.1 ●openZ.ai (Zhipu)205k1.44.4149.889.9 %
GPT-5.1OpenAI400k1.2510149.887.6 %
GPT-5.4 MiniOpenAI400k0.754.5148.786.9 %
Inkling ●openThinking Machines Lab524k14.05148.488.3 %
Kimi K2.5 ●openMoonshot AI262k0.52.5148.1—
o3 ProOpenAI200k2080147.3—
Qwen3.6 PlusAlibaba (Qwen)1,000k0.3251.95147.388.4 %
Qwen3.7 PlusAlibaba (Qwen)1,000k0.321.2814787.9 %
MiniMax M3 ●openMiniMax1,049k0.31.2146.990.9 %
Qwen3.5 397B A17B ●openAlibaba (Qwen)262k0.53.6146.886.4 %
Claude Sonnet 4.5Anthropic1,000k315146.782.3 %
o3OpenAI200k28146.781.8 %
MiniMax M2.5 ●openMiniMax205k0.31.2146.6—
Qwen3.6 27B ●openAlibaba (Qwen)262k0.252146.285.9 %
DeepSeek V3.2 ●openDeepSeek164k0.280.42146.1—
GPT-5.4 NanoOpenAI400k0.21.2514678.5 %
Nemotron 3 Ultra ●openNVIDIA262k0.62.414685.4 %
Kimi K2 Thinking ●openMoonshot AI262k0.62.5145.8—
GLM 5 ●openZ.ai (Zhipu)205k13.2145.887.8 %
MiniMax M2.7 ●openMiniMax205k0.31.2145.8—
o4 MiniOpenAI200k1.14.4145.579.6 %
GPT-5 MiniOpenAI400k0.252145.375 %
Gemini 3.5 Flash LiteGoogle1,049k0.32.5144.983.3 %
DeepSeek V3.2 Exp ●openDeepSeek164k0.270.41144.9—
Gemini 3.1 Flash LiteGoogle1,049k0.251.5144.381.8 %
Gemini 3.1 Flash Lite PreviewGoogle1,049k0.251.5144.381.8 %
Claude Opus 4.1Anthropic200k1575144.177.3 %
Qwen3.7 FlashAlibaba (Qwen)1,000k0.030.13144.182.3 %
Qwen3.6 35B A3B ●openAlibaba (Qwen)262k0.10.95143.784.9 %
GLM 4.7 ●openZ.ai (Zhipu)205k0.541.98143.683.3 %
Gemma 4 31B ●openGoogle262k0.20.414375.8 %
Qwen3.6 FlashAlibaba (Qwen)1,000k0.1881.125142.983.3 %
Qwen3.5-35B-A3B ●openAlibaba (Qwen)262k0.141142.583.5 %
Claude Haiku 4.5Anthropic200k15142.271.2 %
Gemma 4 26B A4B ●openGoogle262k0.0680.225141.973.2 %
o1OpenAI200k1560141.776.8 %
Mistral Medium 3.5 ●openMistral AI262k1.57.5141.4—
o3 MiniOpenAI200k1.14.4140.277 %
DeepSeek V3.1 ●openDeepSeek164k0.250.95139.8—
gpt-oss-120b ●openOpenAI131k0.150.6139.8—
Qwen3.5-9B ●openAlibaba (Qwen)262k0.170.25139.379 %
GPT-5 NanoOpenAI400k0.050.4139.269.4 %
R1 0528 ●openDeepSeek164k0.52.15138.876.3 %
Qwen3 32B ●openAlibaba (Qwen)131k0.080.28138.465.7 %
Qwen3 14B ●openAlibaba (Qwen)41k0.120.24138.263.8 %
gpt-oss-20b ●openOpenAI131k0.0180.09137.760.8 %
GPT-4.1OpenAI1,048k28136.766.9 %
Qwen3 30B A3B ●openAlibaba (Qwen)41k0.120.5136.161.7 %
GPT-4.1 MiniOpenAI1,048k0.41.6134.965.9 %
Mistral Medium 3Mistral AI131k0.42134—
DeepSeek V3 0324 ●openDeepSeek164k0.291.14132.367.6 %
DeepSeek V3 ●openDeepSeek164k0.2571.029132.371.2 %
Llama 4 Maverick ●openMeta524k0.1880.653132.2—
Phi 4 ●openMicrosoft16k0.070.14130.556.1 %
Gemma 3 27B ●openGoogle131k0.080.3513047.7 %
Llama 4 Scout ●openMeta1,311k0.10.3129.6—
GPT-4.1 NanoOpenAI1,048k0.10.4129.548.9 %
GPT-4o-miniOpenAI128k0.150.6126.537.7 %
GPT-4o-mini (2024-07-18)OpenAI128k0.150.6126.537.7 %
Gemma 3 12B ●openGoogle131k0.050.15123.539.5 %
Gemma 2 27B ●openGoogle8k0.650.65122.136.5 %
Mistral LargeMistral AI128k26122.1—
Mistral Nemo ●openMistral AI131k0.0290.03118.7—
Gemma 3 4B ●openGoogle131k0.040.05115.923.2 %
Grok 4.3xAI1,000k1.252.5—88.8 %
Qwen3.5 Plus 2026-04-20Alibaba (Qwen)1,000k0.31.8—84.9 %
Qwen3.5-FlashAlibaba (Qwen)1,000k0.0650.26—82.3 %
Gemini 3.1 Pro Preview Custom ToolsGoogle1,049k212——
Qwen3.5 Plus 2026-02-15Alibaba (Qwen)1,000k0.261.56—84.9 %
GLM 4.7 Flash ●openZ.ai (Zhipu)200k0.0610.4—60.5 %
GPT-5.2-CodexOpenAI400k1.7514——
MiniMax M2.1 ●openMiniMax205k0.31.2——
GPT-5.1-Codex-MaxOpenAI400k1.2510——
GPT-5.1-CodexOpenAI400k1.2510——
GPT-5.1-Codex-MiniOpenAI400k0.252——
MiniMax M2 ●openMiniMax205k0.2551.02——
Granite 4.0 Micro ●openIBM131k0.0170.112—28.3 %
GLM 4.6 ●openZ.ai (Zhipu)205k0.552.2——
Qwen3 30B A3B Instruct 2507 ●openAlibaba (Qwen)262k0.090.3—55.6 %
Qwen3 235B A22B Thinking 2507 ●openAlibaba (Qwen)128k0.453.5—80.1 %
Qwen3 235B A22B Instruct 2507 ●openAlibaba (Qwen)262k0.090.55——
Gemini 2.5 FlashGoogle1,049k0.32.5——
Gemini 2.5 ProGoogle1,049k1.2510—85.3 %
Gemini 2.5 Pro Preview 06-05Google1,049k1.2510—85.3 %
o1-proOpenAI200k150600——
Qwen2.5 VL 72B Instruct ●openAlibaba (Qwen)128k0.81——
Qwen-PlusAlibaba (Qwen)1,000k0.260.78—48.1 %
Llama 3.3 70B Instruct ●openMeta131k0.10.32—47.4 %
GPT-4o (2024-11-20)OpenAI128k2.510—47.9 %
Mistral Large 2407Mistral AI131k26—49 %
Qwen2.5 Coder 32B Instruct ●openAlibaba (Qwen)33k0.661——
Qwen2.5 7B Instruct ●openAlibaba (Qwen)33k0.10.2—35.5 %
Llama 3.2 1B Instruct ●openMeta60k0.0270.201—23.9 %
Qwen2.5 72B Instruct ●openAlibaba (Qwen)33k0.360.4—49.2 %
GPT-4o (2024-08-06)OpenAI128k2.510—49.2 %
Llama 3.1 70B Instruct ●openMeta131k0.40.4—44.2 %
Llama 3.1 8B Instruct ●openMeta131k0.050.08—27 %
GPT-4oOpenAI128k2.510—47.9 %
GPT-4o (2024-05-13)OpenAI128k515—48.9 %
GPT-4 TurboOpenAI128k1030—46.6 %
GPT-3.5 Turbo (older v0613)OpenAI4k12—28 %
GPT-3.5 TurboOpenAI16k0.51.5—28 %
GPT-4OpenAI8k3060—35.7 %

How to use it

The table lists the 164 language models for which Epoch AI publishes at least one score, with their public price taken from OpenRouter on October 25, 2026. Start by picking the measure that matches your use: the overall capabilities index for a broad view, SWE-bench Verified or Terminal-Bench if you need a model for a coding agent, GPQA Diamond for scientific reasoning, ARC-AGI for the ability to adapt to never-seen problems.

  • Then filter by vendor, by licence type (open weights you can run yourself, or proprietary models available through an API), by minimum context size and by maximum blended price.
  • The chart redraws at every change. Hover or tap a dot to read the name, price and score; click to open the model's page.
  • Click a table header to sort (click again to reverse). The last column always shows the chosen measure.

Everything runs in your browser: nothing is sent anywhere, and the page keeps working offline once loaded.

What the selected benchmarks measure

The Epoch AI Capabilities Index (ECI) combines many benchmarks into a single number, on a scale that makes it possible to compare models that did not all take the same tests. 125 models in the table have one; the highest on October 25, 2026 belongs to Claude Opus 5.5 (168.8). Individual benchmarks say more specific things:

  • GPQA Diamond : PhD-level science questions (124 models scored)
  • SWE-bench Verified : fixing real GitHub issues (28 models scored)
  • Terminal-Bench : real tasks in a terminal (37 models scored)
  • ARC-AGI-1 : visual abstract-reasoning puzzles (73 models scored)
  • ARC-AGI-2 : harder version of the ARC puzzles (73 models scored)
  • FrontierMath : research-level maths problems (tiers 1-3) (85 models scored)
  • OTIS Mock AIME : maths competition problems (124 models scored)
  • SimpleQA Verified : accuracy on simple facts (80 models scored)
  • Aider Polyglot : coding exercises in several languages (25 models scored)
  • OSWorld : operating a desktop computer (6 models scored)

Scores are success rates. A gap of two or three points between two models is often within the test's margin of error: look instead at clear gaps and at consistency across several benchmarks close to your use. To understand why ARC-AGI remains hard for models, see the glossary entry.

Reading the score / price chart

The blended price weighs three input tokens for one output token, which matches the typical use of an assistant or an agent: you send a lot of context (files, history, tool results) and receive a shorter answer. The horizontal scale is logarithmic, because prices range from a few cents to several tens of dollars per million tokens.

Orange dots form the Pareto frontier: for each of them, no other displayed model is both cheaper and better scored on the chosen measure. That is where to look for the best value. A model far below the frontier costs more than another that does better; it may still be worth it for a reason the chart does not show (longer context, open weights, hosting in a given region, built-in tool).

To go from a price per million tokens to a real monthly budget, use the Lab's price calculator, and the guide LLM API pricing to understand billing.

Where the data comes from

Scores and the ECI come from Epoch AI's public database (CC BY 4.0 licence), which runs part of the evaluations itself and takes the rest from public leaderboards. Prices come from OpenRouter's public API: the price listed by the model's main provider, in dollars per million tokens. Both sources are refreshed at every site update; the latest run is dated October 25, 2026. The table holds 68 open-weight models and 96 proprietary models.

Limits to keep in mind

  • Uneven coverage. Not every model took every test: a model missing from a measure is not bad, it simply has no published score.
  • Contamination. Some public questions end up in training data; tests kept partly private (such as ARC-AGI-2 or FrontierMath) resist it better.
  • Settings. The same model can score differently depending on reasoning effort, number of attempts or allowed tooling. Epoch AI states its test conditions for each result.
  • Variable prices. An open-weight model is often offered by several hosts at different rates, and prices change often. Prompt caching and batch processing can cut the bill.
  • A benchmark is not your task. Before choosing, test two or three frontier models on a dozen of your own real cases.

The full approach is explained in the guide Choose a model.

Sources

Frequently asked questions

What is the best LLM right now?

On Epoch AI's capabilities index, Claude Opus 5.5 leads on October 25, 2026. But “best” depends on the task and the budget: pick the measure closest to your use and look at the orange frontier.

Why are some well-known models missing?

The table only keeps models that have at least one score published by Epoch AI and a public price. The others have their page in the model directory, without a score.

Are scores supplied by the vendors?

No: they come from Epoch AI, an independent research institute. No vendor pays to appear or rank higher in this table.

What does “open weights” mean?

The model's parameters can be downloaded: you can run it on your own hardware or with the host of your choice. The licence may still restrict commercial use.

How often is the table updated?

At every source run, at least once a week. The latest is dated October 25, 2026.

Neutrality. No affiliate links. No vendor pays to be reviewed, rated or ranked. Reviews are directed by François Chollet, neutral and factual, and every data point is dated and sourced. How we score