INDEPENDENT AI MODEL BENCHMARK
QBench Index 1.6
Compare model capability across source-audited evaluations. Explore rankings, benchmark-level evidence, exact effort variants and API price references.
SCORING FRAMEWORK
08 capability families
QBench Index 1.6 leaderboard
How QBench Index 1.6 works
Each benchmark keeps its reported 0–100 accuracy or task-success percentage. Results are averaged inside eight capability families, then the observed family means are averaged equally. Missing families are left out, not imputed and not pulled toward 50. Model effort variants are separate entries; unreported effort is never guessed.
Rank: at least 3 eligible evaluations across 3+ capability families · Evidence: full (all 8 families), broad (4–7), or limited (3) · Insufficient evidence: retained in Models, without an Index score.
Pareto frontier: open “Index vs. API price + Pareto”. The dashed frontier is on by default; the API token-price proxy is not cost per task.
Models
Models with at least one eligible result. Routers and specialist systems are identified separately. The API price catalog below also includes priced models outside the composite Index.
API price catalog
Per 1M input/output tokens. Official provider API and OpenRouter route prices are labelled separately.
| Model | Provider | Input / 1M | Output / 1M | Price source | Conditions |
|---|
Verified API inventory — not yet ranked
Officially documented model IDs that do not have an exact eligible QBench benchmark result. These models are not assigned scores or leaderboard positions.
| Model | Provider | Official API ID | Context | API price | Status |
|---|
Comparison
Category radar uses source-reported capability-family percentages. Empty spokes mean the category has no result for that model/effort variant.
Provider landscape
Provider coverage from source-audited eligible results. Scores include ranked variants only.
The chart shows the mean QBench Index of ranked variants for the 15 providers with the most ranked variants. The table includes every provider represented in the eligible result set. It is not a provider quality rating.
| Provider | Model names | Variants | Ranked | Mean Index | Priced models |
|---|
Measured task economics
Compare cost, duration or token usage within one benchmark and its stated harness. Metrics from different benchmarks are not pooled.
Only publisher-reported measurements are shown. Missing cost, duration and token fields are not estimated.
| Model | Provider | Effort | Score | Cost / test | Cost / successful task | Duration / test | Tokens / test | Source |
|---|
Benchmark directory
Select a benchmark to see its model scores. The status shows whether it enters the index.