Benchmarks and Limits
A benchmark is a fixed test used to compare models.
For language models, a benchmark may contain multiple-choice questions, short answers, coding tasks, math problems, summaries, tool-use tasks, or human preference judgments. The useful part is standardization: every model is tested on the same examples, or at least under the same published rules.
That makes benchmarks valuable. It also makes them easy to overread.
What a Benchmark Measures
A benchmark measures performance on its own task distribution.
If a benchmark contains high-school science questions, it measures performance on that kind of question under that prompt format and scoring rule. It does not automatically measure:
- whether the model can solve every science problem;
- whether the model can teach science well;
- whether the model is reliable in a product;
- whether the model will behave well under a different prompt;
- whether the model knows why its answer is correct.
The number is evidence. The number is not the model.
Small Example
Suppose a benchmark has 100 questions.
Model A answers 82 correctly. Model B answers 78 correctly.
On this benchmark:
Model A did better on this test. That is the strongest clean statement.
It is weaker to say "Model A is always better." The benchmark may be narrow, the difference may be unstable, or the user's task may need a different skill.
Why One Number Can Mislead
Benchmark scores can mislead for several reasons.
Task mismatch. A model can do well on exam-style questions and still fail at long document editing, careful tutoring, codebase navigation, or tool use.
Prompt sensitivity. The same model can change behavior when instructions, format, examples, or decoding settings change.
Contamination. If benchmark examples or close variants appear in training data, the score may partly measure memory rather than general ability.
Repeated tuning. If teams repeatedly adjust models to improve one benchmark, that benchmark becomes less independent evidence.
Aggregation. A single average can hide uneven behavior. A model may be strong on easy items and weak on the hard items a user actually cares about.
Reading a Benchmark Claim
When you see a benchmark result, ask five questions:
- What exactly was tested?
- How was the answer scored?
- Was the evaluation split independent of training and tuning?
- How large and varied was the benchmark?
- Does this task resemble the use case I care about?
These questions do not dismiss benchmarks. They make benchmarks useful.
Relation to Language Modeling
Language-model training rewards likely continuations. Benchmarks test selected behaviors after training. The connection is indirect.
A model may produce a likely-looking answer that is wrong. It may also solve a benchmark item for the wrong reason. This is why benchmark evaluation must be combined with error analysis: read the failures, not only the average.
A benchmark has 100 questions. A model answers 82 correctly. What is the accuracy percentage?
Compute it first, then check your number.
Hint
Divide correct answers by total questions, then multiply by 100.
Solution
The model answered 82 out of 100 questions correctly:
As a percentage, that is 82 percent.
Model A scores 82 percent and Model B scores 78 percent on the same benchmark
with the same scoring rule. Which model scored higher: A or B?
Answer it first, then check.
Hint
Compare the two percentages on the same setup.
Solution
Model A scored higher on that benchmark because 82 percent is greater than 78 percent. The careful claim is limited to that benchmark and scoring rule.
Should one benchmark score be treated as complete proof of model usefulness?
Answer yes or no.
Answer it first, then check.
Hint
Ask whether one task distribution can cover every use case.
Solution
No. One benchmark score is evidence about one evaluation setup. It is not complete proof that the model is useful for every task.
Enter 1 if benchmark contamination can make a score too optimistic.
Compute it first, then check your number.
Hint
Ask whether the model may have seen the test examples or close variants.
Solution
Enter 1. If benchmark examples or close variants appeared in training, the
score may partly reflect memorization or familiarity.
A benchmark has two sections. A model scores 95 on Section 1 and 55 on Section 2. What is the average score?
Compute it first, then check your number.
Hint
Add the two section scores and divide by 2.
Solution
The average is:
The average is 75, but it hides the uneven behavior between the two sections.
Before Moving On
Read benchmark scores as evidence with a scope. A good report says what was tested, how it was scored, how independent the test was, and where the model failed.