What is Benchmark?

Benchmarks measure models on fixed task sets — coding (SWE-bench), knowledge (MMLU-Pro), science (GPQA), or human preference (LMArena Elo). They enable comparison but saturate over time and can be gamed by training on test data, which is why new, harder benchmarks keep appearing.