Skip to content

DEV Community

Leaderboard Forensics Series' Articles

Back to Ward Ed's Series

Cover image for When a 0.4-Point Lead Means Nothing: Reading Open-Model Leaderboard Margins Like a Statistician

Ward Ed

Oct 6

When a 0.4-Point Lead Means Nothing: Reading Open-Model Leaderboard Margins Like a Statistician

#huggingface #llm #benchmark #machinelearning

7 min read

Cover image for Benchmark Contamination 101: How Train/Test Overlap Inflates Leaderboard Scores (and How to Catch It)

Ward Ed

Oct 6

Benchmark Contamination 101: How Train/Test Overlap Inflates Leaderboard Scores (and How to Catch It)

#machinelearning #llm #benchmark #datascience

7 min read