Shlok Gilda

Position: Evaluation Scores Are Perishable Knowledge Claims

It is argued that evaluation scores should be treated as epistemic claims with three properties: formality (human evaluation provides stronger evidence than an automated metric), scope (a benchmark result applies to the tested distribution, not universally), and validity windows (benchmark results expire as contaminati...