Ilya V. Shulepov

Mutation Testing for Reproducibility Safeguards in Machine Learning Research Software: An Empirical Study

It is shown that, in this sample, existing validation workflows often did not detect the particular controlled reproducibility-relevant changes introduced by the study, motivating reproducibility-oriented mutation testing as a complementary way to assess whether research-software safeguards constrain experimentally important choices.