Milkiyas Gebremichael Gebru

Re-evaluating Detection of Equivalent Mutants using LLMs: We Should Properly Measure How Far We Are

Evaluating the generalization capabilities of the proposed LLM-based EMD techniques across two additional datasets that differ from the prior dataset in mutation operators, programming languages, or source projects finds that the studied LLMs tend to rely on a method-wise majority-voting shortcut rather than reasoning...