How effective are traditional test criteria at detecting bugs in large language models generated code?
An empirical study involving 5 Large Language Models and 4 benchmarks evaluates the effectiveness and efficiency of 3 widely used adequacy criteria: statement coverage, branch coverage, and mutation testing, finding that mutation testing only marginally outperforms traditional coverage criteria in both triggering and detecting faults.
Asma Hamidi, Michael Konstantinou, R. Degiovanni et al.
· 0 citations