Jul 2026
From Business Requirements to Test Assertions: Evaluating LLM-Generated Oracles on Real Bugs
No detectable linear relationship exists between requirement properties and oracle accuracy in this dataset, suggesting that pretraining coverage and the semantic specificity of the required behavior dominate oracle correctness.
Tiancheng Ma, Nasir U. Eisty
· arXiv.org · 0 citations