SWE-Clar: Can Coding Agents Clarify Incomplete Client Requirements and Deliver Greenfield Software?
SWE-Clar, a benchmark grounded in real, high-value client commissions to evaluate requirement clarification and code implementation in this setting, comprises 100 tasks based on real software development jobs on Upwork, each with at least US\$4,000 in total payments.
Jia-Lei Li, Ding-Xian Wang, Xiao-Yan Zhao et al.
· 0 citations