Material replacement is a common interior-design operation: changing the material of a selected surface while preserving its geometry, surroundings, and illumination. Despite its commercial relevance, no public benchmark isolates this task, and evaluating it is challenging. Reference-based metrics penalize valid output...
Ming-Zhe Du, T. Nguyen, Nguyen Tran Cong Duy et al.· 0 citations
Ockhamareto is introduced, a single-shot GRPO framework for unit-test generation and selection, based on the principles of Ockham's Razor and Pareto Optimality, and it is shown that the knee point of the optimal trade-off between efficiency and effectiveness on the Pareto front is not correlated with obvious more easil...
Dong Huang, Mark Harman, Jie M. Zhang et al.· 3 citations
Mutation analysis as an adequacy metric for kernel-benchmark oracles is introduced: deterministic rules inject 10 compilable faults into verified CUDA implementations of 188 KernelBench problems, 7{,}384 of them with an independent kill witness; any test protocol is scored by the fraction it detects.
Ming-Zhe Du, A. Lưu, Dong Huang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.