CraftBench-UE: Deterministic Evaluation for Coding Agents in Unreal Engine
CraftBenchUE is introduced, an evaluation harness that runs agents in an isolated Unreal Engine environment, reconstructs their saved submissions in fresh projects, and applies deterministic build, asset, and runtime checks without an LLM judge.
Shu-Tong Wu, Kevin Calderone, A. Tsen
· 0 citations