Jul 2026
UI2App: Benchmarking Visual Interaction Inference in Executable Web Application Generation
UI2App is the first benchmark targeting interaction inference, the ability to recover application behavior from screenshots alone, without any textual or behavioral guidance, and designs an end-to-end pipeline that evaluates each artifact along four dimensions: executability, navigation reachability, visual fidelity, and interaction inference.
Grace Man Chen, Litao Guo, Yifan Wu et al.
· arXiv.org · 0 citations