Review
Aug 2026
VulnGym: Benchmarking Coding Agents for Repository-Level Vulnerability Detection
VulnGym is a real-world repository-level benchmark for evaluating vulnerability detection by coding agents that aligns reviewed GitHub advisories with their corresponding vulnerable version repositories and defines an end-to-end detection task and three oracle-based subtasks to jointly evaluate vulnerability detection and diagnose limitations in code localization and evidence construction.
Kexing Ji, Jiachen Liu, En-Ze Hu et al.
· 2 citations