The VEX-Bench is introduced, a unified benchmark for evaluating the verification complexity of LLM-generated misinformation, as perceived during screening, across models and generation methods, and shows that no single method dominates all dimensions, underscoring the need for multi-dimensional evaluation.
Hanxun Huang, Yu-Tao Wu, Qi-Zhou Wang et al.· 0 citations
RLCDAlignBench is presented, which benchmarks Jev on ten alignment failures: sycophancy, jailbreaks, deception, prompt injection, hallucination, privacy violation, social bias, reward hacking, concealing uncertainty, and power seeking.
Ruo-Qi Guo, Yi Liu, Ge-Lei Deng et al.· 6 citations
The benchmark evaluates whether agents can recognize and interrupt harm arising from accumulated context, repeated tool use, intermediate actions, and dependencies across steps, and indicates that current systems remain highly vulnerable.
Yun-Hao Feng, Yifan Ding, Ying-Shui Tan et al.· arXiv.org· 18 citations· ⚡1
HazardAuditor is introduced, an execution-grounded framework that runs heterogeneous agents in controlled environments and normalizes their interactions into a canonical event representation for cross-framework supervision, and observes that token-level post-training objectives create a structural mismatch for generati...
Yun-Hao Feng, Rui-Xiao Lin, Ming Wen et al.· 0 citations
The results suggest that directly asking for the target response may not always yield the most effective score for predicting it, and that comparing direct scores with indirect paths through related judgments may reveal a more effective predictive route.
Zonghuan Xu, Xiang Zheng, Yu-Tao Wu et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.