Evaluating language-guided mobile agents has recently shifted from rule-based to model-based approaches to achieve scalable and automated assessments. However, existing holistic evaluation paradigms process entire trajectories at once, leading to substantial context overload. Moreover, they primarily focus on task comp...
Peng-Jian Yang, Zijing Gao, Xue Yu et al.· 1 citation
This paper introduces SeerGuard, a consequence-aware safety framework designed to mitigate risks through pre-execution instruction-level screening and action-level risk assessment, and constructs a unified safety-augmented world model (SAWM) via multi-task learning, integrating semantic next-state prediction with safet...
Xue Yu, Bo Yuan, Peng-Jian Yang et al.· arXiv.org· 1 citation
Test-time scaling (TTS) reliably improves reasoning in large language models, but whether it transfers to small open vision-language models remains unclear. We examine this on EXAMS-V, a multilingual visual multiple-choice benchmark, comparing self-consistency, describe-then-reason with PRM-guided beam search, and two...
Spiros Baxevanakis, Peng-Jian Yang· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
