AI agents keep long-term memory, much of which comes from web pages and tool results. Agent harnesses, the software that runs the model, do not record who may act on this memory, so an instruction hidden in a fetched page can be treated as the user's own instruction. We propose ClawMMU, a protection layer that labels e...
Jin-Hao Hu, Bardia Mohammadi, Mofasshara Rafique et al.· 0 citations
The findings support evaluation practices that separate preference from safety, report safety-critical failure rates directly, and incorporate clinically grounded adjustments when ranking LLMs for clinical decision making.
F. Elhassan, David Sasu, A. Kulinkina et al.· 0 citations
CLIMB is introduced, a benchmark in which a doctor model interviews a simulated patient to recover a ground truth set of co-occurring clinical conditions, and a theoretical reference model of single-hypothesis tracking is formalised with a theoretical reference model of single-hypothesis tracking.
Yusuf Kesmen, A. Mukherjee, Ye-Na Chang et al.· 0 citations
The hypMOOVE-PHC study is the hypothetical vignette phase of the Massive Open Online Validation and Evaluation (MOOVE) initiative, implemented in Kenya, Malawi, and Tanzania, and aims to validate a pool of LLMs through clinical review of expert-generated vignettes through fully crossed repeated-measures comparative eva...
P. Macharia, C. Kachimanga, M. Mahende et al.· medRxiv· 0 citations
This work reconstructs a coupled-fact graph as reconstructing a coupled-fact graph: at each edit, a required fact comes from recent context or parametric memory, and the facts covered by neither form coherence debt.
Bardia Mohammadi, L. Klein, Aman Chadha et al.· 3 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.