Model performance for basic medication tasks was consistently poor, highlighting the need for domain-specific training through clinician-annotated datasets and a comprehensive evaluation framework for benchmarking performance.
Kelli R. Henry, Steven Xu, Kaitlin Blotske et al.· American Journal of Health-S...· 0 citations
Substantial variability exists in both DDI identification performance and uncertainty calibration across large language models, and prompt design alone was insufficient to consistently improve knowledge-aware uncertainty expression.
Adeleine Tilley, Brian Murray, Kelli R. Henry et al.· Journal of Managed Care & Sp...· 0 citations
It is found that sensitivity to demographic cues is distributed across internal units and varies substantially across models, suggesting that effective mitigation requires understanding distributed, task-specific mechanisms rather than manipulating a small set of identified neurons alone.
A systematic study spanning five KG task formulations, three training paradigms, two KGs, and three base LLMs finds that at the task level, all paradigms improve over the non-finetuned baseline, but methods with comparable in-domain accuracy show substantially different knowledge transfer behavior.
Saksham Khatwani, He Cheng, M. Afshar et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.