Assessing safety and trustworthiness of large language models in medicine
It is shown that current large language models generally perform poorly on most of the safety tests, regardless of their safety alignment mechanisms, which underscores the crucial need for ongoing human oversight and the implementation of strict safety guardrails before deploying these tools in clinical practice.