Towards an Automated Test of LLM Security Knowledge
A partially-automated method for assessing LLM knowledge of a security area using authoritative information from Consumer Protection Agencies to identify instability in LLM responses that can be indicative of knowledge gaps is introduced.
Shufan Chai, Liangliang Sun, J. Staddon
· 0 citations