LMAO: Language Model Anomaly Observer
With the increase in adoption of Generative AI (GenAI) and Large Language Models (LLMs), concerns on their security, such as prompt injection and unauthorised model behaviour, arise. These pose significant risks to data confidentiality, system integrity, and user trust. To counter this, this project presents LMAO (Language Model Anomaly Observer), a behavioural monitoring framework which incorporates AI/ML and telemetry-based analysis to detect abnormal actions displayed by GenAI models.
Wei Xin Lai, Hui Li Tay, Timothy Cun Kiat See et al.
· Singapore Institute of Techn... · 0 citations