It is found that merely warning the agents of potential imposter presence is not beneficial: it degrades decisions when no imposter is present, provokes reactions ranging from self-accusation to scapegoating, inflates token use, and reveals to the imposter how it was uncovered.
A. Mercier, Chris Develder, Thomas Demeester· 1 citation
Two training-time mitigations, label augmentation and shortcut-targeted hard negatives, which reduce judged nonsense while preserving ranking performance are studied.
W. Veys, Matthias De Lange, Jens-Joris Decorte et al.· Proceedings of the 20th ACM...· 0 citations
This paper studies the phenomenon whereby specific short input phrases induce a partial amnesia effect in state space models, by irreversibly overwriting information in their hidden states, referred to as a Hidden State Poisoning Attack (HiSPA).
A. Mercier, Chris Develder, Thomas Demeester· arXiv.org· 3 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.