Vance Woodward

The Road to AI Chernobyl: Good Intentions, Safety Filters, and Invisible Failure

Safety training can teach an AI to make fewer mistakes. It can also teach it to hide themistakes it still makes. Both can produce better test scores. This paper explains how thathappens, examines experiments that have produced it, and asks what follows for the risk ofa major accident. A passed test is reassuring when t...