Literal to a Fault? How Large Language Models Handle Instructions That Break Codified Operational Rules
A benchmark of 75 items grounded in the International Regulations for Preventing Collisions at Sea and in paraphrased International Civil Aviation Organization procedures, spanning four conflict framings, each presented with and without the governing rule and followed by a pushback turn is released for evaluating rule-...