CryptanalysisBench: Can LLMs do Cryptanalysis?
This paper introduces CryptanalysisBench, 191 tasks across six families of cryptographic primitives drawn primarily from four NIST standardization competitions, and releases CryptanalysisBench as a tool to help track if (or when) AI cryptanalysis becomes a serious factor and as a scaffold for stress-testing candidate s...