Stress-testing Alignment Midtraining
There is not enough public evidence for us to confidently state that midtraining can address the core difficulties inherent in aligning powerful AI systems, and it is believed that demonstrations must be present either in midtraining or post-training datasets for these rules to be robustly learned.
Sid Baines, Jonathan Bostock, M. Martínez et al.
· 1 citation