J. Dontabhaktuni

Phantom transitions in language model fine-tuning

This work builds an order parameter combining the predicted distribution with embedding overlap, as a density matrix, and shows sharp jumps resembling phase transitions, which characterize this near-synonym mechanism and need recalibration before extrapolation.