Charles O'Neill

Can a Language Model Learn Facts Continually in Its Weights?

This work follows invented facts written into Qwen3 models from creation through sequences of twenty to one hundred later writes, using held-out questions of five types, and finds that facts can be behaviourally forgotten without being erased.