Wei-Nan Gan

Select-TTT: Query-Conditioned Selective Fast Weight Updates for In-Place Test-Time Training

Test-time training (TTT) enables a deployed language model to internalize incoming context on-the-fly into a small set of fast-weight parameters, rather than merely treating it as transient context for attention. In-Place TTT recently made this idea practical for large language models by repurposing the down-projection...