Implicit Rule Induction with Test-Time Task Embeddings in ARC-like Tasks
A novel two-step TTT protocol is introduced: first finetune only the task embedding (Embed-TTT), then freeze it and finetune the backbone, which shows that Embed-TTT consistently yields improved task embeddings, ones that align better with underlying task rules, improve embedding-based retrieval, and enable accurate li...