Sequential test-time training adapts a memory network through successive updates, each computing an inner-loop gradient based on the network's previous state. Intuitively, this state dependence should allow each update to account for what the memory has already learned and better incorporate new information. However, w...
Yi-Ning Li, Dong-Chen Han, Jie Fu et al.· 0 citations
Vision--language--action (VLA) models acquire broad generalization through large-scale pretraining, yet adapting them to a new task and robot embodiment still requires post-training on newly collected data. Unlike pretraining, post-training targets task- and embodiment-specific adaptation, making it particularly sensit...
Run-Ze Xu, Yuan-Fan Xu, Cui-Jie Xu et al.· 0 citations
Dual Attention Residuals (DAR) is proposed, which brings multi-stream interaction into historical retrieval through reciprocal cross-stream addressing and consistently improves validation loss over standard residual Transformers and Attention Residuals.
Xing-Da Yu, Yi-Ning Li, Xin-Zhang Liu et al.· arXiv.org· 1 citation
This work reformulates the implicit reward of sampled-token OPD based on trajectory correctness, then applies a ReLU gating mechanism to ensure that correct trajectories receive non-negative rewards and incorrect ones receive non-positive rewards, making it readily combinable with any policy gradient algorithm, such as...