Kai-Xuan He

DORA: Dynamic Online Reinforcement Agent for Token Pruning in Vision Transformers

Vision Transformers (ViTs) incur quadratic self-attention cost in the number of tokens. Most token-reduction methods adapt token identities within a prescribed layer-wise compression schedule, or search a static mask offline, and thus limit online adaptation of when and how much to prune. We propose DORA (Dynamic Onlin...