Generative policies offer expressive action distributions for online reinforcement learning (RL), but many diffusion- and flow-based policies require costly iterative sampling. We propose DriftSpread, a one-step generative policy based on Drifting for online maximum-entropy (MaxEnt) RL. To incorporate entropy without a...
Chun-Yu Luo, Hong-Yu Zhao, Guang-Yi Ni et al.· 1 citation
Computing equilibria in high-dimensional continuous games requires learning and representing rich, multi-modal strategy distributions, something conventional neural policies struggle to achieve. Diffusion models offer a natural solution, but standard diffusion training requires direct samples from a fixed target distri...
Hai-Chuan Wang, Anagha Satish, Jia-Le Zheng et al.· 0 citations
This work studies causal interventions in controlled multiple-choice tasks and identifies that persuasion mainly acts through a small set of mid-layer attention heads, which are decision heads, which mainly acts through a one-dimensional option-routing feature in the option-token representations.
Xiang-Kun Sun, Ling-Kai Kong, Ao Zhang et al.· arXiv.org· 2 citations· ⚡1
Across three model families, two small groups of attention heads are identified with distinct roles in introspective reporting supporting introspective detection and localization of large language models.
Jia-Hong Zou, Xiang-Kun Sun, Ling-Kai Kong et al.· arXiv.org· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.