The policy-gradient theorem gives the exact gradient under the current policy, but finite on-policy samples may miss rare high-return trajectories. We study whether tree search improves their coverage within a fixed budget while controlling gradient bias. We introduce On-Policy Parallel Tree Search (OPTS) and Tree Traj...
Jun-Yu Lu, Shi-Chao Weng, Zhi-Qiang Wang et al.· 0 citations
This paper considers multilingual pretraining as a cooperative game in which each language acts as a player that jointly contributes to pretraining, gaining the resulting reduction in test loss as the payoff and proposes a game-theoretic multilingual scaling law called ShapleyLaw.
Large language models are entering decisions in triage and lending, where task-relevant inference must be distinguished from impermissible proxy use, and causal proxy effects in four LLMs on a clinical-ranking task with known ground truth are measured.
An audit is introduced that predicts a mechanism's fate as a population grows, asking how often the mechanism can act, whether agents use the information it supplies, and whether the measurement itself creates apparent scale effects.
Zeng-Qing Wu, Chuan Xiao· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.