Hegelian Self-Reflection for Improved Mathematical and Symbolic Reasoning, and Scientific Discovery in Large Language Models
Sara Abdali, Michael Solodko, Can Goksen et al.
· 0 citations
We have 3 of 9 papers
We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.
Not the right person? Other researchers publish under this name.
Eliciting Weak-to-Strong Generalization with On-Policy Reverse Distillation
On-Policy Reverse Distillation (OPRD), which evaluates the teacher's policy shift relative to its reference policy on student rollouts and amplifies the component of the student's verifier-driven policy gradient along that direction, and effectively combines verifier-driven policy optimization with teacher guidance reg...
Youngrok Park, Sangmin Bae, Hojung Jung et al.
· 3 citations
Sliding-window beats linear attention
This work shows that Sliding Window Attention (SWA) with sinks performs as well or better than post-trained Linear Attention models, and recommends switching to SWA instead of post-training linear models.
Alexia Jolicoeur-Martineau, R. Sukthanker, Pashmina Cameron et al.
· 0 citations