We have 3 of 11 papers
We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.
Not the right person? Other researchers publish under this name.
RLTL;DR is introduced, a promising compacted training paradigm of the form"on this sort of task, keep this sort of thing in mind", which it is hoped will inspire future research on.
It is shown that this gating mechanism causes SSMs to first learn an in-weights"memorization"solution, while delaying, or even preventing, convergence to a correct in-context learning solution, and that gating is often beneficial for improving generalization to long sequence lengths.
It is suggested that using standard CoT prompting increasingly acts as a source of distraction as models grow stronger, because standard CoT prompting also demands style adaptation, formatting compliance, and potentially undesired contextualization, which can distract models from the core reasoning task.
We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.
