A comprehensive study on PPT spanning five PPT tasks, four PT data mixtures, four parameter scales (500M to 7B), and PT budgets of up to 100B tokens finds that downstream gains arise from PPT tasks that improve long-range retrieval.
Atsuki Yamaguchi, Tatsuro Inaba, Joel Niklaus et al.· 0 citations
Despite the widely recognized potential of AI in education, most prior work has focused on individualized student assistance. In contrast, the majority of educational practice worldwide still takes place in collective classroom settings. To enable researchers to study AI assistance in collective teaching, we introduce...
Michal Štefánik, J. Nehyba, Jirina Karasova et al.· 0 citations
The current robustness fine-tuning methods improve over standard fine-tuning and in-context learning, but the best-to-worst prompt gap remains as high as 40-57% of performance, and recent robustness-enhancing methods often fail to outperform the simplest data construction strategy: training on one template per batch.
Frederic Sadrieh, Michal Štefánik· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.