Emerging computer hardware often trades reliability for energy efficiency; here we show that large-language models (LLMs) can be trained to tolerate this unreliability, and that rather than degrading, their error resilience actually increases as they grow. Modified neural scaling laws inferred from 40,000 GPU-hours of...
T. McCourt, I. Fiete, Isaac L. Chuang· 0 citations
It is found that though continual learning methods help, fine-tuning reduces robustness across pretrained models, suggesting that starting with the strongest foundation model is not necessarily the best approach for performance on specialist tasks.
Jaedong Hwang, Brian Cheung, Zhang-Wei Hong et al.· 0 citations
It is found that a structured entorhinal-hippocampal memory model, which provides a content-independent metric scaffold based on grid cells for storing experience, coupled to a policy recurrent network, succeeds at all three forms of generalization.
Jaedong Hwang, Sujaya Neupane, M. Jazayeri et al.· bioRxiv· 0 citations
Comparisons are fundamental to science: experiment against model, one organism against another, a system against itself across time. Because many systems, from brains to climate, are characterized by how they evolve in time, it is a natural goal to compare their dynamics. Dynamical systems comparison is well defined, b...
Mitchell Ostrow, Adam J. Eisen, L. Kozachkov et al.· bioRxiv· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.