Biologically Inspired Mechanisms for Facilitating Grokking in Multilayer Perceptrons
The results support the common principle that explicit regulation of neuron utilization and effective connectivity can improve the emergence of generalizable internal computation and motivate broader investigation of biologically inspired activity regulation and adaptive sparsification, including in large language models.
Florin Leon
· 0 citations