We study how large transient inputs cause post-perturbation memory failure in small recurrent neural networks (RNNs), and whether spectral summaries of early hidden-state trajectories provide information beyond simpler time-domain descriptions. Mechanistically, each of three tanh memory RNNs contained two stable zero-i...
Sohan Poudel· Zenodo (CERN European Organi...· 0 citations
We study how large transient inputs cause post-perturbation memory failure in small recurrent neural networks (RNNs), and whether spectral summaries of early hidden-state trajectories provide information beyond simpler time-domain descriptions. Mechanistically, each of three tanh memory RNNs contained two stable zero-i...
Sohan Poudel· Zenodo (CERN European Organi...· 0 citations
The report asks a simple but focused question: if a numerical mechanism attached to a trained neural network had to select exactly one component to preserve, what would it choose, and would that choice predict real functional consequences better than simple baselines? We ran an exploratory series of experiments on smal...
Sohan Poudel· Zenodo (CERN European Organi...· 0 citations
The report asks a simple but focused question: if a numerical mechanism attached to a trained neural network had to select exactly one component to preserve, what would it choose, and would that choice predict real functional consequences better than simple baselines? We ran an exploratory series of experiments on smal...
Sohan Poudel· Zenodo (CERN European Organi...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.