Coarse-Graining Hidden Representations: Unsupervised Neuron Selection via Mapping Entropy
This work cast neuron selection as the problem of coarse-graining the hidden layer by retaining a subset of its neurons, and scores each putative selection by the mapping entropy (ME), measuring the loss of discriminatory power inherent in discarding part of the network neurons.
Margherita Mele, Andrea Castagna, R. Menichetti et al.
· 0 citations