ERASE: EaRly bAckpropagation SchEdule for Faster Training of Modern Recommendation Systems
The detachment mechanism of Forward-Forward (FF) is reinterpreted as a scheduling primitive: given a local objective, detaching a block's output removes downstream gradient dependencies, making its backward pass ready when its forward pass finishes.
Ergan Shang, Flavio Sales Truzzi
· 0 citations