The Cost of Long Memory: State, Context, and Stability Complexity in Sequence Models
Long-range temporal dependence poses a resource question for sequence models: for a specified predictive-memory law, how much state, context, or dynamical criticality is required in order to forecast accurately? We study this question directly in forecasting risk. For algebraically decaying predictive memory, we prove...
Yu-Heng Song
· 0 citations