Preprint
Oct 2026
How Far Back Should a Transformer Look? Repetition and Copying in Music Sequence Models
How predictive performance depends on the maximum context available to an autoregressive model of symbolic music, and what information long-context models exploit is investigated, as well as methodological checks for context-length measurements.
Amir Fathi
· 0 citations