Kevin Miao

Unifying Score and Performance for Fine-Grained Music Understanding in Audio-Language Models

MuNo-SP (Music Notation unifying Score and Performance), a text-based representation that jointly encodes score content and performance information, is introduced and an automatic training-data generation pipeline is developed that uses aligned scores and performances to produce long-form auditory analyses and musicall...