TLDR AI · RESEARCH & INNOVATION
CHATMUSICIAN
Summary from the TLDR AI newsletter
Music understanding typically relies on adding a modality-specific encoder to a language model. This is expensive and unstable. This work found that music understanding increased substantially without impact to base language ability when music was tokenized into ABC notation.