META INTRODUCES SPIRIT LM OPEN SOURCE MODEL THAT COMBINES TEXT AND SPEECH INPUTS/OUTPUTS

Summary from the TLDR AI newsletter

Meta has launched an open-source multimodal language model designed to integrate text and speech inputs and outputs with expressive, natural-sounding speech capabilities. Meta Spirit LM aims to outperform existing voice AI by using phonetic, pitch, and tone tokens to enhance emotional expression and maintain natural expressiveness in tasks like ASR, TTS, and speech classification.