TLDR AI · RESEARCH & INNOVATION
ENHANCED SPEECH TRANSLATION
Summary from the TLDR AI newsletter
ZeroSwot is a new method for Speech Translation (ST) that overcomes the lack of data and differences between speech and text. It uses unique techniques to train a speech encoder with only speech recognition data, allowing it to work with a multilingual translation model.