APPLE'S NEW SPEECH API VS WHISPER: THE FIRST REAL BENCHMARK

Summary from the TLDR newsletter

Apple's SpeechAnalyzer cuts word error rate compared with SFSpeechRecognizer by 3.5x to 4x on the same audio. It beats Whisper Small by a comfortable margin with roughly a third of the compute time per second of audio. SpeechAnalyzer is now the strongest on-device option for English on Apple hardware. Whisper covers far more languages and runs anywhere, but the days of it being the automatic accuracy pick are over.