Distil-Whisper (2023)
Hugging Face distilled OpenAI's Whisper large-v2 into a 756-million-parameter model that ran 6x faster and was 51% smaller while staying within 1% word error rate on most benchmarks.
Showed that distillation could shrink a massive speech model while keeping accuracy nearly intact.
Set the expectation that speed and size gains did not have to cost much accuracy.
IBM's 5.0 release pushes the same speed-versus-accuracy trade-off far harder — a 20x throughput jump instead of 6x.
