MIXTURE OF EXPERTS FOR SPECULATIVE DECODING

Summary from the TLDR AI newsletter

Jakiro enhances speculative decoding by using Mixture of Experts to generate diverse predictions, reducing correlation among candidates and improving inference speed.