BLT: TOKEN FREE LANGUAGE MODEL TRAINING

Summary from the TLDR AI newsletter

Meta has released details and training code for the Byte Latent Transformer which uses learned patches instead of tokens for training, essentially eliminating a challenging portion of language modeling. Importantly, it found that its paradigm scales better to small Llama 2 sized models.