EFFICIENT BYTE LEVEL MODELS AT SCALE

Summary from the TLDR AI newsletter

EvaByte is a model from SambaNova trained on byte level language modeling. It performs on par with models two generations old (e.g., Llama 2). While this may seem slightly disappointing, it is a big win for byte level models, which have been stuck at sub 1B parameter scale for some time.