LAION OPENLM FOR MEDIUM SIZED MODELS

Summary from the TLDR AI newsletter

OpenLM is a library and framework for training medium-sized language models up to 7B parameters. It is designed with GPU speed and hackability in mind. Models trained on 1.25T tokens are available as validation of convergence.