TLDR AI · MISCELLANEOUS

STABLELM 3B WITH DATA REPEATING

stability.wandb.io8 min read

Summary from the TLDR AI newsletter

Stability has trained another model, this time on 4T tokens to test data repeating. Also, due to public pushback, they removed Books3 from the data mix.