DATA DECIDE

Summary from the TLDR AI newsletter

AllenAI has released a tool that can be used to help decide which data to include in pre-training. This framework is quite useful for understanding what goes into a filtering run for pre-training.