BUZZ PRETRAINING DATASET (HUGGING FACE HUB)

Summary from the TLDR AI newsletter

Buzz is a novel dataset that includes preference data in the pretraining mix. Its researchers have also released several models that were trained using this data. They found that the models perform well on a number of human preference tasks.