CAPPY: OUTPERFORMING AND BOOSTING LARGE MULTI-TASK LANGUAGE MODELS WITH A SMALL SCORER

Summary from the TLDR AI newsletter

Cappy is a small model trained to take instructions and a candidate completion and return a score for how well the completion fulfills the instructions. It outperforms much larger models at this task, suggesting it may be used as a feedback mechanism for training and generation.