HELM INSTRUCT BENCHMARK

Summary from the TLDR AI newsletter

The language modeling group at Stanford released a widely used benchmark called Holistic Evaluation of Language Models (HELM). They also released a version for instruction following called HELM-Instruct. It is multidimensional, open-ended, and absolute.