SECURE SYSTEM FOR EVALUATING CODE MODELS

Summary from the TLDR AI newsletter

One hard challenge when working with language models that write code is evaluating the quality of the generated code. This is difficult because running arbitrary code is dangerous for a system. The code could do anything, including deleting everything. MosaicML offers a secure environment for evaluating generated code.