EXPERIMENT DIARY

Summary from the TLDR AI newsletter

This document contains a diary for an experiment aimed at teaching an LLM using GRPO to generate regex given a description. It details the performance, learnings, modifications, and key takeaways from each experiment. The initial training run was on December 17. It saw the model quickly learning how to generate valid regex tags, but the model was basically generating random regex strings.