PLANNING IN NATURAL LANGUAGE IMPROVES LLM SEARCH FOR CODE GENERATION

Summary from the TLDR AI newsletter

One of the challenges of code generation is getting diverse candidate solutions. Oftentimes, even repeated sampling fails to generate enough novelty to solve a problem. However, if you plan in natural language first and brainstorm candidate solution paths, then generation is significantly more diverse and varied leading to improved code generation solutions.