RRSI: REGULARIZED RECURSIVE SELF-IMPROVEMENT OF AGENT HARNESSES

Summary from the TLDR AI newsletter

An AI agent's capability is largely set by its harness. Evolving the harness against a fixed evolve set is effective, but the harness memorizes the training tasks, and large in-distribution gains shrink or vanish out of distribution. RRSI keeps the harness edit space open and regularizes the search trajectory through it instead. Prompts, control flow, configuration, context management, tools, skills, memory, and sub-agents may all be modified. The constraints act on how the search moves, not on what the harness may contain.