MODEL COLLAPSE IS ALREADY HAPPENING, WE JUST PRETEND IT ISN'T

Summary from the TLDR Dev newsletter

Model collapse, where AI models degrade over time, is already happening as new systems are increasingly trained on data generated by previous AI models. This recursive process smooths out rare and diverse patterns, leading to a loss of variance and homogenization in outputs.