WHAT'S NEW WITH ML IN PRODUCTION

Summary from the TLDR newsletter

Most machine learning in production is still not related to large language models or generative AI, which make up less than 10% of the market at most. At their core, machine learning models are algorithms that perform compression on a corpus of data. A lot has changed in leading-edge machine learning applications over the past year as the industry has moved from smaller, business-specific models that perform specific tasks to very large generalist models that complete text. The pendulum is again shifting to smaller models that people are starting to fine-tune and run on their own. The industry still focuses on compression, but it is changing where and how much it is controlled.