TLDR AI · DEEP DIVES & ANALYSIS
YOUR AI MIGHT BE LYING TO YOUR BOSS
Summary from the TLDR AI newsletter
It's very hard to measure the contribution that AI models make to a codebase. Sometimes the best use cases for AI are inquisitive prompts that don't necessarily produce any code at all. Lines of code isn't a very good measure of code quality, and it can be difficult to separate the work engineers did vs what AI has done. The bias appears to be towards reporting a higher AI percentage, which is great for AI companies, but skewed metrics can be harmful.