IS DATA STILL A MOAT?

Summary from the TLDR Web Dev newsletter

“Data is the new oil” was a common slogan of the last decade, but this might not hold true anymore with the advent of generative AI. On one hand, quality data still matters as LLMs can be greatly influenced by training data quality. On the other hand, fine tuning models only requires ~100 data points, which can be easily curated. LLMs can also now generate great synthetic data, which lowers the usefulness of “real” data.