TLDR · MISCELLANEOUS

HOW TECH GIANTS CUT CORNERS TO HARVEST DATA FOR A.I.

nytimes.com22 min read

Summary from the TLDR newsletter

OpenAI solved its data supply problem in late 2021 by developing a speech recognition tool called Whisper to transcribe audio from YouTube videos, yielding new text to train its AI systems. Its team ultimately transcribed more than one million hours of video to train GPT-4. Google and Meta have also similarly cut corners in the race to lead AI, obtaining data in legally and ethically dubious ways. This article discusses the various methods companies have used to obtain data - or have considered using to obtain data - for AI training purposes.