USING GPT-4O FOR WEB SCRAPING

Summary from the TLDR Web Dev newsletter

GPT-4o can be used for web scraping, though it can be pretty expensive. This developer experimented with different approaches, including directly asking GPT-4o to extract data, generating XPaths, and combining both methods. While GPT-4o demonstrated impressive data extraction capabilities, its inconsistent inaccuracies and high cost made it tough to be sustainable.