TLDR · BIG TECH & STARTUPS
REDDIT NOW BLOCKS ALL SEARCH ENGINES OTHER THAN GOOGLE FOLLOWING ‘MISUSE'
Summary from the TLDR newsletter
Reddit has started to block its site from appearing in search engines other than Google. The site has updated its robots.txt file to block all bots from scraping any part of it. It claims the change was being made following an increase in commercial entities scraping the site. Reddit and Google announced a new deal earlier this year allowing Google to use Reddit data to train AI models.