CRAWLEE FOR PYTHON

Summary from the TLDR Web Dev newsletter

Crawlee is a web scraping and browser automation library. It supports both BeautifulSoup and Playwright crawling for more reliable web crawlers. It also supports type hints in Python, headless browsers, automatic scaling, and proxy management.