CONCURRENT WEB CRAWLING IN RUBY WITH ASYNC

Summary from the TLDR Web Dev newsletter

This article shows how to transform a slow, synchronous Ruby web crawler into a fast concurrent one using the Async library. Crawling time is reduced from 3 seconds to half a second in the example by implementing non-blocking I/O with Fibers, connection reuse, and rate limiting.