TLDR Web Dev · ARTICLES & TUTORIALS
A GOOD DAY TO TRIE-HARD: SAVING COMPUTE 1% AT A TIME
Summary from the TLDR Web Dev newsletter
Cloudflare's "pingora-origin" service processes a massive amount of HTTP requests - a small function called "clear_internal_headers" was identified as consuming a significant portion of its CPU time. To optimize this function, Cloudflare explored different data structures, eventually settling on a trie-based approach, which resulted in a new open-source Rust crate called "trie-hard". The trie-hard implementation reduced the CPU utilization of the function, achieving a 1.28% decrease in compute time, which matters a lot at scale.