TLDR Web Dev · MISCELLANEOUS

ANSWERING READER FEEDBACK: WAR ROOMS VS. DEEP INVESTIGATIONS

rachelbythebay.com9 min read

Summary from the TLDR Web Dev newsletter

During a major Facebook outage in 2014, known internally as "Call the Cops", this developer found that "war rooms" were pointless for deep investigations. He struggled to diagnose the root cause of the outage while confined to a poorly ventilated room with limited resources. He needed to escape that environment and use his usual setup to effectively investigate. The root cause was eventually traced to a bug in the fbagent process that caused it to kill all processes on the machine when the fork failed due to running out of memory.