KEEPING 20,000 GPUS HEALTHY

Summary from the TLDR Dev newsletter

Modal runs a globally distributed pool of over 20,000 GPUs across multiple cloud providers. Its approach begins with instance type testing and selection, evaluating performance and reliability differences between cloud hyperscalers. This is followed by machine image preparation and automated boot checks to guarantee GPU health before customer workloads begin. Throughout an instance's life, Modal performs continuous passive and active healthchecking.