TLDR Dev · ARTICLES & TUTORIALS

SCALING GIT AT OPENAI

links.tldrnewsletter.com22 min read

Summary from the TLDR Dev newsletter

OpenAI built Pando, a Git-compatible backend that handles pushes to unrelated branches independently and reuses cached packfiles across fetches. It reduced median push latency by nearly 80% and now serves nearly a petabyte of Git data per day. The tradeoff is weaker consistency across branches and some redundant downloads, allowing writes to scale horizontally and reads to saturate clients' network connections.