FLUID COMPUTE: HOW WE BUILT SERVERLESS SERVERS

Summary from the TLDR Web Dev newsletter

Vercel's Fluid compute optimizes serverless computing by efficiently using resources, minimizing cold starts, and reducing costs. This approach uses a custom TCP-based protocol and Rust-based core to create secure tunnels between Vercel and AWS Lambda functions, turning on HTTP streaming. The system also routes requests to existing idle function instances, increasing resource utilization and breaking free from the traditional one-invocation-per-instance model.