TLDR AI · ENGINEERING & RESEARCH

CLOUD RUN GPUS, NOW GA, MAKES RUNNING AI WORKLOADS EASIER FOR EVERYONE

cloud.google.com5 min read

Summary from the TLDR AI newsletter

NVIDIA GPU support for Cloud Run, Google Cloud's serverless runtime, is now generally available. Support for GPUs in Cloud Run makes Google Cloud's GPU-accelerated applications simpler, faster, and more cost-effective than ever before. Users are only charged for the GPU resources they consume, down to the second - Cloud Run automatically scales GPU instances down to zero when no requests are received, eliminating idle costs. It features rapid startup and scaling and full streaming support.