TLDR AI · ENGINEERING & RESEARCH
CLOUD RUN GPUS, NOW GA, MAKES RUNNING AI WORKLOADS EASIER FOR EVERYONE
Summary from the TLDR AI newsletter
NVIDIA GPU support for Cloud Run, Google Cloud's serverless runtime, is now generally available. Support for GPUs in Cloud Run makes Google Cloud's GPU-accelerated applications simpler, faster, and more cost-effective than ever before. Users are only charged for the GPU resources they consume, down to the second - Cloud Run automatically scales GPU instances down to zero when no requests are received, eliminating idle costs. It features rapid startup and scaling and full streaming support.