talk-data.com talk-data.com

Google Cloud Next session 2025-04-11 at 18:00

Autoscale Kafka consumers on Cloud Run

Event: Google Cloud Next '25

Speakers

Matt Larkin

Product Manager · Google Cloud

Adam Kane

Software Engineer · Google Cloud

Topics

Kafka Cloud Computing Cloud Run

Description

Leverage the flexibility of Cloud Run and its ease of use for your Apache Kafka workloads. In this session, we’ll introduce Cloud Run worker pools, a new resource specifically designed for non-request-based workloads, like Kafka consumers. Learn how worker pools, along with a self-hosted Kafka autoscaler, can enable fast and flexible scaling of your Kafka consumers by using Kafka queue metrics.