SCALING STREAMHUB: TRANSITIONING FROM KINESIS TO KAFKA FOR 145 BILLION DAILY EVENTS

Summary from the TLDR Data newsletter

Atlassian moved from Kinesis to Kafka on AWS MSK as traffic rose from 22 billion to 150 billion events a day. Tiered Storage cut costs, but incidents exposed broker, S3, control-plane, and disk limits. Quotas, sharding, spare capacity, backups, and failover were critical.