Home icon

How Klaviyo processes 3 billion daily events at scale with Amazon MSK Express

Big Data Blog



This article describes how Klaviyo migrated its event infrastructure from RabbitMQ to Amazon MSK Express to handle 3 billion daily events and scale for peak traffic.

  • Migrated from RabbitMQ to Amazon MSK Express to meet extreme scaling requirements during Black Friday/Cyber Monday
  • Implemented three-tier priority topics (p10, p20, p30) to process real-time triggers (5-second SLO) and analytics aggregates (20-minute SLO) on unified infrastructure
  • Designed graduated retry architecture with exponential backoff and dead-letter queue to ensure zero data loss
  • Scaled from 12 to 60 brokers in seven weeks without manual partition reassignment using MSK Express Intelligent Rebalancing
  • Achieved 30% cost reduction by running unified processors across all priority levels instead of separate infrastructure
  • Delivered 22.7 billion messages during BFCM 2025, up 25% year-over-year, at peak of 170,000 events per second
  • MSK Express features eliminated storage provisioning, automated rebalancing, and enabled 90% faster failure recovery than Standard brokers

Klaviyo's lean infrastructure team successfully scaled mission-critical event processing at massive scale using managed Kafka with thoughtful architecture design and priority-based routing.



Go to article

The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.

Related articles

Mar 29
2024
Nexthink scales to trillions of events per day with Amazon MSK
Nov 16
2026
Deliver petabytes of Apache Kafka data to Amazon S3 at up to 60% lower cost with Amazon MSK Express brokers
Nov 17
2026
How Veeva scaled big data with Amazon EMR on EKS
Nov 17
2026
Amazon MSK Express brokers available on AWS Graviton4-based M8g instances

The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.