Home icon

Improve Apache Kafka scalability and resiliency using Amazon MSK tiered storage

Big Data Blog



This article discusses how Amazon MSK (Managed Streaming for Apache Kafka) tiered storage improves the scalability and resiliency of Apache Kafka clusters.

Specifically, the article covers:

  • Apache Kafka's storage architecture and its impact on availability and resiliency
  • How Amazon MSK tiered storage addresses challenges like slow broker recovery, inefficient load balancing, and scaling limitations
  • The benefits of using Amazon MSK tiered storage, including faster broker recovery, efficient load balancing, and seamless scaling
  • A real-world test demonstrating the performance improvement with Amazon MSK tiered storage for partition reassignment operations
  • Conclusion encouraging the use of Amazon MSK tiered storage to improve Kafka's scalability and resiliency


Go to article

The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.

Related articles

May 29
2024
Amazon MSK adds support for Apache Kafka version 3.7
May 19
2025
Amazon MSK adds support for Apache Kafka version 4.0
Oct 15
2025
Amazon MSK adds support for Apache Kafka version 4.1
Apr 2
2026
Streamline Apache Kafka topic management with Amazon MSK

The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.