Deploying and scaling Apache Kafka on Amazon EKS
Containers Blog
This article explains how to deploy and scale Apache Kafka on Amazon EKS using the Data on EKS (DoEKS) project and the Strimzi Operator.
Specifically, the article covers:
- An overview of the solution architecture for running Kafka on EKS
- Step-by-step instructions for deploying the infrastructure using Terraform and the DoEKS blueprints
- Verifying the Kafka deployment and creating topics
- Running a sample Kafka producer, streams, and consumer
- Scaling the Kafka cluster and rebalancing partitions using Cruise Control
- Benchmarking the Kafka cluster performance
- Monitoring the Kafka cluster using Grafana dashboards
- Testing Kafka disruption and failover scenarios
- Conclusion and cleanup steps
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.