Harnessing Karpenter: Transitioning Kafka to Amazon EKS with AWS solutions
Containers Blog
This article discusses AppsFlyer's migration of their legacy Apache Kafka infrastructure to Kubernetes on Amazon EKS, using AWS solutions. It covers the benefits they achieved and the challenges they faced.
Specifically, the article covers:
- The benefits of using Amazon EKS for their Kafka deployment, including simplified management and integration with AWS services
- The performance boost achieved by using AWS Graviton instances with local NVMe SSD storage for their Kafka brokers
- How they used the open-source Local Path Provisioner and their own Local PVC Releaser controller to handle local storage with Kubernetes
- The advantages of using Karpenter for autoscaling, including faster node provisioning, local storage awareness, and cost optimization
- The overall benefits of their new Kafka on EKS setup, including 30% cost reduction and faster recovery times
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.