Scaling Cloudera’s development environment: Leveraging Amazon EKS, Karpenter, Bottlerocket, and Cilium for hybrid cloud

Cloudera modernized its development environment by adopting a hybrid cloud approach using Amazon EKS, addressing critical operational challenges in its on-premises Kubernetes infrastructure.

• Key technologies used: Amazon EKS, Karpenter, Bottlerocket, Cilium
• Improved build and test cycle times by 50%
• Scaled from 10 to 1,000 nodes in minutes
• Reduced infrastructure costs by 40%
• Decreased S3 data transfer latency to milliseconds
• Reduced security attack surface by 60%

The solution enabled more efficient resource utilization, faster development cycles, enhanced security, and significant cost optimization by leveraging AWS container and compute technologies.