Introducing Amazon EMR on EKS with Apache Flink: A scalable, reliable, and efficient data processing platform
Big Data Blog
This article introduces Amazon EMR on EKS with Apache Flink, which allows running Flink applications on Amazon EKS using the EMR runtime, combining the benefits of both services.
Specifically, the article covers:
- Benefits of EMR on EKS for data workloads
- Advantages of EMR on EKS with Apache Flink, including faster restart, logging/monitoring, cost optimization with Spot Instances, Glue Data Catalog integration, Amazon S3 integration, and RBAC with IRSA
- Key differentiations of EMR on EKS with Flink, such as task local recovery, fine-grained recovery, monitoring capabilities, and spot instance interruption handling
- Getting started with deploying and running Flink jobs on EMR on EKS
- Conclusion highlighting the benefits of running Flink workloads on the managed, scalable, resilient, and cost-optimized EMR on EKS platform
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
May 24
2024
2024
Introducing the Amazon Kinesis Data Streams Apache Spark Structured Streaming Connector for Amazon EMR
Mar 10
2025
2025
Amazon EMR on EKS now supports Amazon EKS Pod Identity
Jun 3
2025
2025
Build a centralized observability platform for Apache Spark on Amazon EMR on EKS using external Spark History Server
Sep 13
2024
2024
Use Batch Processing Gateway to automate job management in multi-cluster Amazon EMR on EKS environments
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.