Introducing Amazon EMR on EKS with Apache Flink: A scalable, reliable, and efficient data processing platform
Big Data Blog
This article introduces Amazon EMR on EKS with Apache Flink, which allows running Flink applications on Amazon EKS using the EMR runtime, combining the benefits of both services.
Specifically, the article covers:
- Benefits of EMR on EKS for data workloads
- Advantages of EMR on EKS with Apache Flink, including faster restart, logging/monitoring, cost optimization with Spot Instances, Glue Data Catalog integration, Amazon S3 integration, and RBAC with IRSA
- Key differentiations of EMR on EKS with Flink, such as task local recovery, fine-grained recovery, monitoring capabilities, and spot instance interruption handling
- Getting started with deploying and running Flink jobs on EMR on EKS
- Conclusion highlighting the benefits of running Flink workloads on the managed, scalable, resilient, and cost-optimized EMR on EKS platform
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
May 24
2024
2024
Introducing the Amazon Kinesis Data Streams Apache Spark Structured Streaming Connector for Amazon EMR
Jun 4
2024
2024
Introducing Amazon EMR Serverless Streaming jobs for continuous processing on streaming data
Jun 26
2024
2024
Amazon Managed Service for Apache Flink introduces two new APIs to query operations on Flink applications
Jun 26
2024
2024
Amazon Managed Service for Apache Flink now supports system-rollback
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.