Amazon EMR on EKS now supports job run concurrency controls
News
This article announces job run admission control on Amazon EMR on EKS with support for job run concurrency and backpressure signals.
- Set concurrent job limits on virtual clusters to control simultaneous job execution
- Configure maxConcurrentJobRuns to limit jobs running at any time
- Configure maxInQueueJobRuns to set maximum queue depth for pending jobs
- Prevents cluster overload and noisy-neighbor scheduling failures in multi-tenant environments
- StartJobRun returns ValidationException when queue is full for graceful traffic shedding
- View current limits and live job counts using DescribeVirtualCluster
- No limits applied by default; existing workloads unaffected until opted in
- Available in all AWS Regions where EMR on EKS is offered
Job run concurrency controls enable fine-grained resource management for EMR on EKS virtual clusters, protecting shared infrastructure and ensuring predictable workload execution.
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.