Amazon EMR on EKS now supports job run concurrency controls

This article announces job run admission control on Amazon EMR on EKS with support for job run concurrency and backpressure signals.

• Set concurrent job limits on virtual clusters to control simultaneous job execution
• Configure maxConcurrentJobRuns to limit jobs running at any time
• Configure maxInQueueJobRuns to set maximum queue depth for pending jobs
• Prevents cluster overload and noisy-neighbor scheduling failures in multi-tenant environments
• StartJobRun returns ValidationException when queue is full for graceful traffic shedding
• View current limits and live job counts using DescribeVirtualCluster
• No limits applied by default; existing workloads unaffected until opted in
• Available in all AWS Regions where EMR on EKS is offered

Job run concurrency controls enable fine-grained resource management for EMR on EKS virtual clusters, protecting shared infrastructure and ensuring predictable workload execution.