AWS Glue now provides job queuing
News
AWS Glue now provides job queuing, a new capability that enables users to submit AWS Glue job runs without needing to manage account level quotas and limits.
Specifically, the article covers:
- AWS Glue job queuing monitors account level quotas and limits, and automatically queues jobs if limits are insufficient to start a job run
- Once limits become available, AWS Glue retries the queued job run
- Job queuing can handle limits like max concurrent job runs per account, max concurrent Data Processing Units (DPU), and resource unavailability due to IP address exhaustion in Amazon VPC
- Job queuing can be enabled via the AWS Management console or API/CLI
- Job queuing is available in all AWS commercial regions where AWS Glue is generally available
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.