AWS Glue announces automatic version upgrades for Apache Spark jobs
News
AWS Glue introduces automatic version upgrades, a capability that keeps Apache Spark jobs current on the latest AWS Glue runtime without manual coordination.
- Set job version to "Auto" for automatic upgrades with latest security patches and performance improvements
- Multiple validation levels assess compatibility, obtain consent, and validate output profiles before upgrading
- Platform teams can standardize runtime versions across large job fleets without individual coordination
- Jobs validated against established output schema, data volume, latency, and format before upgrade
- Jobs requiring code changes remain on current version with upgrade analysis and fixes provided
- Available in all AWS Commercial Regions via AWS Glue Studio, CLI, API, and SDKs
Auto upgrades eliminate weeks of manual planning, enabling hands-free runtime management while maintaining job reliability and performance standards.
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.