Home icon

AWS Glue announces automatic version upgrades for Apache Spark jobs

News



AWS Glue introduces automatic version upgrades, a capability that keeps Apache Spark jobs current on the latest AWS Glue runtime without manual coordination.

  • Set job version to "Auto" for automatic upgrades with latest security patches and performance improvements
  • Multiple validation levels assess compatibility, obtain consent, and validate output profiles before upgrading
  • Platform teams can standardize runtime versions across large job fleets without individual coordination
  • Jobs validated against established output schema, data volume, latency, and format before upgrade
  • Jobs requiring code changes remain on current version with upgrade analysis and fixes provided
  • Available in all AWS Commercial Regions via AWS Glue Studio, CLI, API, and SDKs

Auto upgrades eliminate weeks of manual planning, enabling hands-free runtime management while maintaining job reliability and performance standards.



Go to article

The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.

Related articles

Aug 24
2026
Upgrade AWS Glue jobs to Glue 6.0 with AI-powered Spark upgrades
Dec 9
2025
Introducing AWS Glue 5.1 for Apache Spark
Dec 4
2024
Introducing AWS Glue 5.0 for Apache Spark
Nov 22
2024
Announcing generative AI upgrades for Apache Spark in AWS Glue (preview)

The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.