Introducing AWS Glue 6.0 for faster and more cost-effective data integration
Big Data Blog
This article announces AWS Glue 6.0, a major upgrade to AWS's serverless data integration service featuring significant cost reductions and performance improvements.
- 30% price reduction on AWS Glue usage rates with up to 36% better price performance via TPC-DS benchmarks
- Upgraded runtime: Apache Spark 4.1.1, Python 3.13, Scala 2.13, and AWS SDK for Java 2.x
- Apache Iceberg V3 support including VARIANT data type with automatic shredding, deletion vectors, and geospatial types
- New features: Spark Declarative Pipelines, Real-Time Mode for streaming with sub-second latencies, Arrow-Native UDFs
- Python virtual environments with S3 caching reduce job startup latency by eliminating runtime dependency resolution
- Updated open table format libraries: Iceberg 1.11.0, Hudi 1.1.1, Delta Lake 4.2.0
AWS Glue 6.0 enables faster data processing, lower operational costs, and modern lakehouse architectures with enterprise-grade open table format support.
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.