AWS Glue Data Catalog offers advanced automatic optimization for Apache Iceberg tables
News
AWS Glue Data Catalog has introduced advanced automatic optimization features for Apache Iceberg tables, addressing key challenges in managing large-scale data lakes.
- Supports compaction of delete files
- Enables nested data type handling
- Provides partial progress commits
- Supports partition evolution
- Monitors table partitions for positional and equality delete files
- Allows schema evolution and column reordering
- Expands support for complex nested data
- Adds compression codec support for Parquet files
Available in 14 AWS regions, these features can be accessed via AWS console, CLI, or SDKs, automatically improving query performance and reducing metadata overhead for Iceberg tables.
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
Nov 21
2024
2024
AWS Glue Data Catalog supports automatic optimization of Apache Iceberg tables through your Amazon VPC
Nov 21
2024
2024
AWS Glue Data Catalog now supports Apache Iceberg automatic table optimization through Amazon VPC
Sep 12
2024
2024
AWS Glue Data Catalog now supports storage optimization of Apache Iceberg tables
Sep 12
2024
2024
The AWS Glue Data Catalog now supports storage optimization of Apache Iceberg tables
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.