AWS Glue Data Catalog now supports storage optimization of Apache Iceberg tables
News
The article discusses AWS Glue Data Catalog's new support for storage optimization of Apache Iceberg tables. It helps reduce metadata overhead, control storage costs, and improve query performance.
Specifically, the article covers:
- AWS Glue Data Catalog can automatically remove data files that are no longer needed in Apache Iceberg tables
- It handles snapshots (versions) of tables and removes orphan files (from failed writes)
- Users can enable optimization, set retention periods, and view history of deleted files
- Optimization is available through the AWS console, CLI, and SDKs
- It is currently available in 13 AWS regions
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
Sep 12
2024
2024
The AWS Glue Data Catalog now supports storage optimization of Apache Iceberg tables
Dec 19
2024
2024
AWS Glue Data Catalog offers advanced automatic optimization for Apache Iceberg tables
Nov 21
2024
2024
AWS Glue Data Catalog now supports Apache Iceberg automatic table optimization through Amazon VPC
Nov 21
2024
2024
AWS Glue Data Catalog supports automatic optimization of Apache Iceberg tables through your Amazon VPC
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.