AWS Glue Data Catalog supports automatic optimization of Apache Iceberg tables through your Amazon VPC
Big Data Blog
AWS Glue Data Catalog now supports automatic optimization of Apache Iceberg tables through specific Amazon VPCs, offering enhanced security and maintenance capabilities for data management.
- Supports automatic table optimization including compaction, snapshot management, and orphan data deletion
- Allows configuring table optimizers to run in specific VPCs, subnets, and security groups
- Provides capabilities for:
- Compacting tables with multiple small files
- Managing snapshot retention
- Deleting unreferenced files
- Helps reduce metadata overhead and improve query performance
- Available in all AWS Glue supported regions
The feature enables customers with advanced security requirements to maintain Iceberg tables while controlling access through specific network configurations.
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
Nov 21
2024
2024
AWS Glue Data Catalog now supports Apache Iceberg automatic table optimization through Amazon VPC
Dec 19
2024
2024
AWS Glue Data Catalog offers advanced automatic optimization for Apache Iceberg tables
Sep 12
2024
2024
AWS Glue Data Catalog now supports storage optimization of Apache Iceberg tables
Sep 12
2024
2024
The AWS Glue Data Catalog now supports storage optimization of Apache Iceberg tables
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.