New: Improve Apache Iceberg query performance in Amazon S3 with sort and z-order compaction
AWS News Blog
AWS has introduced new compaction strategies for Apache Iceberg in Amazon S3 to improve query performance: `sort` and `z-order` compaction.
- `Sort` compaction organizes files based on user-defined column order, reducing files scanned during queries
- `Z-order` compaction enables efficient file pruning across multiple dimensions
- These strategies help optimize data layout in tables with high-ingest or frequently updated datasets
- Available for both S3 Tables and general purpose S3 buckets with AWS Glue Data Catalog
- Performance improvements can be up to threefold compared to default `binpack` compaction
The new compaction methods help reduce query latency and query engine costs by more efficiently organizing data files.
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
Jun 24
2025
2025
Amazon S3 now supports sort and z-order compaction for Apache Iceberg tables
Jul 15
2025
2025
Amazon S3 now supports compaction of Apache Avro and ORC formats for Apache Iceberg tables
Dec 3
2024
2024
Announcing Amazon S3 Tables – Fully managed Apache Iceberg tables optimized for analytics workloads
Dec 19
2024
2024
Accelerate queries on Apache Iceberg tables through AWS Glue auto compaction
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.