New: Improve Apache Iceberg query performance in Amazon S3 with sort and z-order compaction
AWS News Blog
AWS has introduced new compaction strategies for Apache Iceberg in Amazon S3 to improve query performance: `sort` and `z-order` compaction.
- `Sort` compaction organizes files based on user-defined column order, reducing files scanned during queries
- `Z-order` compaction enables efficient file pruning across multiple dimensions
- These strategies help optimize data layout in tables with high-ingest or frequently updated datasets
- Available for both S3 Tables and general purpose S3 buckets with AWS Glue Data Catalog
- Performance improvements can be up to threefold compared to default `binpack` compaction
The new compaction methods help reduce query latency and query engine costs by more efficiently organizing data files.
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
Jun 24
2025
2025
Amazon S3 now supports sort and z-order compaction for Apache Iceberg tables
Jul 15
2025
2025
Amazon S3 now supports compaction of Apache Avro and ORC formats for Apache Iceberg tables
Jun 13
2025
2025
Query Amazon S3 Tables from open source Trino using Apache Iceberg REST endpoint
Jul 16
2025
2025
Compaction support for Avro and ORC file formats in Apache Iceberg tables in Amazon S3
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.