Home icon

Create and update Apache Iceberg tables with partitions in the AWS Glue Data Catalog using the AWS SDK and AWS CloudFormation

Big Data Blog

This article demonstrates how to create and update Apache Iceberg tables with partitions in AWS Glue Data Catalog using AWS SDK, CLI, and CloudFormation.

  • AWS Glue now supports Iceberg table management with partitions via APIs and IaC tools
  • Previously required separate steps in Athena; now fully automatable in CI/CD pipelines
  • CreateTable() API creates Iceberg tables with schema, partitions, and sort order
  • UpdateTable() API modifies table schema by adding metadata JSON files to S3
  • Requires AWS CLI 2.27.58+ or Python SDK 1.39.12+
  • Examples provided for AWS CLI, Boto3, and CloudFormation templates
  • Supports partition transforms like year and identity on specified columns

This release enables enterprises to automate Iceberg table lifecycle management at scale with full lineage tracking in one place.

Go to article

The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.

Related articles

Nov 26
2025
Introducing catalog federation for Apache Iceberg tables in the AWS Glue Data Catalog
Mar 4
2024
Use AWS Glue ETL to perform merge, partition evolution, and schema evolution on Apache Iceberg
Sep 12
2024
The AWS Glue Data Catalog now supports storage optimization of Apache Iceberg tables
Nov 21
2024
AWS Glue Data Catalog supports automatic optimization of Apache Iceberg tables through your Amazon VPC

The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.