Home icon

Enable cross-cloud analytics with Amazon S3 Tables and Google BigQuery, Part 1: IAM-based access control

Big Data Blog



This article demonstrates how to enable Google BigQuery to query Apache Iceberg tables stored in Amazon S3 Tables using IAM-based access control through AWS Glue's Iceberg REST Catalog.

  • Use AWS Glue Iceberg REST Catalog as metadata bridge between BigQuery and S3 Tables
  • Configure OIDC federation to allow BigQuery to assume AWS IAM roles for cross-cloud access
  • Set up S3 Tables integration with Glue Data Catalog using federated s3tablescatalog
  • Create BigQuery federated catalog that syncs metadata from Glue on configurable refresh intervals
  • Enable schema evolution tracking through Iceberg metadata without manual DDL changes
  • Query live Iceberg data from BigQuery without data duplication or replication pipelines

This IAM-based approach provides simpler cross-cloud analytics by allowing BigQuery to read S3 Tables data directly while maintaining single-source-of-truth governance through AWS identity policies.



Go to article

The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.

Related articles

Aug 25
2026
Enable cross-cloud analytics with Amazon S3 Tables and Google BigQuery, Part 2: access control with Lake Formation
Apr 18
2024
Evaluating public and cross account access at scale with IAM Access Analyzer for Amazon S3
Aug 11
2026
AWS Identity and Access Management streamlines assignment of IAM roles to workforce users with account access manager
Aug 7
2026
Securing your Amazon S3 buckets: Identifying and remediating over-permissioned access

The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.