Home icon
Amazon S3 audit logging, Part 3: Analyzing S3 Metadata journal tables for object lifecycle tracking

Storage Blog



This article explains how to use Amazon S3 Metadata journal tables with Amazon Athena to track object lifecycle changes and optimize storage costs.

  • S3 Metadata journal tables automatically record object state changes in query-optimized Parquet format
  • Captures storage class transitions, encryption changes, tag modifications, and Object Lock events
  • Does not capture access information, HTTP details, user identity, or replication status
  • Enable via S3 console Metadata tab; records delivered within 15 minutes; pay only for storage and Athena queries
  • Six query patterns provided: storage class transitions, distribution analysis, lifecycle timelines, premature transitions, encryption changes, and change frequency detection
  • Use partition pruning on record_timestamp to minimize Athena costs ($5 per TB scanned)
  • Part 3 of series covering server access logs (Part 1) and CloudTrail data events (Part 2)

S3 Metadata journal tables provide visibility into object state changes for storage optimization and governance compliance without infrastructure management.



Go to article

The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.

Related articles

The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.