Turn petabytes of relational database records into a cost-efficient audit trail using Amazon Athena, AWS DMS, Amazon RDS, and Amazon S3
Database Blog
This article discusses a solution for turning large amounts of relational database records into a cost-efficient and secure audit trail using AWS services like Amazon Athena, AWS DMS, Amazon RDS, and Amazon S3.
Specifically, the article covers:
- Overview of the solution architecture
- Using AWS DMS to export data from Amazon RDS to a staging S3 bucket in Parquet format
- Copying data from the staging bucket to an archive bucket with S3 Object Lock enabled to prevent modification
- Partitioning strategies for Parquet files to optimize Athena query performance and cost
- Querying the archived data using Amazon Athena with low latency and cost
- Benefits of the solution compared to using database snapshots for archiving
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
Jul 23
2024
2024
Enhance database performance with Amazon RDS dedicated log volumes
Jan 21
2026
2026
Automate the export of Amazon RDS for MySQL or Amazon Aurora MySQL audit logs to Amazon S3 with batching or near real-time processing
Jul 7
2026
2026
Automate PostgreSQL audit log extraction and analysis with Amazon S3
Mar 7
2024
2024
Petabyte-scale log analytics with Amazon S3, Amazon OpenSearch Service, and Amazon OpenSearch Ingestion
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.