Copy and mask PII between Amazon RDS databases using visual ETL jobs in AWS Glue Studio
Big Data Blog
This article explains how to copy data from one Amazon RDS PostgreSQL database to another while automatically masking personally identifiable information (PII) using AWS Glue Studio, a low-code visual editor for building ETL pipelines.
Specifically, the article covers:
- Solution overview and prerequisites
- Enabling connectivity between the AWS accounts hosting the source, target, and AWS Glue resources
- Creating AWS Glue components like connections and crawlers to access the databases
- Building a visual ETL job in AWS Glue Studio with steps for data extraction, PII detection and masking, data transformation, and loading to the target database
- Running the ETL job and verifying the results
- Cleaning up the resources created
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
Sep 5
2024
2024
Amazon RDS Custom for SQL Server supports Cross-region Snapshot Copying
Jul 10
2024
2024
Author data integration jobs with an interactive data preparation experience with AWS Glue visual ETL
Sep 10
2024
2024
Migrate Delta tables from Azure Data Lake Storage to Amazon S3 using AWS Glue
Sep 12
2024
2024
Amazon RDS for MySQL zero-ETL integration with Amazon Redshift is now generally available
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.