Automated data governance with AWS Glue Data Quality, sensitive data detection, and AWS Lake Formation
Blog
This article discusses automating data governance on AWS data lakes using AWS Glue Data Quality, sensitive data detection, and AWS Lake Formation tag-based access control.
Specifically, the article covers:
- Data governance requirements like ensuring data confidentiality and data quality
- Solution architecture leveraging AWS Glue Data Quality, sensitive data detection transforms, and Lake Formation tag-based access control
- Provisioning resources using AWS CloudFormation
- Granting permissions using Lake Formation tags for different user categories
- Testing the solution across three use cases: new data ingestion, data drift, and fixing data quality issues
- Conclusion and further reading resources
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.