Amazon DataZone introduces OpenLineage-compatible data lineage visualization in preview
Big Data Blog
This article discusses the preview of an OpenLineage-compatible data lineage visualization feature in Amazon DataZone. It allows capturing, storing, and visualizing lineage of data movement and transformations across various AWS services.
Specifically, the article covers:
- The importance of data lineage for understanding data origins, changes, and consumption
- How Amazon DataZone's data lineage feature works, including its compatibility with OpenLineage
- Visualizing lineage in Amazon DataZone and the capabilities available
- Step-by-step instructions for capturing lineage from AWS Glue tables and ETL jobs, Amazon Redshift, and Amazon MWAA (Apache Airflow)
- Conclusion highlighting the benefits of this feature for data governance and analytics
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
Jun 27
2024
2024
Amazon DataZone introduces API-driven, OpenLineage-compatible data lineage visualization in preview
Jun 27
2024
2024
Introducing end-to-end data lineage (preview) visualization in Amazon DataZone
Dec 3
2024
2024
Data Lineage is now generally available in Amazon DataZone and next generation of Amazon SageMaker
Dec 3
2024
2024
Announcing the general availability of data lineage in the next generation of Amazon SageMaker and Amazon DataZone
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.