Create a modern data platform using the Data Build Tool (dbt) in the AWS Cloud
Blog
This article describes how to create a modern data platform using the Data Build Tool (dbt) and various AWS services. It covers a case study of a retail company that migrated and modernized their legacy data platform using dbt and AWS.
Specifically, the article covers:
- The use case and requirements for the retail company
- An overview of the solution architecture using AWS services like Amazon Redshift, AWS Glue, AWS Lambda, Amazon MWAA, and dbt
- Data ingestion approaches (real-time and batch) using services like AWS DMS, AWS Glue, and AWS Lambda
- Data warehousing layers in Amazon Redshift (landing, certified dataset, user-friendly data mart)
- Creating dbt projects and data pipelines
- Orchestrating ETL jobs using Amazon MWAA and Airflow DAGs
- Conclusion on the benefits of using dbt and AWS for building modern data platforms
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.