Migrate workloads from AWS Data Pipeline
Big Data Blog
The article discusses how to migrate workloads from AWS Data Pipeline to other AWS services like AWS Glue, AWS Step Functions, and Amazon Managed Workflows for Apache Airflow (Amazon MWAA).
Specifically, the article covers:
- Overview of AWS Data Pipeline and reasons for migrating to newer services
- When to migrate to AWS Glue, with examples for exporting DynamoDB to S3 and importing DynamoDB from S3
- When to migrate to AWS Step Functions, with an example for migrating HadoopActivity on EmrCluster
- When to migrate to Amazon MWAA, with an example for migrating HadoopActivity on EmrCluster
- Cleanup instructions after migration
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
Dec 9
2024
2024
Migrate and Archive data for ADAS workloads on AWS
Jul 8
2025
2025
Migrate and modernize VMware workloads with AWS Transform for VMware
Jan 2
2024
2024
How to migrate a large-scale SQL Server database over low bandwidth using AWS Application Migration Service
Feb 24
2026
2026
Migrating enterprise ML workloads from Databricks to AWS for large scale ML
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.