
AWS DataSync enables faster large-scale data transfers by using multi-task and multi-agent architectures to parallelize workloads, maximize network bandwidth utilization, and reduce overall migration timelines.


<div><p>This article explains how to accelerate data transfers using AWS DataSync scale-out architectures for large-scale migrations.</p><ul><li>DataSync agents deployed on-premises act as clients connecting to local storage systems</li><li>Single agent with 64GB RAM supports up to 50 million files per task</li><li>Run multiple parallel tasks to spread workload across agents and increase throughput</li><li>Use task filtering with include/exclude patterns to distribute data across tasks</li><li>Configure multiple agents per single task location for additional parallelization</li><li>Plan for increased I/O on source/destination storage and network bandwidth consumption</li><li>Monitor Amazon EFS and FSx performance using CloudWatch metrics</li><li>Combine multiple tasks and multiple agents for large-scale migrations</li></ul><p>DataSync scale-out methods reduce migration timelines by maximizing available network bandwidth and parallelizing data transfers across multiple agents and tasks.</p></div>


Related articles