Home icon

Troubleshoot and minimize AWS DMS replication latency with Amazon S3 as a target

Database Blog



This article discusses how to troubleshoot and minimize replication latency when using Amazon S3 as a target with AWS Database Migration Service (DMS).

Specifically, the article covers:

  • How to troubleshoot latency issues by identifying source and target latency, checking resource utilization, reviewing S3 settings, and checking DMS task logs
  • A use case where high target latency was caused by contention issues during replication to S3, with details on the symptoms and observations
  • Steps to address target performance issues by adjusting DMS endpoint settings like cdcMaxBatchInterval and cdcMinFileSize, and task settings like MinTransactionSize and CommitTimeout
  • Additional configurations like increasing MemoryLimitTotal and MemoryKeepTime if the "Reading from source is paused" issue persists
  • Conclusion emphasizing the importance of testing changes and leveraging DMS features for monitoring and automation


Go to article

The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.

Related articles

May 3
2024
Tune replication performance with AWS DMS for an Amazon Kinesis Data Streams target endpoint – Part 1
May 3
2024
Tune replication performance with AWS DMS for an Amazon Kinesis Data Streams target endpoint – Part 2
May 3
2024
Tune replication performance with AWS DMS for an Amazon Kinesis Data Streams target endpoint – Part 3
Feb 20
2024
Understand and optimize replication for Amazon Redshift with AWS DMS

The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.