Home icon

Streamline large binary object migrations: A Kafka-based solution for Oracle to Amazon Aurora PostgreSQL and Amazon S3

Big Data Blog

This article presents a Kafka-based solution for migrating large binary objects (LOBs) from Oracle databases to Aurora PostgreSQL and Amazon S3.

  • Uses Amazon MSK, MSK Connect, and Lambda to stream and process LOB data during migration
  • Debezium connectors capture Oracle changes and apply them to Aurora PostgreSQL
  • Lambda functions download BLOBs from Oracle and upload to S3, organized by primary key
  • Eliminates size constraints and truncation issues of traditional migration tools
  • Reduces Oracle licensing costs by decoupling LOBs from the database
  • Maintains data integrity and referential relationships during long-running migrations
  • Requires network connectivity (Direct Connect or VPN) for on-premises Oracle databases
  • Complete implementation available on GitHub with AWS CDK deployment code

This solution enables seamless Oracle LOB migration to AWS while maintaining business continuity and avoiding traditional migration failures.

Go to article

The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.

Related articles

Jun 10
2026
How to migrate from Oracle to Amazon Aurora PostgreSQL using AWS CloudFormation (Part 1)
Jan 14
2026
Effectively managing storage in Amazon RDS for Oracle Databases
Jan 22
2026
Modernize your data warehouse by migrating Oracle Database to Amazon Redshift with Oracle GoldenGate
Feb 11
2026
Migrate relational-style data from NoSQL to Amazon Aurora DSQL

The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.