Run watsonx.data integration pipelines close to your data on AWS

This article explains how IBM watsonx.data integration enables data pipeline portability on AWS through a decoupled architecture separating design from execution.

• Cloud-based control plane handles pipeline design, scheduling, and monitoring
• Remote engines deployed in AWS accounts run pipelines close to data sources
• Same pipeline definition works across AWS Regions, on-premises, and hybrid environments
• Remote engines can deploy on EC2, EKS, or Red Hat OpenShift Service on AWS
• Connection credentials stored locally on remote engines, not in control plane
• Only metadata returns to control plane; data stays in source environment
• Supports batch processing, real-time streaming, and data observability
• Pipeline portability eliminates need to rebuild when infrastructure changes

watsonx.data integration simplifies enterprise data pipeline management by enabling design-once, run-anywhere execution while maintaining data residency and security requirements.