Introducing self-managed data sources for Amazon OpenSearch Ingestion
Big Data Blog
This article introduces support for self-managed data sources like Apache Kafka and OpenSearch/Elasticsearch clusters for Amazon OpenSearch Ingestion. It outlines the prerequisites and steps to create pipelines for ingesting data from these sources.
Specifically, the article covers:
- Solution overview and prerequisites for network connectivity, name resolution, certificate verification, and access permissions
- Steps to create a pipeline with self-managed Kafka as the source
- Steps to create a pipeline with self-managed OpenSearch/Elasticsearch as the source
- Considerations for using self-managed OpenSearch as the data source
- Conclusion highlighting other supported data sources for OpenSearch Ingestion
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
Jul 1
2024
2024
Amazon OpenSearch Ingestion adds support for ingesting data from self-managed sources
Jun 12
2024
2024
Ingest and analyze your data using Amazon OpenSearch Service with Amazon OpenSearch Ingestion
Sep 16
2024
2024
Amazon OpenSearch Service: Managed and community driven
Jun 6
2025
2025
Ingest data from Atlassian Jira and Confluence into Amazon OpenSearch Service
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.