Amazon OpenSearch Ingestion adds supports to ingest streaming data from Confluent Cloud

This article announces that Amazon OpenSearch Ingestion now supports ingesting streaming data from Confluent Cloud Kafka clusters into Amazon OpenSearch Service managed clusters or Serverless collections. This integration enables near-real-time aggregations, sampling, and anomaly detection on ingested data, helping build efficient data pipelines for complex observability use cases.

Specifically, the article covers:

• Amazon OpenSearch Ingestion can consume data from one or more topics in a Confluent Kafka cluster and transform the data before writing it to Amazon OpenSearch Service or Amazon S3.
• Users can configure the number of consumers per topic and tune fetch parameters for high and low priority data.
• Confluent Schema Registry can be used to specify data schema for dynamic reading at ingest time.
• This feature is available in 14 regions, including US, Europe, Asia Pacific, Canada, and South America.
• Links to Amazon OpenSearch Ingestion webpage and Developer Guide for more information.