Use Amazon Kinesis Data Streams to deliver real-time data to Amazon OpenSearch Service domains with Amazon OpenSearch Ingestion
Big Data Blog
This article demonstrates how to use Amazon Kinesis Data Streams to deliver real-time data from CloudWatch logs to an Amazon OpenSearch Service domain using Amazon OpenSearch Ingestion.
Specifically, the article covers:
- Solution overview for centralizing log aggregation with Kinesis Data Streams and OpenSearch Ingestion
- Prerequisites (creating a Kinesis data stream and OpenSearch domain)
- Configuring CloudWatch log subscription filters to send logs to Kinesis
- Configuring an OpenSearch Ingestion pipeline to process log data from Kinesis and index it in OpenSearch
- Monitoring the solution with Kinesis, CloudWatch, and OpenSearch metrics
- Cleaning up resources created for this solution
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
Nov 11
2024
2024
Amazon OpenSearch Ingestion adds support for ingesting data from Amazon Kinesis Data Streams
Nov 22
2024
2024
Amazon Managed Service for Apache Flink releases a new Amazon Kinesis Data Streams connector
Nov 20
2024
2024
Amazon Kinesis Data Streams On-Demand mode supports streams writing up to 10GB/s
Aug 31
2026
2026
Amazon Kinesis Data Streams announces data delivery to general purpose Amazon S3 buckets
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.