Use Amazon Kinesis Data Streams to deliver real-time data to Amazon OpenSearch Service domains with Amazon OpenSearch Ingestion
Big Data Blog
This article demonstrates how to use Amazon Kinesis Data Streams to deliver real-time data from CloudWatch logs to an Amazon OpenSearch Service domain using Amazon OpenSearch Ingestion.
Specifically, the article covers:
- Solution overview for centralizing log aggregation with Kinesis Data Streams and OpenSearch Ingestion
- Prerequisites (creating a Kinesis data stream and OpenSearch domain)
- Configuring CloudWatch log subscription filters to send logs to Kinesis
- Configuring an OpenSearch Ingestion pipeline to process log data from Kinesis and index it in OpenSearch
- Monitoring the solution with Kinesis, CloudWatch, and OpenSearch metrics
- Cleaning up resources created for this solution
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
Nov 11
2024
2024
Amazon OpenSearch Ingestion adds support for ingesting data from Amazon Kinesis Data Streams
Jan 17
2023
2023
Build highly available streams with Amazon Kinesis Data Streams
Jun 12
2024
2024
Ingest and analyze your data using Amazon OpenSearch Service with Amazon OpenSearch Ingestion
Jun 6
2024
2024
Amazon OpenSearch Ingestion now supports ingesting streaming data from Amazon MSK Serverless
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.