Modernize your data observability with Amazon OpenSearch Service zero-ETL integration with Amazon S3
Big Data Blog
The article introduces AWS's new zero-ETL integration between Amazon OpenSearch Service and Amazon S3, allowing you to query and analyze operational logs stored in S3 directly from OpenSearch Service without needing to ingest the data into OpenSearch Service indexes.
Specifically, the article covers:
- Benefits of the OpenSearch Service zero-ETL integration with S3, such as eliminating the need for complex ETL pipelines and reducing storage costs by querying infrequently accessed data directly from S3
- Key concepts like creating Glue Data Catalog tables, skipping indexes, materialized views, and covering indexes to optimize query performance
- A step-by-step walkthrough of setting up the integration using VPC Flow Logs as an example data source
- Cost considerations, where you only pay for the OpenSearch Compute Units consumed during queries and indexing activities
- The integration's value proposition of analyzing hot data in OpenSearch Service and infrequently queried data on S3 without duplicating storage
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
May 22
2024
2024
Amazon OpenSearch Service zero-ETL integration with Amazon S3 now available
May 16
2024
2024
Amazon DocumentDB zero-ETL integration with Amazon OpenSearch Service is now available
Mar 4
2026
2026
Zero-ETL integrations with Amazon OpenSearch Service
Feb 18
2026
2026
Implementing search on Amazon DynamoDB data using zero-ETL integration with Amazon OpenSearch service
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.