Petabyte-scale log analytics with Amazon S3, Amazon OpenSearch Service, and Amazon OpenSearch Ingestion
Big Data Blog
This article discusses solutions for enabling petabyte-scale log analytics using Amazon OpenSearch Service in a modern data architecture on AWS.
Specifically, the article covers:
- Three solution architectures for managing high volumes of log data:
- 1. Tiered storage in OpenSearch Service and data lifecycle management
- 2. On-demand ingestion of logs using Amazon OpenSearch Ingestion
- 3. OpenSearch Service direct queries with Amazon S3
- Best practices for optimizing data ingestion and storage
- Conclusion summarizing key considerations for choosing the right architecture pattern
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
Aug 20
2025
2025
Build enterprise-scale log ingestion pipelines with Amazon OpenSearch Service
Apr 1
2026
2026
Amazon OpenSearch Service introduces agentic AI for log analytics
Sep 16
2025
2025
Get started with Amazon OpenSearch Service: T-shirt size your domain for log analytics
Aug 20
2024
2024
Reducing long-term logging expenses by 4,800% with Amazon OpenSearch Service
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.