Amazon OpenSearch Service introduces intelligent ingestion for logs and documents in Amazon S3

Amazon OpenSearch Serverless now offers intelligent ingestion, a fully managed feature that automatically transforms logs and documents from Amazon S3 into searchable content in OpenSearch Serverless collections.

• Supports observability logs and structured data in JSON, NDJSON, and JSON array formats
• Handles unstructured files including PDF, Word, plain text, and Markdown formats
• Automatically detects data types, parses documents, generates embeddings, and indexes results
• Offers ingestion jobs for one-time migrations and ingestion streams for continuous syncing
• Uses vision-language models to describe images and charts, making visual content searchable
• Scales capacity automatically with pay-per-use pricing, no advance sizing needed
• Available for OpenSearch Serverless (NextGen) collections across seven AWS Regions

Intelligent ingestion eliminates the need to manage ingestion infrastructure or write pipeline code, enabling rapid setup through the AWS Console or API.