Home icon

Introducing Terraform support for Amazon OpenSearch Ingestion

Big Data Blog



This article introduces Terraform support for Amazon OpenSearch Ingestion, a fully managed, serverless data collector that delivers real-time log, metric, and trace data to Amazon OpenSearch Service domains and Amazon OpenSearch Serverless collections.

Specifically, the article covers:

  • Solution overview: Deploying an OpenSearch Ingestion pipeline with Terraform, along with supporting resources like an Amazon OpenSearch domain, IAM role, CloudWatch log group, and the pipeline configuration.
  • Prerequisites: AWS account, Terraform installed, IAM permissions, and awscurl tool.
  • Creating a Terraform configuration directory and defining AWS resources in main.tf.
  • Creating the resources using Terraform apply.
  • Testing the pipeline by sending sample logs and verifying data ingestion.
  • Cleaning up resources using Terraform destroy.
  • Conclusion: Benefits of using Terraform to deploy OpenSearch Ingestion pipelines and available resources for getting started.


Go to article

The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.

Related articles

Feb 27
2024
Use Amazon OpenSearch Ingestion to migrate to Amazon OpenSearch Serverless
Jun 26
2024
Amazon OpenSearch Ingestion adds supports to ingest streaming data from Confluent Cloud
Jul 1
2024
Amazon OpenSearch Ingestion adds support for ingesting data from self-managed sources
Nov 22
2024
Amazon OpenSearch Ingestion now supports AWS Lambda for custom data transformation

The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.