AWS Glue mutual TLS authentication for Amazon MSK
Big Data Blog
This article explains how to securely process and analyze streaming data from Amazon Managed Streaming for Apache Kafka (Amazon MSK) using AWS Glue with mutual TLS authentication.
Specifically, the article covers:
- Creating a private CA using AWS Certificate Manager (ACM) and generating client certificates
- Setting up an Amazon MSK cluster with mutual TLS authentication
- Creating a Kafka connection in AWS Glue with mutual TLS authentication
- Creating a Python shell job in AWS Glue to produce messages for the Kafka topic
- Creating an AWS Glue Streaming job to consume and process messages from the Kafka topic
- Analyzing the processed data using Amazon Athena
- Conclusion and cleanup steps
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.