AWS Glue mutual TLS authentication for Amazon MSK
Big Data Blog
This article explains how to securely process and analyze streaming data from Amazon Managed Streaming for Apache Kafka (Amazon MSK) using AWS Glue with mutual TLS authentication.
Specifically, the article covers:
- Creating a private CA using AWS Certificate Manager (ACM) and generating client certificates
- Setting up an Amazon MSK cluster with mutual TLS authentication
- Creating a Kafka connection in AWS Glue with mutual TLS authentication
- Creating a Python shell job in AWS Glue to produce messages for the Kafka topic
- Creating an AWS Glue Streaming job to consume and process messages from the Kafka topic
- Analyzing the processed data using Amazon Athena
- Conclusion and cleanup steps
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
Oct 1
2024
2024
Amazon MSK APIs now supports AWS PrivateLink
Jun 19
2025
2025
Secure access to a cross-account Amazon MSK cluster from Amazon MSK Connect using IAM authentication
Nov 24
2025
2025
Amazon CloudFront announces support for mutual TLS authentication
May 6
2026
2026
Migrating TLS Clients managed by third-party Certificate Authorities from self-managed Apache Kafka to Amazon MSK
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.