Visualize Confluent data in Amazon QuickSight using Amazon Athena
Blog
This article demonstrates how to visualize Confluent streaming data in Amazon QuickSight using Amazon Athena without duplicating data.
- Athena connector for Kafka enables querying Confluent data directly without moving it to S3
- Register Confluent topic schemas in AWS Glue Schema Registry for Athena query planning
- Deploy Athena Kafka connector with Confluent Cloud credentials stored in AWS Secrets Manager
- Join streaming Confluent data with reference data in S3 using standard SQL queries
- Create QuickSight datasets from Athena queries for real-time visualization and analysis
- Predicate pushdown filters reduce data scanned and improve query performance
- Eliminates data duplication and reduces storage costs compared to S3 sink connector approach
This integration enables enterprises to analyze real-time streaming data and enrich it with reference datasets without separate ETL pipelines or data movement.
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.