
Monitor Amazon MSK cluster health and performance by integrating Amazon Managed Service for Prometheus and Amazon Managed Grafana to scrape JMX metrics and visualize real-time Kafka operational insights.


<div><p>This article provides a step-by-step guide to monitor Amazon MSK clusters using Amazon Managed Service for Prometheus and Amazon Managed Grafana for comprehensive operational insights.</p><ul><li>Enable open monitoring on MSK clusters to expose JMX and node metrics via Prometheus exporters</li><li>Create Amazon Managed Service for Prometheus workspace for centralized metric storage and analysis</li><li>Deploy Prometheus server on EC2 instance to scrape metrics from MSK brokers</li><li>Use VPC endpoint for secure communication between EC2 and Prometheus workspace</li><li>Import pre-built Kafka dashboard into Grafana for real-time cluster monitoring</li><li>Monitor topics, partitions, consumer lag, broker health, and network throughput</li><li>Optionally import Node Exporter dashboard for infrastructure-level metrics</li></ul><p>This integrated solution enables proactive issue detection, enhanced troubleshooting, and effective capacity planning for Kafka-based applications.</p></div>


Related articles