Amazon EMR Serverless announces detailed performance monitoring of Apache Spark jobs with Amazon Managed Service for Prometheus
News
The article announces the ability to monitor detailed performance metrics for Apache Spark jobs running on Amazon EMR Serverless by integrating with Amazon Managed Service for Prometheus.
Specifically, the article covers:
- Apache Spark provides detailed performance metrics for drivers and executors, like JVM memory, GC, and shuffle information
- Amazon Managed Service for Prometheus is a serverless monitoring and alerting service
- EMR Serverless now integrates with Managed Prometheus to monitor Spark metrics in a centralized view
- This feature is available on EMR release 7.1.0+ in several AWS regions
- Users can visit the documentation to get started with this new monitoring capability
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.