The solution provides visibility into resource consumption and costs of individual applications running on Amazon EMR on EC2 clusters, enabling informed workload management, cost optimization, and transparent billing through correlation of YARN metrics, AWS Cost and Usage Reports, Amazon Athena, and Amazon QuickSight.

<div>
<p>The article summarizes how to implement a solution to analyze resource usage and costs of applications running on Amazon EMR clusters using AWS services like Amazon Athena, Amazon QuickSight, and AWS Cost and Usage Reports (CUR).</p>
<p>Specifically, the article covers:</p>
<ul>
<li>Solution overview and benefits</li>
<li>Prerequisites like setting up CUR and Athena integration</li>
<li>Deploying the solution by installing scripts on EMR cluster and launching a CloudFormation stack</li>
<li>Reviewing the correlated cost breakdown views in Athena</li>
<li>Building visualizations in QuickSight using the provided datasets</li>
<li>Clean up steps</li>
</ul>
</div>


Analyze Amazon EMR on Amazon EC2 cluster usage with Amazon Athena and Amazon QuickSight

Related articles

Related articles

Sep 10
2024
Amazon EMR on EC2 improves cluster launch experience with intelligent subnet selection

Dec 16
2024
Analyzing Amazon S3 Metadata with Amazon Athena and Amazon QuickSight

Jan 29
2025
Hybrid big data analytics with Amazon EMR on AWS Outposts

May 12
2026
Streamlined monitoring and debugging for Amazon EMR on EC2