Run interactive workloads on Amazon EMR Serverless from Amazon EMR Studio
Big Data Blog
This article discusses how to run interactive PySpark workloads in Amazon EMR Studio using Amazon EMR Serverless as the compute.
Specifically, the article covers:
- Prerequisites for setting up AWS resources like IAM roles, S3 buckets, and VPC
- Creating an EMR Studio, Workspace, and EMR Serverless application with an interactive endpoint
- Running a Spark application interactively, installing external Python packages, and creating visualizations
- Interacting with the AWS Glue Data Catalog using Spark SQL on EMR Serverless
- Diagnosing and troubleshooting interactive applications using driver logs and Spark UI
- Cleanup steps to delete the created resources
- Conclusion and potential future capabilities of EMR Serverless Interactive applications
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
Jun 9
2026
2026
Run Interactive Workloads on Amazon EMR Serverless with Spark Connect
Oct 1
2024
2024
Amazon EMR Serverless introduces Job Run Concurrency and Queuing controls
Sep 4
2024
2024
Use Apache Spark on Amazon EMR Serverless directly from Amazon Sagemaker Studio
Jul 22
2025
2025
Amazon EMR Serverless adds support for Inline Runtime Permissions for job runs
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.