Home icon

Run interactive workloads on Amazon EMR Serverless from Amazon EMR Studio

Big Data Blog

This article discusses how to run interactive PySpark workloads in Amazon EMR Studio using Amazon EMR Serverless as the compute.

Specifically, the article covers:

  • Prerequisites for setting up AWS resources like IAM roles, S3 buckets, and VPC
  • Creating an EMR Studio, Workspace, and EMR Serverless application with an interactive endpoint
  • Running a Spark application interactively, installing external Python packages, and creating visualizations
  • Interacting with the AWS Glue Data Catalog using Spark SQL on EMR Serverless
  • Diagnosing and troubleshooting interactive applications using driver logs and Spark UI
  • Cleanup steps to delete the created resources
  • Conclusion and potential future capabilities of EMR Serverless Interactive applications
Go to article

The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.

Related articles

Jun 9
2026
Run Interactive Workloads on Amazon EMR Serverless with Spark Connect
Aug 4
2026
Run interactive workloads on Amazon EMR on EC2 with Spark Connect
Jun 4
2024
Introducing Amazon EMR Serverless Streaming jobs for continuous processing on streaming data
Sep 11
2026
Orchestrate Amazon EMR Serverless jobs with AWS Step functions

The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.