Run Interactive Workloads on Amazon EMR Serverless with Spark Connect
News
This article announces Spark Connect support for Amazon EMR Serverless, enabling interactive development of Apache Spark applications from notebooks and IDEs.
- Interactive sessions with persistent Spark context across cells and scripts
- Develop in SageMaker Unified Studio, Jupyter, Visual Studio Code, and other IDEs
- Blend local Python code with remote Spark operations seamlessly
- Monitor and debug sessions via EMR console and Spark UI
- Real-time session monitoring and history tracking capabilities
- Granular cost and usage visibility per session
- Available with EMR release 7.13 in all EMR Serverless regions
Spark Connect on EMR Serverless enables interactive data exploration and iterative development workflows while maintaining separation between client and Spark infrastructure.
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.