Home icon
Run Interactive Workloads on Amazon EMR Serverless with Spark Connect

News



This article announces Spark Connect support for Amazon EMR Serverless, enabling interactive development of Apache Spark applications from notebooks and IDEs.

  • Interactive sessions with persistent Spark context across cells and scripts
  • Develop in SageMaker Unified Studio, Jupyter, Visual Studio Code, and other IDEs
  • Blend local Python code with remote Spark operations seamlessly
  • Monitor and debug sessions via EMR console and Spark UI
  • Real-time session monitoring and history tracking capabilities
  • Granular cost and usage visibility per session
  • Available with EMR release 7.13 in all EMR Serverless regions

Spark Connect on EMR Serverless enables interactive data exploration and iterative development workflows while maintaining separation between client and Spark infrastructure.



Go to article

The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.

Related articles

The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.