AWS Glue Interactive Sessions now support Spark Connect for interactive workloads
News
AWS Glue Interactive Sessions now support Apache Spark Connect, enabling developers to build and run Spark applications from preferred IDEs and notebooks on serverless infrastructure.
- Develop and run Spark applications from SageMaker Unified Studio, Jupyter, VS Code, and other IDEs
- Thin client architecture decouples client applications from Spark execution environment
- Enables ad hoc data exploration, iterative debugging, and incremental PySpark development
- Real-time session monitoring via Spark UI and history tracking through Spark History Server
- Available across Asia Pacific, Canada, Europe, South America, and US regions
Spark Connect simplifies Spark development workflows by eliminating cluster management while providing observability and stability through isolated client dependencies.
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.