Serverless Storage on Amazon EMR Serverless now supports terabyte-scale shuffle
News
This article announces that Amazon EMR Serverless now supports terabyte-scale shuffle operations, significantly expanding its serverless storage capabilities.
- Shuffle operation limit increased from 200 GB to 1 TB per job
- Enables production-scale Apache Spark workloads without cluster management
- Supports complex operations like large table joins and aggregations on multi-terabyte datasets
- Spill support offloads data to disk for memory-intensive operations
- Available with EMR 7.14, EMR Spark 8.1 and later in 18 AWS Regions
Enterprise data teams can now confidently run production workloads with terabyte-scale datasets without storage constraints.
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
Mar 10
2026
2026
Reducing costs for shuffle-heavy Apache Spark workloads with serverless storage for Amazon EMR Serverless
Jan 6
2026
2026
Amazon EMR Serverless eliminates local storage provisioning, reducing data processing costs by up to 20%
Jul 7
2026
2026
Amazon EMR Serverless now supports larger worker sizes to run more compute and memory intensive workloads
Dec 2
2025
2025
Amazon EMR Serverless eliminates local storage provisioning for Apache Spark workloads
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.