Scale your AWS Glue for Apache Spark jobs with R type, G.12X, and G.16X workers
Big Data Blog
AWS has announced new worker types for AWS Glue for Apache Spark jobs, introducing R type, G.12X, and G.16X workers to help organizations handle more complex and demanding data processing workloads.
- R type workers offer increased memory with a 1:8 vCPU to memory ratio, available in R.1X, R.2X, R.4X, and R.8X configurations
- G.12X and G.16X workers provide more compute, memory, and storage for intensive data integration jobs
- New worker types are designed for scenarios like:
- Large join operations
- High-cardinality group by operations
- Complex query plans
- Machine learning and analytics
- Data skew scenarios
- Workers can be easily selected through AWS Glue Studio, API, CLI, or interactive sessions
- Pricing is $0.52 per DPU-hour for R type and $0.44 per DPU-hour for G type workers
These new worker types enable vertical scaling for more resource-intensive data processing tasks, providing greater flexibility in handling complex workloads.
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.