Introducing Amazon MWAA larger environment sizes
Big Data Blog
This article introduces larger environment sizes (XL and 2XL) for Amazon Managed Workflows for Apache Airflow (Amazon MWAA), a managed service that streamlines the setup and operation of Apache Airflow environments for orchestrating data pipelines in the cloud.
Specifically, the article covers:
- Current challenges with resource constraints in existing Amazon MWAA environment sizes for running complex, resource-intensive workloads or a high volume of Directed Acyclic Graphs (DAGs)
- The capabilities of the new XL and 2XL environment classes, offering 2x and 4x more compute and 3x and 6x more memory respectively compared to the large environment size
- Pricing considerations for the new environment classes
- Guidance on observing Amazon MWAA performance metrics to identify resource bottlenecks and plan for upgrading to larger environment sizes
- Steps to set up a new XL or 2XL environment or upgrade an existing environment
- Conclusion highlighting the benefits of the larger environment sizes for running more complex and resource-intensive Apache Airflow workloads
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.