Introducing Amazon MWAA Serverless
Big Data Blog
This article introduces Amazon MWAA Serverless, a new deployment option for Apache Airflow that eliminates operational overhead through serverless scaling and pay-per-use pricing.
- Automatically scales infrastructure based on workflow demands without provisioning overhead
- Pay only for actual compute time used during task execution
- Uses YAML-based workflow definitions for enhanced security and task isolation
- Each workflow has granular IAM permissions and runs on chosen VPC
- Supports Amazon Provider Package operators; custom code requires AWS services like Lambda, Batch, or Glue
- No Airflow web interface; monitoring via CloudWatch and CloudTrail
- Includes conversion tool to migrate existing Python DAGs to YAML format
- Task logs stored in CloudWatch log groups for debugging and observability
MWAA Serverless simplifies workflow orchestration by removing infrastructure management while providing cost optimization and improved security through declarative YAML configurations.
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.