Home icon

AWS Step Functions expands data source options and improves observability for Distributed Map

News

AWS Step Functions has expanded data source options and observability for Distributed Map, enhancing workflow capabilities for large-scale data processing:

  • New data input support includes:
    • AWS Athena data manifest
    • Parquet files
    • S3 object prefix iteration
    • Direct JSON object processing
  • Added observability metrics:
    • Approximate Open Map Runs Count
    • Open Map Run Limit
    • Approximate Map Runs Backlog Size
  • Available in all commercial AWS Regions
  • Accessible through AWS Step Functions console

These improvements enable more efficient and transparent distributed data processing workflows.

Go to article

The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.

Related articles

Feb 7
2025
AWS Step Functions expands data source and output options for Distributed Map
Nov 4
2025
Orchestrating big data processing with AWS Step Functions Distributed Map
Oct 24
2025
Processing Amazon S3 objects at scale with AWS Step Functions Distributed Map S3 prefix
Nov 22
2024
AWS Step Functions simplifies developer experience with Variables and JSONata transformations

The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.