
AWS Step Functions enhances Distributed Map with expanded data source options like Athena manifests, Parquet files, and S3 objects, plus new observability metrics for improved workflow management.


<div>
<p>
AWS Step Functions has expanded data source options and observability for Distributed Map, enhancing workflow capabilities for large-scale data processing:
</p>
<ul>
<li>New data input support includes:
<ul>
<li>AWS Athena data manifest</li>
<li>Parquet files</li>
<li>S3 object prefix iteration</li>
<li>Direct JSON object processing</li>
</ul>
</li>
<li>Added observability metrics:
<ul>
<li>Approximate Open Map Runs Count</li>
<li>Open Map Run Limit</li>
<li>Approximate Map Runs Backlog Size</li>
</ul>
</li>
<li>Available in all commercial AWS Regions</li>
<li>Accessible through AWS Step Functions console</li>
</ul>
<p>
These improvements enable more efficient and transparent distributed data processing workflows.
</p>
</div>


AWS Step Functions expands data source options and improves observability for Distributed Map

Related articles

Related articles

Feb 7
2025
AWS Step Functions expands data source and output options for Distributed Map

Nov 4
2025
Orchestrating big data processing with AWS Step Functions Distributed Map

Sep 18
2025
AWS Step Functions now supports IPv6 with dual-stack endpoints

Sep 30
2025
AWS Step Functions now supports Service Quotas