
AWS Step Functions enhances Distributed Map with expanded data source options like Athena manifests, Parquet files, and S3 objects, plus new observability metrics for improved workflow management.


<div>
<p>
AWS Step Functions has expanded data source options and observability for Distributed Map, enhancing workflow capabilities for large-scale data processing:
</p>
<ul>
<li>New data input support includes:
<ul>
<li>AWS Athena data manifest</li>
<li>Parquet files</li>
<li>S3 object prefix iteration</li>
<li>Direct JSON object processing</li>
</ul>
</li>
<li>Added observability metrics:
<ul>
<li>Approximate Open Map Runs Count</li>
<li>Open Map Run Limit</li>
<li>Approximate Map Runs Backlog Size</li>
</ul>
</li>
<li>Available in all commercial AWS Regions</li>
<li>Accessible through AWS Step Functions console</li>
</ul>
<p>
These improvements enable more efficient and transparent distributed data processing workflows.
</p>
</div>


Related articles