Enhance monitoring and observability for AWS HealthOmics workflows

This article discusses enhancing monitoring and observability for AWS HealthOmics workflows by automating the ingestion and analysis of workflow run information.

• Solution uses an event-driven architecture with a data lake to collect workflow metrics
• Captures workflow run status events, manifest logs, and Run Analyzer outputs
• Enables automated processing and transformation of workflow data using AWS Lambda
• Allows creation of custom dashboards using Amazon QuickSight and Amazon Athena
• Provides benefits like performance improvement, root cause analysis, and cost optimization

The solution helps researchers and organizations gain better insights into their genomic and omics data workflows by providing comprehensive monitoring and observability tools.