Scaling UX testing with Amazon Nova Act: A new approach to user flow analysis
Machine Learning Blog
This article demonstrates how to build a cloud-deployed UX testing platform using Amazon Nova Act to automatically generate test scenarios, execute user flows at scale, and provide actionable insights through automated analysis.
- Amazon Nova Act uses multimodal AI to understand and interact with web interfaces through vision and action, adapting to interface changes unlike traditional scripting tools
- Solution includes four layers: documentation processing for test scenario generation, orchestration for managing test execution, execution using ECS and Fargate for parallel testing, and analysis for metrics
- Automatic flow generation from documentation uses Claude 4.5 Sonnet to convert user tasks into detailed testing workflows at multiple granularity levels
- Manual flow definition allows precise control over test scenarios for edge cases and new features not covered in documentation
- Supports persistent browser sessions for authenticated user flows, structured data extraction with Pydantic schemas, and file operations for upload/download testing
- Dashboard provides metrics across abstraction layers including overview health, performance efficiency, and error-adjusted signals separating infrastructure failures from agent failures
This approach enables comprehensive UX testing at scale, helping teams catch issues earlier and iterate faster on user experiences without the maintenance overhead of traditional automation tools.
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
2026
2026
2026
2026
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.