Home icon

Scaling UX testing with Amazon Nova Act: A new approach to user flow analysis

Machine Learning Blog



This article demonstrates how to build a cloud-deployed UX testing platform using Amazon Nova Act to automatically generate test scenarios, execute user flows at scale, and provide actionable insights through automated analysis.

  • Amazon Nova Act uses multimodal AI to understand and interact with web interfaces through vision and action, adapting to interface changes unlike traditional scripting tools
  • Solution includes four layers: documentation processing for test scenario generation, orchestration for managing test execution, execution using ECS and Fargate for parallel testing, and analysis for metrics
  • Automatic flow generation from documentation uses Claude 4.5 Sonnet to convert user tasks into detailed testing workflows at multiple granularity levels
  • Manual flow definition allows precise control over test scenarios for edge cases and new features not covered in documentation
  • Supports persistent browser sessions for authenticated user flows, structured data extraction with Pydantic schemas, and file operations for upload/download testing
  • Dashboard provides metrics across abstraction layers including overview health, performance efficiency, and error-adjusted signals separating infrastructure failures from agent failures

This approach enables comprehensive UX testing at scale, helping teams catch issues earlier and iterate faster on user experiences without the maintenance overhead of traditional automation tools.



Go to article

The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.

Related articles

Jul 14
2026
Accelerating software delivery with agentic QA automation using Amazon Nova Act – Part 2
Aug 11
2026
First Orion accelerates QA automation using Amazon Nova Act
Jul 21
2026
Amazon Connect Customer launches metrics for agent queues on analytics dashboards
Jun 26
2026
Amazon Connect Customer launches Agentic CX designer (NLX) in preview

The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.