Benchmarking Amazon Nova and GPT-4o models with FloTorch
Machine Learning Blog
FloTorch conducted a comprehensive benchmark comparing Amazon Nova models with OpenAI's GPT-4o models using the CRAG dataset, focusing on latency, accuracy, and cost across five diverse topics.
- Amazon Nova Pro was 97% faster and 65.26% more cost-effective than GPT-4o
- GPT-4o showed a slight 1.5% accuracy advantage over Amazon Nova Pro
- Amazon Nova Micro and Lite outperformed GPT-4o-mini by 2-4 percentage points in accuracy
- Amazon Nova Micro and Lite were 10-56% cheaper than GPT-4o-mini
- Amazon Nova models demonstrated 20-48% faster response times
The study suggests that Amazon Nova models offer comparable or superior performance to GPT-4o models, particularly in terms of cost and speed, making them attractive for enterprise AI applications.
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
2025
2025
2024
2025
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.