How Twilio built a multi-engine query platform using Amazon Athena and open-source Presto
Big Data Blog
Twilio developed Odin, a multi-engine query platform that combines Amazon Athena and open-source Presto to address scalability, operational, and cost management challenges in their data infrastructure.
- Platform serves 1,500 users, processing 2.5 million queries monthly across 20 petabytes of data
- Uses Zuul-based gateway to route queries across multiple engines with intelligent routing
- Implemented query hint mechanism allowing users to specify query destination
- Utilizes AWS services like ElastiCache, DynamoDB, and Glue Data Catalog
- Supports both provisioned capacity and on-demand Athena workgroups
The solution provides a flexible, scalable data querying platform that can adapt to evolving technological needs while maintaining a seamless user experience.
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
2026
2024
2025
2025
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.