How Twilio secured their multi-engine query platform with AWS Lake Formation

This article describes how Twilio secured their multi-engine query platform using AWS Lake Formation for unified access control across multiple AWS accounts and query engines.

• Migrated to AWS Glue Data Catalog as managed metastore for enterprise data mesh architecture
• Implemented AWS Lake Formation Tag-Based Access Control (LF-TBAC) for fine-grained permissions
• Built Odin gateway with unified authentication layer supporting LDAP and future Okta integration
• Created custom authorization layer matching user tags with Lake Formation resource tags
• Automated data sharing workflows using Git, Terraform, and ServiceNow integration
• Reduced authorization overhead to 6-10 milliseconds through strategic caching and ALB target group separation
• Enabled self-service data access provisioning across multiple Lines of Business

Twilio successfully built a scalable governance framework supporting secure cross-account data sharing while maintaining compliance requirements through Lake Formation's tag-based access control and automated provisioning workflows.