Building an AI gateway to Amazon Bedrock with Amazon API Gateway

This article presents a reference architecture for building an AI gateway to Amazon Bedrock using Amazon API Gateway, developed by Dynatrace for enterprise-scale access control.

• API Gateway serves as entry point with authorization, throttling, and lifecycle management
• Lambda authorizer handles request authorization including JWT token validation
• Lambda integration function signs requests and routes them to Bedrock endpoints
• Architecture supports streaming responses using new API Gateway response streaming
• Deployment via CloudFormation with optional private endpoint configuration
• Supports authorization, quota management, tenant isolation, and cost control
• Enhancement options include rate limiting, WAF integration, caching, and content filtering
• Complete solution code available on GitHub with testing examples provided

The pattern enables enterprises to govern foundation model usage transparently while maintaining compatibility with standard AWS SDKs like Boto3.