Amazon Bedrock tokenomics data lake
Machine Learning Blog
This article describes a centralized observability data lake for Amazon Bedrock invocations that aggregates logs across accounts to provide visibility into prompts, responses, token usage, and per-invocation costs.
- Centralizes Amazon Bedrock invocation logs from multiple accounts into a queryable data lake using CloudWatch, Lambda, Firehose, and Athena
- Captures per-invocation data including prompts, responses, token counts, models used, IAM identities, and stop reasons
- Enables debugging, token efficiency measurement, prompt engineering optimization, and cross-team usage governance
- Supports cost attribution by joining invocation data with AWS Cost and Usage Reports
- Deployed via CloudFormation templates across central and linked accounts with built-in KMS encryption and IAM access controls
- Includes optional AWS QuickSight dashboard for visualizing token consumption over time
The data lake provides the granular visibility needed to implement tokenomics practices and optimize AI token consumption across organizations.
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.