Amazon Kinesis Data Streams now supports 10x larger record sizes: Simplifying real-time data processing
Big Data Blog
Amazon Kinesis Data Streams now supports record sizes up to 10MiB, a significant increase from the previous 1MiB limit. This enhancement simplifies data processing across various industries and use cases.
- Eliminates need to split large records or store them separately
- Beneficial for IoT analytics, change data capture, and AI/ML workloads
- Can update maximum record size through AWS Console, CLI, or SDKs
- Maintains existing Kinesis Data Streams API functionality
- Shard throughput limits remain unchanged
Best practices include maintaining large records at 1-2% of total record count, using a uniform partition key strategy, and ensuring downstream applications can handle larger records.
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
2025
2025
2025
2024
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.