Reduce your compute costs for stream processing applications with Kinesis Client Library 3.0
Big Data Blog
This article discusses Kinesis Client Library (KCL) 3.0, which allows you to reduce compute costs for stream processing applications with Kinesis Data Streams by up to 33%.
Specifically, the article covers:
- Load balancing challenges in stream processing with previous KCL versions, leading to uneven worker utilization and higher costs
- New load balancing algorithm in KCL 3.0 that monitors worker CPU utilization and rebalances load for even utilization
- Other benefits like reduced DynamoDB read capacity costs, graceful shard handoff, and removing AWS SDK for Java 1.x dependency
- Steps to migrate from KCL 2.x to 3.0 with no code changes
- Checklist of key considerations when using KCL 3.0
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
Nov 6
2024
2024
New Kinesis Client Library 3.0 reduces stream processing compute costs by up to 33%
Jun 3
2024
2024
Optimize write throughput for Amazon Kinesis Data Streams
Jun 11
2025
2025
Amazon DynamoDB Streams adds supports for Kinesis Client Library (KCL) 3.0
Jan 17
2023
2023
Build highly available streams with Amazon Kinesis Data Streams
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.