Home icon

Reduce your compute costs for stream processing applications with Kinesis Client Library 3.0

Big Data Blog

This article discusses Kinesis Client Library (KCL) 3.0, which allows you to reduce compute costs for stream processing applications with Kinesis Data Streams by up to 33%.

Specifically, the article covers:

  • Load balancing challenges in stream processing with previous KCL versions, leading to uneven worker utilization and higher costs
  • New load balancing algorithm in KCL 3.0 that monitors worker CPU utilization and rebalances load for even utilization
  • Other benefits like reduced DynamoDB read capacity costs, graceful shard handoff, and removing AWS SDK for Java 1.x dependency
  • Steps to migrate from KCL 2.x to 3.0 with no code changes
  • Checklist of key considerations when using KCL 3.0
Go to article

The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.

Related articles

Nov 6
2024
New Kinesis Client Library 3.0 reduces stream processing compute costs by up to 33%
Nov 20
2024
Amazon Kinesis Data Streams On-Demand mode supports streams writing up to 10GB/s
Nov 11
2024
Amazon Kinesis Data Streams launches CloudFormation support for resource policies
Nov 22
2024
Amazon Managed Service for Apache Flink releases a new Amazon Kinesis Data Streams connector

The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.