AWS Glue Streaming now supports Kinesis Data Streams enhanced fan-out feature
News
This article discusses the AWS Glue Streaming ETL now supporting the Amazon Kinesis Data Streams (KDS) enhanced fan-out feature for Kinesis event sources. Enhanced fan-out allows scaling up the number of stream consumers by offering each consumer its own read throughput.
Specifically, the article covers:
- Enhanced fan-out provides each stream consumer with their own 2MB/second read throughput per shard
- AWS Glue streaming now supports Enhanced Fan-Out mode, enabling customers to scale effectively, enhance performance, and mitigate Kinesis throttling issues when multiple consumers subscribe to the stream
- The feature is available in all commercial AWS Regions where AWS Glue is available
- Conclusion: Enhanced fan-out support in AWS Glue Streaming helps customers scale and improve performance of Streaming ETL jobs
The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.
Related articles
The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.