Home icon

Introducing the Amazon Kinesis Data Streams Apache Spark Structured Streaming Connector for Amazon EMR

News

The article introduces the Amazon Kinesis Data Streams Apache Spark Structured Streaming Connector for Amazon EMR, which allows building real-time streaming applications and pipelines that consume Amazon Kinesis Data Streams using Apache Spark Structured Streaming.

Specifically, the article covers:

  • The new connector is pre-packaged on Amazon EMR 7.1 (EMR on EKS, EMR on EC2, and EMR Serverless)
  • It provides a faster, more scalable, and fault-tolerant way to consume Kinesis Data Streams compared to open-source alternatives
  • It supports Enhanced Fan-out consumption with dedicated read throughput
  • Users can now focus on building business logic using familiar Spark Data Source APIs
  • It is available in all AWS Regions where Amazon EMR is available
Go to article

The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.

Related articles

May 24
2024
Build Spark Structured Streaming applications with the open source connector for Amazon Kinesis Data Streams
Nov 22
2024
Amazon Managed Service for Apache Flink releases a new Amazon Kinesis Data Streams connector
Sep 10
2025
Build a streaming data mesh using Amazon Kinesis Data Streams
Jun 11
2025
Amazon DynamoDB Streams adds supports for Kinesis Client Library (KCL) 3.0

The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.