Home icon

AWS Lambda now supports queues for Apache Kafka in self-managed Kafka event sources

News



AWS Lambda now supports queues for Apache Kafka in self-managed Kafka event source mappings, enabling higher parallelism and throughput for event-driven workloads.

  • Scale processing beyond partition count using Kafka share groups (Apache Kafka 4.2+)
  • Multiple event pollers consume concurrently from same partition, each supporting up to 10 concurrent invocations
  • Ideal for workloads like image/video encoding, fraud detection, and telemetry ingestion that prioritize speed over ordering
  • Decouples parallelism from partition count with no producer or topic configuration changes
  • Improves resilience by preventing slow/failed events from blocking others in same partition
  • Available in all AWS commercial regions where self-managed Kafka ESM is supported

Queue mode enables higher throughput during traffic spikes and more resilient processing for Kafka workloads that don't require strict partition ordering.



Go to article

The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.

Related articles

Oct 9
2026
AWS Lambda supports OAuth authentication for self-managed Apache Kafka event sources
Jul 17
2025
AWS Lambda announces low latency processing for Kafka events
Nov 24
2025
AWS Lambda announces enhanced error handling capabilities for Kafka event processing
Jun 20
2025
AWS Lambda announces native support for Avro and Protobuf formatted Kafka events

The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.