Introducing open source Bulk Executor for Amazon DynamoDB

This article introduces the open source Bulk Executor for Amazon DynamoDB, a command-line utility that simplifies bulk operations on DynamoDB tables using AWS Glue as the backend.

• Perform bulk tasks like count, find, delete, update, copy, and fill without writing custom code
• Supports advanced filtering with Spark SQL syntax and parallel execution across hundreds of machines
• Built-in commands include finding items by criteria, counting records, deleting old items, copying tables across regions/accounts, and loading data from S3
• Provides cost estimates before execution and rate limiting to prevent throttling and competition with organic traffic
• Installation via bootstrap command creates AWS Glue job, IAM role, S3 bucket, and CloudWatch Logs automatically
• Extensible architecture allows users to write custom Python functions for specialized bulk operations

Bulk Executor eliminates undifferentiated heavy lifting by handling DynamoDB segmented scans, Spark parallelization, and distributed rate limiting while providing a simple local command-line experience.