Home icon

Efficiently verify Amazon S3 data at scale with compute checksum operation

Storage Blog



AWS has introduced a new compute checksum operation in Amazon S3 Batch Operations, enabling organizations to efficiently verify data integrity at scale without downloading entire datasets.

  • Users can generate checksums for billions of objects across different storage classes
  • Supports multiple checksum algorithms like SHA-1, SHA-256, MD5, CRC32, CRC32C, and CRC64NVME
  • Provides full-object and composite checksum calculation methods
  • Reduces operational complexity and costs of traditional data verification approaches
  • Integrates with Amazon Athena for detailed reporting and analysis

The feature allows organizations to confirm data integrity, maintain compliance, and validate content workflows directly in the storage layer, without incurring additional retrieval or processing costs.



Go to article

The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.

Related articles

Aug 18
2025
Amazon S3 introduces a new way to verify the content of stored datasets
Apr 23
2026
Amazon S3 now supports five additional checksum algorithms
Oct 13
2025
Accelerating Amazon S3 Batch Operations at scale with on-demand manifest generation
Jan 23
2026
Applying Amazon S3 Object Lock at scale for petabytes of existing data

The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.