Home icon

How Seltz cut data costs 40% with Amazon S3 Tables

Storage Blog



This article describes how Seltz, an AI search engine company, achieved 40% cost savings by adopting Amazon S3 Tables for its knowledge pipeline that processes billions of documents through enrichment stages.

  • S3 Tables provide fully managed Apache Iceberg tables with automatic compaction, snapshot management, and file cleanup
  • Seltz's pipeline uses multiple enrichment stages (text extraction, quality scoring, deduplication, vectorization) that write millions of small files requiring compaction
  • Managed lifecycle eliminates operational overhead of building custom maintenance pipelines with Spark or AWS Glue
  • Atomic commits and time-ordered IDs enable incremental processing where only affected downstream stages reprocess data
  • Amazon Athena and DuckDB provide ad-hoc SQL access for debugging and monitoring without additional ETL
  • Step-by-step walkthrough covers creating table buckets, writing data with PyIceberg, querying with Athena, and reading programmatically

S3 Tables eliminate engineering complexity for managing Iceberg tables at scale while preserving open format flexibility and enabling observable pipelines.



Go to article

The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.

Related articles

Oct 6
2026
Cost-effective ETL with DuckDB and Amazon S3 Tables on AWS Glue
Jul 15
2025
Amazon S3 Tables reduce compaction costs by up to 90%
Sep 21
2026
How Comcast scaled analytics 80x while cutting costs 38% with GraphQL and Amazon S3 Tables
Sep 30
2026
Amazon S3 Tables now support all Apache Iceberg V3 data types

The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.