
Ontraport reduced their data processing costs by 80% and storage costs by 92% by migrating from Amazon EMR to AWS Glue for ETL workloads, enabling efficient log processing at scale with minimal developer resources.


<div><p>This article describes how Ontraport, a CRM and automation service, reduced data processing costs by 80% by migrating from Amazon EMR to AWS Glue for their log processing ETL workloads.</p><ul><li>Ontraport processes 200+ million log records daily from multiple sources</li><li>Initial Amazon EMR setup required 16-node cluster; AWS Glue reduced complexity significantly</li><li>AWS Glue's DynamicFrame and crawlers simplified schema discovery and data transformation</li><li>Processing cost reduced from $500 to $100 per terabyte (80% savings)</li><li>Storage costs reduced by 92% through Parquet compression and partitioning</li><li>10 workers processed 500M records in under 60 minutes; 100 workers handled 10B records in 1 hour</li><li>Achieved results with only one full-time developer using serverless approach</li></ul><p>AWS Glue's serverless model and built-in data processing capabilities enabled Ontraport to optimize costs and accelerate development compared to managing EMR clusters.</p></div>


Related articles