Home icon

How Razorpay achieved 11% performance improvement and 21% cost reduction with Amazon EMR

Big Data Blog

This article details how Razorpay, an Indian FinTech company, migrated to Amazon EMR and achieved significant performance and cost improvements in their data platform.

  • Migrated from third-party solution to Amazon EMR for batch, streaming, and interactive analytics
  • Achieved 11% performance improvement and 21% cost reduction
  • Processes 1PB+ daily data with 60+ concurrent streaming pipelines and 3,000+ workflows
  • Implemented medallion architecture on S3 with Delta Lake for ACID transactions
  • Used Debezium and Maxwell for CDC, Spark for compute, Airflow for orchestration
  • Optimized Spark resource allocation with explicit maxExecutors for predictable workloads
  • Configured YARN node labels to run drivers on On-Demand, tasks on Spot instances
  • Achieved 13-15% faster execution for large warehouse jobs
  • Supports 800 daily active users and 350,000 operational reports

Razorpay's migration demonstrates how EMR enables enterprise-scale data platforms with improved performance, cost efficiency, and operational flexibility without vendor lock-in.

Go to article

The AWS News Feed is currently looking for gold sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.

Related articles

Oct 9
2024
Amazon EMR on EC2 cost optimization: How a global financial services provider reduced costs by 30%
Mar 28
2024
How Amazon optimized its high-volume financial reconciliation process with Amazon EMR for higher scalability and performance
Mar 12
2024
How the GoDaddy data platform achieved over 60% cost reduction and 50% performance boost by adopting Amazon EMR Serverless
Jan 6
2026
Amazon EMR Serverless eliminates local storage provisioning, reducing data processing costs by up to 20%

The AWS News Feed is currently looking for silver sponsors. If you want to support the AWS community and reach a large audience of AWS professionals, consider sponsoring the AWS News Feed.