BLOG8 min read
Building a Cost-Efficient ETL Pipeline at Scale
How we reduced our Spark cluster costs by 73% while improving throughput
sparkcost-optimizationdelta-lakeetl
342,456
WRITE-UPS
Blogs, tutorials, news, and case studies from the community
FEATURED
Building a Cost-Efficient ETL Pipeline at Scale
How we reduced our Spark cluster costs by 73% while improving throughput
Sarah ChenFeb 10, 20262,456189
ANNOUNCEMENT4 min read
TUTORIAL12 min read
A Beginner's Guide to Change Data Capture with Debezium
Step-by-step tutorial for setting up CDC pipelines from PostgreSQL to Kafka
cdcdebeziumkafkapostgresstreaming
221,823
CASE STUDY6 min read
How We Won the $100 Budget Challenge
Processing 100M records for $12.47 using serverless Spark and aggressive partition pruning
cost-optimizationserverlesssparkcompetition
563,412
BLOG10 min read
Understanding Spark's Adaptive Query Execution
Deep dive into AQE internals and when it helps (and when it doesn't)
sparkaqeperformanceinternals
151,245