Design a nightly batch ETL that ingests raw JSON logs from object storage, transforms them with Apache Spark, and loads curated tables into a warehouse. Jobs must be idempotent, observable, and recoverable after partial failure.
DrawCode Practice Problem
Design a Batch ETL Pipeline (Spark)
Interactive Visualizer Workspace
Explore step-by-step interactive animations, memory state tracking, and live multi-language execution in DrawCode.
Launch Interactive Visualizer