Etl Pipelines
If you like applying Etl Pipelines, every challenge here gives you a chance to practice it on a real industry brief.
- AnalysisIntermediateNew
Halve a Daily Spark Bill Without Breaking the SLA
Work only from the materials in this file. Read the representative PySpark module (PULSE-JOB) and the cluster configuration (PULSE-CLUSTER) to understand how the nightly job is …
- Spark
- Cost Optimization
- Etl Pipelines
Open coursework - CodeIntermediateNew
Design a Change-Data-Capture Pipeline for an E-Commerce Reseller
Receive the MySQL schema (220 tables), 7 days of binlog samples, and the data team's freshness + correctness requirements. Design the CDC pipeline: Debezium for MySQL binlog cap…
- Change Data Capture
- Debezium
- Kafka
Big Data and Data-Intensive Systems - AnalysisIntermediateNew
Cost-Optimize a Large-Scale Spark Job for an Ad-Tech Platform
You receive the Spark job source (PySpark), the EMR cluster config, and 5 nights of job-history JSON. Profile the job with the Spark UI + EMR metrics, identify the top 3 cost dr…
- Spark Optimization
- Cloud Services
- Cost Engineering
Cloud Computing for Data and ML - CodeIntermediateNew
Build a Serverless ETL Pipeline for a Climate-Tech Sensor Fleet
Build the pipeline using managed services only (e.g., S3 + Lambda + EventBridge + Glue, or GCS + Cloud Functions + Cloud Scheduler + BigQuery external tables). Source the data f…
- Serverless Architecture
- Etl Pipelines
- Infrastructure As Code
Cloud Computing for Data and ML Practice your coursework on real scenarios.
Every challenge is shaped from real-world context — not generic exercises. The work mirrors what your degree prepares you for.
Why Ewance
- DesignIntermediateNew
Migrate a 200TB Data Lake from Parquet to Iceberg
Receive an inventory of the 200TB hot tier (around 1,200 tables, around 38 PB of historical data referenced), the current Spark + Trino read patterns, and 6 months of schema-cha…
- Iceberg
- Parquet
- Data Lake
Big Data and Data-Intensive Systems
How it works
From brief to credential, in six steps.
Step 01
Browse challenges aligned to your studies.
Step 02
Accept the one that fits your goals.
Step 03
Work through it with AI Copilot guidance.
Step 04
Submit for structured evaluation.
Step 05
Earn a verified credential.
Step 06
Add it to LinkedIn with one click.
Industry teams behind a decade of practitioner briefs
Hiring from this pool?
Sponsor a challenge and meet candidates through actual work.
Industry teams can shape briefs around the skills they hire for, then evaluate students on rubric-scored deliverables — not resumes.