Scaling a Sydney D2C Cosmetics Startup's Data Pipeline
Overview
What this challenge is about.
Design a cloud data pipeline for a D2C cosmetics brand, process real-time events with Spark, and earn a verifiable certificate.
The scenario
GlowUp is a Sydney-based D2C cosmetics startup with 500K monthly active users, selling organic skincare products. They currently use a single MySQL database and manual ETL scripts.
The Brief
What you'll do, and what you'll demonstrate.
Design a scalable, real-time data pipeline using cloud and big data technologies to replace the failing batch system.
Earning criteria — what you'll demonstrate
- Apply cloud computing concepts to design a scalable data pipeline
- Use Apache Spark or similar for distributed data processing
- Select appropriate NoSQL database for real-time analytics
- Evaluate cost-performance trade-offs in cloud architectures
Program Fit
Where this fits in your program.
Sharpens the same skills your degree expects you to demonstrate.
Aligned coursework coming soon.
Skills
Skills you'll demonstrate.
Each one shows up on your verified credential.
- Cloud Computing
Design and deploy scalable applications using cloud platforms and services.
- Apache Spark
Apply apache spark to solve real industry problems and demonstrate production-level capability.
- Nosql
Apply nosql to solve real industry problems and demonstrate production-level capability.
- Data Pipeline
Apply data pipeline to solve real industry problems and demonstrate production-level capability.
- Cost Analysis
Apply cost analysis to solve real industry problems and demonstrate production-level capability.
Careers
Career paths this challenge builds toward
Completing this challenge demonstrates skills that transfer directly to these roles: