Overview
What this challenge is about.
Track embedding drift across 12 weeks of RAG data with UMAP, detect shifting clusters, and list top-20 moved documents. Get a verifiable certificate.
The scenario
The startup (around 28 staff, post-Series-A, two enterprise customers in production) has staked its enterprise positioning on transparent, auditable model behavior; the risk-function approval is a precondition for go-live.
The Brief
What you'll do, and what you'll demonstrate.
Build a weekly embedding-drift visualization that risk-grade users trust enough to approve a rollout.
Earning criteria — what you'll demonstrate
- Project high-dim embeddings consistently across snapshots
- Detect and visualize cluster-level change over time
- Communicate model behavior to a risk-function audience
- Build notebook-grade tools the rest of the team actually uses
Program Fit
Where this fits in your program.
Sharpens the same skills your degree expects you to demonstrate.
Aligned coursework coming soon.
Skills
Skills you'll demonstrate.
Each one shows up on your verified credential.
- Embeddings
Apply embeddings to solve real industry problems and demonstrate production-level capability.
- Dimensionality Reduction
Apply dimensionality reduction to solve real industry problems and demonstrate production-level capability.
- Umap
Apply umap to solve real industry problems and demonstrate production-level capability.
- Interactive Visualization
Apply interactive visualization to solve real industry problems and demonstrate production-level capability.
- Python
Write clean, efficient Python for data processing, automation, and backend services.
- Drift Detection
Apply drift detection to solve real industry problems and demonstrate production-level capability.
Careers
Career paths this challenge builds toward
Completing this challenge demonstrates skills that transfer directly to these roles:
AI Engineer
Owning observability tools for retrieval and embedding systems is a core AI engineer specialization at enterprise-AI startups.
This challenge sharpens
- embeddings
- drift-detection
- python
AI Safety Researcher
Designing tools that let risk reviewers audit model behavior is exactly the kind of work AI safety researchers do for enterprise rollouts.
This challenge sharpens
- drift-detection
- interactive-visualization
- embeddings
Data Scientist
Tracking cluster-level change in a 50k-doc corpus over time is the kind of exploratory analytical work data scientists own.
This challenge sharpens
- dimensionality-reduction
- umap
- interactive-visualization