Overview
What this challenge is about.
You receive a packet: original training data sample, post-launch production logs, three Slack-style threads from the on-call rotation, and a summary of the telco's complaints. Reconstruct the deployment timeline. Run a blameless root-cause analysis across data (label shift? leakage?), model (calibration drift? distribution drift?), and process (testing gap? hand-off gap?). Produce a 5-page post-mortem with three concrete corrective actions, each with an owner, due date proposal, and expected impact. Present in a 25-minute readout to engineering + business stakeholders.
The Brief
What you'll do, and what you'll demonstrate.
Run a blameless post-mortem on a failed ML deployment and recommend three corrective actions that will land with both engineering and the business sponsor.
Earning criteria — what you'll demonstrate
- Run a blameless post-mortem across data, model, and process axes
- Reconstruct an ML deployment timeline from heterogeneous artifacts
- Recommend corrective actions that survive both engineering and business scrutiny
- Present ML failures to mixed audiences without losing either side
Program Fit
Where this fits in your program.
Sharpens the same skills your degree expects you to demonstrate.
Skills
Skills you'll demonstrate.
Each one shows up on your verified credential.
Careers
Roles this prepares you for.
Real titles. Real skill bridges. Pick the one closest to your trajectory.
AI Solutions Architect
Running mixed-audience post-mortems on failed deployments is one of the most senior solutions-architect competencies and is exactly what consultancies hire for.
This challenge sharpens
- root-cause-analysis
- stakeholder-framing
- deployment
MLOps Engineer
Reconstructing a failure timeline from logs and proposing monitoring/process fixes is core MLOps incident-response work.
This challenge sharpens
- model-monitoring
- ml-pipelines
- deployment
AI Product Manager
Owning a corrective-action plan that engineering and the business sponsor both sign off on is the AI-PM's post-incident job.
This challenge sharpens
- stakeholder-framing
- case-study-analysis
- root-cause-analysis