Overview
What this challenge is about.
Conduct a multi-site chest X-ray audit: compute AUROC, AUPRC, ECE, and per-site drift. Identify weak cells and propose mitigations. Earn a verifiable certificate.
The scenario
The hospital network (5 sites, around 1.2M chest-X-rays per year) requires per-site audit sign-off from the clinical-AI committee before any vendor rollout.
The Brief
What you'll do, and what you'll demonstrate.
Run a per-site, per-finding audit of a chest-X-ray classifier and produce a go/no-go deployment plan for each of 5 sites.
Earning criteria — what you'll demonstrate
- Apply rigorous multi-site evaluation to a clinical imaging classifier
- Detect input distribution drift across hospital sites
- Propose mitigations grounded in real per-site / per-finding evidence
- Communicate per-site deployment decisions to a clinical-AI committee
Program Fit
Where this fits in your program.
Sharpens the same skills your degree expects you to demonstrate.
Aligned coursework coming soon.
Skills
Skills you'll demonstrate.
Each one shows up on your verified credential.
- Medical Imaging
Apply medical imaging to solve real industry problems and demonstrate production-level capability.
- Classification
Apply classification to solve real industry problems and demonstrate production-level capability.
- Model Evaluation
Apply model evaluation to solve real industry problems and demonstrate production-level capability.
- Drift Detection
Apply drift detection to solve real industry problems and demonstrate production-level capability.
- Model Calibration
Apply model calibration to solve real industry problems and demonstrate production-level capability.
- Model Monitoring
Apply model monitoring to solve real industry problems and demonstrate production-level capability.
Careers
Career paths this challenge builds toward
Completing this challenge demonstrates skills that transfer directly to these roles:
AI Safety Researcher
Per-site clinical-imaging audits with per-finding evaluation and mitigation proposals are the AI-safety-researcher's signature deliverable at consultancies serving healthcare networks.
This challenge sharpens
- drift-detection
- model-monitoring
- model-calibration
MLOps Engineer
Per-site drift monitoring and recalibration plans are core MLOps work for any multi-site clinical-AI deployment.
This challenge sharpens
- drift-detection
- model-monitoring
- model-evaluation
Applied AI Scientist
Bridging per-site audit evidence to a committee-readable go/no-go plan is the applied-AI-scientist's daily craft in clinical AI consulting.
This challenge sharpens
- medical-imaging
- classification
- model-evaluation