Design a Model-Monitoring Dashboard for an MLOps Platform
Overview
What this challenge is about.
You receive realistic 30-day metric streams for three production models (a classifier, a regressor, and a ranker) including prediction volume, latency p50/p95, accuracy or RMSE on labeled samples, and feature drift scores. Design and prototype a single-page dashboard answering four questions in order: is the model healthy now, what changed in the last 24h, is drift building, and where to drill in. Build the prototype in Streamlit or a similar low-friction stack. Deliverable is the design rationale, the prototype, and a redlined comparison to the current dashboard.
The Brief
What you'll do, and what you'll demonstrate.
Redesign the primary model-monitoring dashboard so the four core questions are answered in the order users actually ask them.
Earning criteria — what you'll demonstrate
- Apply visual-hierarchy principles to a dense operational dashboard
- Match chart type to data type for ML-specific metrics
- Design for the user's actual question order, not the data team's mental model
- Communicate redesign rationale defensibly to a product team
Program Fit
Where this fits in your program.
Sharpens the same skills your degree expects you to demonstrate.
Skills
Skills you'll demonstrate.
Each one shows up on your verified credential.
Careers
Roles this prepares you for.
Real titles. Real skill bridges. Pick the one closest to your trajectory.
AI Product Designer
Redesigning a dense ML-product dashboard with explicit rationale is the exact day-one work of an AI product designer at any MLOps or analytics platform.
This challenge sharpens
- dashboard-design
- visual-hierarchy
- chart-selection
AI Product Manager
Owning the four-question framing and the customer-test script is exactly how AI PMs scope product redesigns.
This challenge sharpens
- dashboard-design
- ml-metrics
- redline-design
MLOps Engineer
Understanding what makes a good monitoring surface translates into stronger MLOps platform engineering decisions.
This challenge sharpens
- ml-metrics
- streamlit
- dashboard-design