Overview
What this challenge is about.
You receive: 90 days of API logs (request volume, token distributions), the customer's golden eval set of 200 prompts, the incumbent and new pricing schedules, and quality ratings on 50 prompts from both models. Build a 12-month cost projection under 3 scenarios (full migration / hybrid / no migration). Run a paired-prompt quality comparison with bootstrap CIs. Recommend a path with explicit risks. Deliver a 4-page memo + reproducible cost spreadsheet.
The Brief
What you'll do, and what you'll demonstrate.
Decide whether to migrate to the new foundation-model API tier given cost, quality, and migration-risk constraints.
Earning criteria — what you'll demonstrate
- Model AI inference costs across scenarios
- Run paired statistical comparisons of model quality
- Reason about migration risks specific to foundation-model APIs
- Communicate cost-quality trade-offs to a CFO
Program Fit
Where this fits in your program.
Sharpens the same skills your degree expects you to demonstrate.
Skills
Skills you'll demonstrate.
Each one shows up on your verified credential.
Careers
Roles this prepares you for.
Real titles. Real skill bridges. Pick the one closest to your trajectory.
AI Engineer
Cost + quality migration analysis is the AI-engineer project that shows business judgment beyond pure model work.
This challenge sharpens
- cost-modeling
- model-evaluation
- ai-strategy
AI Product Manager
Translating model choice into a CFO-facing decision is the AI PM skill at production-AI companies.
This challenge sharpens
- ai-strategy
- vendor-evaluation
- financial-modeling