Plan Inventory Replenishment as an MDP for an E-Commerce AI Startup
Overview
What this challenge is about.
Plan Inventory Replenishment as an MDP for an E-Commerce AI Startup. Advanced challenge in code. Writing production code that solves real engineering problem...
The Brief
What you'll do, and what you'll demonstrate.
Formulate and solve a single-SKU replenishment MDP and beat the current reorder-point heuristic in simulation across the 50 SKUs.
This is not a coding exercise. It is the work a software engineer does between a Jira ticket and a merged PR. That distinction matters to every hiring manager who has seen candidates solve LeetCode problems and none who have shipped production code under real constraints.
When you finish, you will have something most graduates do not: a real-world deliverable, verified by Ewance, that you can show to a hiring manager and say "I did this. Here is the proof."
Earning criteria — what you'll demonstrate
- Translate a business problem into a well-defined MDP
- Implement value iteration and verify convergence properties
- Build a fair simulation harness on historical demand
- Communicate the limits of the model (single SKU, stationary demand)
Program Fit
Where this fits in your program.
Sharpens the same skills your degree expects you to demonstrate.
Aligned coursework coming soon.
Skills
Skills you'll demonstrate.
Each one shows up on your verified credential.
- Mdp Modeling
Apply mdp modeling to solve real industry problems and demonstrate production-level capability.
- Value Iteration
Apply value iteration to solve real industry problems and demonstrate production-level capability.
- Dynamic Programming
Apply dynamic programming to solve real industry problems and demonstrate production-level capability.
- Simulation
Apply simulation to solve real industry problems and demonstrate production-level capability.
- Python
Write clean, efficient Python for data processing, automation, and backend services.
- Policy Evaluation
Apply policy evaluation to solve real industry problems and demonstrate production-level capability.
Careers
Career paths this challenge builds toward
Completing this challenge demonstrates skills that transfer directly to these roles:
Applied AI Scientist
Formulating a business problem as an MDP and benchmarking against the incumbent heuristic is the textbook first quarter for an applied AI scientist on an optimization team.
This challenge sharpens
- mdp-modeling
- value-iteration
- policy-evaluation
ML Researcher
Clean MDP formulations are the entry point for any RL or sequential-decision research role.
This challenge sharpens
- mdp-modeling
- dynamic-programming
- policy-evaluation
Data Scientist
Simulation-based policy comparison on historical data is core operations-research-flavored data science work.
This challenge sharpens
- simulation
- policy-evaluation
- python