Overview
What this challenge is about.
Train offline RL on 9 robot-arm tasks, evaluate zero-shot and few-shot success on 3 held-out tasks, and earn your verifiable certificate.
The scenario
The consultancy (around 40 staff, around USD 6M annual revenue) competes on time-to-first-pick on new client floors; a successful offline-RL skill pre-train would shave weeks off each engagement.
The Brief
What you'll do, and what you'll demonstrate.
Train an offline RL policy on logged trajectories that lifts zero-shot and few-shot performance on held-out tasks vs. a BC baseline.
Earning criteria — what you'll demonstrate
- Apply a modern offline RL algorithm (CQL or IQL) on real logged data
- Design a held-out task split for skill-reuse evaluation
- Compare offline RL to imitation baselines fairly
- Communicate offline-RL value to a consultancy's solutions team
Program Fit
Where this fits in your program.
Sharpens the same skills your degree expects you to demonstrate.
Robot Learning
Master · Applied Ai
Strong alignment
This challenge maps to Robot Learning at the Master level. It sharpens the same practical skills your coursework expects — but in a real industry context with actual constraints and deliverables.
Skills
Skills you'll demonstrate.
Each one shows up on your verified credential.
- Offline Rl
Apply offline rl to solve real industry problems and demonstrate production-level capability.
- Conservative Q Learning
Apply conservative q learning to solve real industry problems and demonstrate production-level capability.
- Skill Reuse
Apply skill reuse to solve real industry problems and demonstrate production-level capability.
- Imitation Learning
Apply imitation learning to solve real industry problems and demonstrate production-level capability.
- Policy Evaluation
Apply policy evaluation to solve real industry problems and demonstrate production-level capability.
- Pytorch
Apply pytorch to solve real industry problems and demonstrate production-level capability.
Careers
Career paths this challenge builds toward
Completing this challenge demonstrates skills that transfer directly to these roles:
Applied AI Scientist
Translating logged operational data into a usable offline-RL skill pre-train is the daily work of applied AI scientists in industrial robotics.
This challenge sharpens
- offline-rl
- skill-reuse
- policy-evaluation
ML Researcher
Designing held-out task splits and comparing offline RL to imitation baselines is research-engineering work that opens doors at robot-learning teams.
This challenge sharpens
- offline-rl
- conservative-q-learning
- imitation-learning
Machine Learning Engineer
Wiring d3rlpy + simulator + eval harness into a reusable consultancy tool is core MLE work in industrial AI.
This challenge sharpens
- pytorch
- offline-rl
- policy-evaluation