Overview
What this challenge is about.
Quantify covariate shift and concept drift in a climate-risk model, then deliver a notebook and actuarial memo for a verifiable certificate.
The scenario
The broker (around 600 staff, GBP 4B in placed premium per year) is preparing a 2027 portfolio review for its Bermuda-based capital providers; misjudging climate-shift risk would be a career-defining error for the chief actuary.
The Brief
What you'll do, and what you'll demonstrate.
Quantify covariate, prior, and concept drift on a 2010-2020-trained climate-risk model against 2021-2024 data and recommend retrain or rebuild.
Earning criteria — what you'll demonstrate
- Distinguish covariate, prior, and concept drift quantitatively
- Apply standard distribution-shift tests (KS, energy distance, MMD)
- Slice shift findings by region and feature group
- Communicate technical shift findings to a chief actuary
Program Fit
Where this fits in your program.
Sharpens the same skills your degree expects you to demonstrate.
Aligned coursework coming soon.
Skills
Skills you'll demonstrate.
Each one shows up on your verified credential.
- Distribution Shift
Apply distribution shift to solve real industry problems and demonstrate production-level capability.
- Covariate Shift
Apply covariate shift to solve real industry problems and demonstrate production-level capability.
- Concept Drift
Apply concept drift to solve real industry problems and demonstrate production-level capability.
- Model Monitoring
Apply model monitoring to solve real industry problems and demonstrate production-level capability.
- Python
Write clean, efficient Python for data processing, automation, and backend services.
- Actuarial Analysis
Apply actuarial analysis to solve real industry problems and demonstrate production-level capability.
Careers
Career paths this challenge builds toward
Completing this challenge demonstrates skills that transfer directly to these roles:
Research Scientist
Quantifying distribution shift with rigorous statistical tests on a high-stakes actuarial model is the kind of work junior research scientists own at climate-risk shops.
This challenge sharpens
- distribution-shift
- covariate-shift
- concept-drift
AI Safety Researcher
Documenting drift evidence for a high-impact retrain-or-rebuild decision is exactly the AI safety researcher's contribution to safety-critical ML.
This challenge sharpens
- distribution-shift
- model-monitoring
- concept-drift
Data Scientist
Sliced shift analysis with actuarial-grade communication is a senior data-scientist responsibility in financial-services ML.
This challenge sharpens
- distribution-shift
- actuarial-analysis
- model-monitoring