Overview
What this challenge is about.
Red-Team Evaluation of a Refusal Policy. Advanced challenge in research. Conducting rigorous research on real questions, earn a blockchain-verified credentia...
The Brief
What you'll do, and what you'll demonstrate.
Run a structured red-team eval across 6 harm categories with per-category quantitative and qualitative findings, and recommend ship/no-ship.
This is not a research exercise. It is the work a researcher does to produce findings that withstand scrutiny. That distinction matters to every hiring manager who has seen candidates summarize papers and none who have produced original findings under expert review.
When you finish, you will have something most graduates do not: a real-world deliverable, verified by Ewance, that you can show to a hiring manager and say "I did this. Here is the proof."
Earning criteria — what you'll demonstrate
- Design red-team prompts across multiple elicitation patterns
- Apply a multi-level scoring rubric with inter-rater reliability
- Detect regressions vs. a previous release
- Communicate safety findings to a release-decision review
Program Fit
Where this fits in your program.
Sharpens the same skills your degree expects you to demonstrate.
Aligned coursework coming soon.
Skills
Skills you'll demonstrate.
Each one shows up on your verified credential.
- Red Teaming
Apply red teaming to solve real industry problems and demonstrate production-level capability.
- Refusal Policy
Apply refusal policy to solve real industry problems and demonstrate production-level capability.
- Alignment Evaluation
Apply alignment evaluation to solve real industry problems and demonstrate production-level capability.
- Rubric Design
Apply rubric design to solve real industry problems and demonstrate production-level capability.
- Inter Rater Reliability
Apply inter rater reliability to solve real industry problems and demonstrate production-level capability.
- Responsible Ai
Apply responsible ai to solve real industry problems and demonstrate production-level capability.
Careers
Career paths this challenge builds toward
Completing this challenge demonstrates skills that transfer directly to these roles:
AI Safety Researcher
Running structured red-team evals across multiple harm categories is the day-one job of AI safety researchers at every frontier lab.
This challenge sharpens
- red-teaming
- alignment-evaluation
- refusal-policy
ML Researcher
Inter-rater methodology and regression analysis are core post-training research skills.
This challenge sharpens
- alignment-evaluation
- inter-rater-reliability
- rubric-design
Applied AI Scientist
Translating eval results into a defensible ship/no-ship recommendation is applied-AI-scientist judgement work in safety-sensitive deployments.
This challenge sharpens
- red-teaming
- responsible-ai
- alignment-evaluation