Overview
What this challenge is about.
Design an LLM essay-feedback system for K-12, score 20 essays on a 4-dim rubric, and compare with human teachers. Get a verifiable certificate.
The scenario
The provider (anonymized, US-based, around 500 staff, around 1.4M students across 30 states) faces parent and teacher pressure to keep humans-in-the-loop on anything that touches a grade-of-record.
The Brief
What you'll do, and what you'll demonstrate.
Design a higher-order essay-feedback system with measurable inter-rater agreement and clear human-in-the-loop boundaries.
Earning criteria — what you'll demonstrate
- Design automated-assessment systems with explicit human-in-the-loop boundaries
- Compute inter-rater agreement (Cohen's kappa) correctly
- Translate pedagogy rubrics into LLM prompts
- Communicate AI-feedback limits to parents and teachers
Program Fit
Where this fits in your program.
Sharpens the same skills your degree expects you to demonstrate.
AI in Education and Learning Analytics
Master · Applied Ai
Strong alignment
This challenge maps to AI in Education and Learning Analytics at the Master level. It sharpens the same practical skills your coursework expects — but in a real industry context with actual constraints and deliverables.
Skills
Skills you'll demonstrate.
Each one shows up on your verified credential.
- Automated Assessment
Apply automated assessment to solve real industry problems and demonstrate production-level capability.
- Rubric Design
Apply rubric design to solve real industry problems and demonstrate production-level capability.
- Prompt Engineering
Apply prompt engineering to solve real industry problems and demonstrate production-level capability.
- Inter Rater Agreement
Apply inter rater agreement to solve real industry problems and demonstrate production-level capability.
- User Research
Conduct interviews, surveys, and usability tests to uncover actionable user insights.
- Evaluation Design
Apply evaluation design to solve real industry problems and demonstrate production-level capability.
Careers
Career paths this challenge builds toward
Completing this challenge demonstrates skills that transfer directly to these roles:
AI Product Designer
Designing automated-assessment UX with explicit human-in-the-loop boundaries is core to AI product design in regulated industries like K-12.
This challenge sharpens
- rubric-design
- user-research
- automated-assessment
AI Product Manager
Translating teacher pedagogy + parent transparency into product requirements is the AI PM craft at K-12 companies.
This challenge sharpens
- evaluation-design
- automated-assessment
- user-research