Overview
What this challenge is about.
Train a temporal model on driving video clips to classify lane-change intent, then profile latency and build a confusion matrix. End with a verifiable certificate.
The scenario
The Stuttgart startup (~80 engineers, post-Series-B, supplying perception software to two Tier-1 automotive customers) is under pressure to ship a calibrated intent classifier this quarter; the current rule-based predictor over-triggers on highway merges.
The Brief
What you'll do, and what you'll demonstrate.
Train a temporal vision model that classifies neighboring-vehicle lane-change intent from dashcam video and characterize its real-world failure modes for the perception team.
Earning criteria — what you'll demonstrate
- Apply temporal vision models (VideoMAE, TimeSformer, or CNN+GRU) to a short-clip classification task
- Use a cross-city train/test split to measure real-world generalization
- Profile a model for on-device latency and reason about deployment trade-offs
- Communicate a model's failure modes honestly to a downstream consumer team
Program Fit
Where this fits in your program.
Sharpens the same skills your degree expects you to demonstrate.
Visual Intelligence and Visual Reasoning
Master · Computer Vision
Strong alignment
This challenge maps to Visual Intelligence and Visual Reasoning at the Master level. It sharpens the same practical skills your coursework expects — but in a real industry context with actual constraints and deliverables.
Skills
Skills you'll demonstrate.
Each one shows up on your verified credential.
- Video Understanding
Apply video understanding to solve real industry problems and demonstrate production-level capability.
- Temporal Modeling
Apply temporal modeling to solve real industry problems and demonstrate production-level capability.
- Model Evaluation
Apply model evaluation to solve real industry problems and demonstrate production-level capability.
- Generalization
Apply generalization to solve real industry problems and demonstrate production-level capability.
- Pytorch
Apply pytorch to solve real industry problems and demonstrate production-level capability.
- Perception
Apply perception to solve real industry problems and demonstrate production-level capability.
Careers
Career paths this challenge builds toward
Completing this challenge demonstrates skills that transfer directly to these roles:
Computer Vision Engineer
Shipping a temporal vision model with city-split evaluation and a deployment-aware latency profile is exactly the day-one task of a CV engineer on a perception team.
This challenge sharpens
- video-understanding
- temporal-modeling
- perception
Machine Learning Engineer
Training a model at two sizes, profiling latency, and writing an integration note for a consumer team mirrors MLE work in any production CV stack.
This challenge sharpens
- model-evaluation
- pytorch
- temporal-modeling
Applied AI Scientist
Building a defensible generalization story (cross-city split, sliced failure modes) and translating it into a threshold recommendation is the texture of applied-AI-scientist work in autonomous vehicles.
This challenge sharpens
- generalization
- model-evaluation
- video-understanding