Design a Voice-First Interaction for a Hands-Free Warehouse App
Overview
What this challenge is about.
Spend half a day shadowing pickers at a partner warehouse (NDA pre-signed). Map the picking workflow and identify the 8 highest-frequency interactions that should go voice-first. Design wake-word + command grammar with explicit error-recovery (mis-hearing, ambient noise, multi-language pickers). Prototype with the Web Speech API or Whisper.cpp on a tablet. Run a 1-hour contextual inquiry with 4 pickers in the real warehouse environment, measuring time-per-pick before and after. Deliver the interaction spec, the prototype, the contextual-inquiry report, and a speed-up estimate.
The Brief
What you'll do, and what you'll demonstrate.
Design and prototype a voice-first picking interaction model that measurably beats touch in a real warehouse environment.
Earning criteria — what you'll demonstrate
- Apply user-centered design to a hands-busy, noisy real-world context
- Design voice-UI grammar with explicit error-recovery paths
- Run contextual inquiry in a workplace setting with ethical observation practices
- Measure interaction performance with comparable before/after methodology
Program Fit
Where this fits in your program.
Sharpens the same skills your degree expects you to demonstrate.
Skills
Skills you'll demonstrate.
Each one shows up on your verified credential.
Careers
Roles this prepares you for.
Real titles. Real skill bridges. Pick the one closest to your trajectory.
Product Manager
Product managers who run contextual inquiry in real workplace contexts ship features that don't quietly die in the next quarter's usage data.
This challenge sharpens
- contextual-inquiry
- user-research
- user-centered-design