Reservoir Sampling for a Privacy-Preserving Telemetry Pipeline
Overview
What this challenge is about.
Implement Vitter’s Algorithm R in Rust for reservoir sampling from an 18B-event stream, then earn a verifiable certificate.
The scenario
The company (around USD 22M ARR, open-core licensing) is privacy-first by reputation — sampling must be defensibly unbiased so analytics conclusions hold up under public scrutiny.
The Brief
What you'll do, and what you'll demonstrate.
Build a reservoir-sampling pipeline that produces a uniform 0.5 percent sample from an 18B-event/day stream with per-key stratification and provable uniformity.
Earning criteria — what you'll demonstrate
- Implement Vitter's Algorithm R and reason about its uniformity guarantee
- Apply A-Res (Efraimidis-Spirakis) for weighted/stratified reservoir sampling
- Verify sampling uniformity with chi-square goodness-of-fit
- Engineer a streaming sampler that respects backpressure and memory bounds
Program Fit
Where this fits in your program.
Sharpens the same skills your degree expects you to demonstrate.
Aligned coursework coming soon.
Skills
Skills you'll demonstrate.
Each one shows up on your verified credential.
- Reservoir Sampling
Apply reservoir sampling to solve real industry problems and demonstrate production-level capability.
- Randomized Algorithms
Apply randomized algorithms to solve real industry problems and demonstrate production-level capability.
- Streaming Systems
Apply streaming systems to solve real industry problems and demonstrate production-level capability.
- Rust Programming
Apply rust programming to solve real industry problems and demonstrate production-level capability.
- Statistical Testing
Apply statistical testing to solve real industry problems and demonstrate production-level capability.
- Data Privacy
Apply data privacy to solve real industry problems and demonstrate production-level capability.
Careers
Career paths this challenge builds toward
Completing this challenge demonstrates skills that transfer directly to these roles: