A/B Testing
If you like applying A/B Testing, every challenge here gives you a chance to practice it on a real industry brief.
- CodeIntermediateNew
Build a Canary Rollout for a Production Recommender
Pick a serving stack (Triton, Seldon Core, KServe, or BentoML). Implement two-model traffic splitting with a configurable percentage (start at 5%). Wire up online metric collect…
- Canary Deployment
- Kubernetes Orchestration
- A/B Testing
ML Engineering and Production ML - DesignIntermediateNew
Design an Adaptive UI for a Streaming-Platform Recommender
Design 3 adaptive layout variants triggered by session-intent signals (time of day, last-3-session pattern, device class) — without retraining the recommender. Build a high-fide…
- Adaptive Interfaces
- Interaction Design
- A/B Testing
Advanced Human-Computer Interaction - CodeIntermediateNew
Build a Hybrid Recommendation System for an Indie Streaming Catalog
Use the provided 6-month anonymized event log (around 320M play events, 1.4M unique users in the held-out cohort), audio embeddings (256-d), and track metadata. Implement (1) an…
- Recommendation Systems
- Collaborative Filtering
- Content Based Recommendation
Data Mining and Information Retrieval - CodeIntermediateNew
Build a Hybrid Recommender for a Niche Consumer-AI Music App
You receive listening events (around 240 million plays) plus a content embedding per track (audio + curator tags). Build a collaborative filtering model (ALS or implicit-feedbac…
- Recommender Systems
- Collaborative Filtering
- Content Based Filtering
Data Mining and Knowledge Discovery Practice your coursework on real scenarios.
Every challenge is shaped from real-world context — not generic exercises. The work mirrors what your degree prepares you for.
Why Ewance
- AnalysisIntermediateNew
Frequent-Itemset Mining on a Grocery Retailer's Basket History
Load 18 months of basket-level transaction data (Parquet, around 92 GB) into a Spark cluster. Run FP-growth at support thresholds tuned per category (food vs household vs fresh)…
- Frequent Itemset Mining
- Fp Growth
- Apache Spark
Data Mining and Information Retrieval - StrategyBeginnerNew
Nudge Strategy for a Bangalore D2C Cosmetics Brand
You are a behavioral economics consultant hired by Glow Naturals. Analyze their current checkout process (provided in a mockup) and identify cognitive biases causing friction. P…
- Nudge Design
- Choice Architecture
- A/B Testing
Behavioral Economics - AnalysisSeniorNew
Cost-Quality Prompt Optimization at Scale
You receive 2,000 labeled code snippets (human rater consensus score 1-5) and budget for at most 8,000 API calls across the optimization run. Run a factorial sweep of 3 prompt s…
- Prompt Optimization
- Cost Quality Tradeoff
- Experimental Design
Prompt Engineering - AnalysisIntermediateNew
MCMC for Conversion-Funnel A/B Testing at a Marketplace
You receive 6 weeks of per-visitor funnel data (visit, sign-up, trial start, trial-to-paid conversion) split by variant and by acquisition channel (organic, paid social, paid se…
- Mcmc
- Bayesian Hierarchical Models
- A/B Testing
Probabilistic Machine Learning - Browse challenges
Explore role
Product Manager
Ship product that solves real user problems. Combine user research, prototyping, and stakeholder alignment to turn ambiguous briefs into measurable wins — the role at the centre of modern software teams.
- AnalysisBeginnerNew
Run an A/B Test on Two System Prompts for a Sales Email Assistant
You will (1) design the A/B test (random assignment by rep_id, 50/50 split, 2-week duration), (2) instrument three primary metrics: reply rate (event-based), average tokens per …
- Prompt Evaluation
- A/B Testing
- Metric Design
LLM Application Development - AnalysisFoundationalNew
Optimize Ad Spend for Munich D2C Cosmetics Brand
You are given a CSV dataset with 10,000 rows of ad performance data including date, campaign, audience segment, creative type, impressions, clicks, conversions, and spend. Your …
- A/B Testing
- Regression Analysis
- Data Cleaning
Marketing Analytics - DesignBeginnerNew
A/B-Test a Recommender Improvement Without Breaking Trust
You receive offline-evaluation results for both the production and candidate models plus aggregate metrics from the last 12 weeks (recipe views, save rate, weekly active users, …
- Experimental Design
- A/B Testing
- Metric Design
Machine Learning in Practice - AnalysisIntermediateNew
A/B Testing for a 40-Person SaaS Scale-up Moving to Enterprise
You are a data analyst at TaskFlow. You are given the raw A/B test data (visitor logs, conversions, and downstream sales data). Your task is to perform a rigorous analysis: chec…
- A/B Testing
- Statistical Analysis
- Bayesian Methods
Data Science for Business Build a verifiable portfolio.
Submissions become evidence. Reviewers with shipping experience score against a rubric; the result becomes a credential anyone can verify.
Why Ewance
- AnalysisIntermediateNew
Diagnose Modern Transport-Protocol Performance for an OTT Streamer
Receive the current delivery architecture (HTTP/2 origin + CDN), 4 weeks of Conviva-style QoE (quality of experience) metrics, and access to a synthetic-client harness (Linux + …
- Quic Http3
- Network Measurement
- Transport Protocols
Advanced Computer Networks - AnalysisBeginnerNew
A/B Test Landing Page for a 40-Person SaaS Scale-Up
You are a marketing analyst at TaskFlow. You have a dataset of 10,000 visitors with columns: group (control/variant), converted (yes/no), time on page (seconds), and device type…
- Hypothesis Testing
- A/B Testing
- Chi Square Test
Statistics for Business - CodeIntermediateNew
Build a Forgetting-Curve-Aware Spaced-Repetition Engine
You receive 6 months of practice logs from 8,000 learners (item, timestamp, response correctness, response latency). Fit a learner-personalized forgetting model (logistic per-it…
- Spaced Repetition
- Personalization
- Behavioral Data
AI in Education and Learning Analytics
How it works
From brief to credential, in six steps.
Step 01
Browse challenges aligned to your studies.
Step 02
Accept the one that fits your goals.
Step 03
Work through it with AI Copilot guidance.
Step 04
Submit for structured evaluation.
Step 05
Earn a verified credential.
Step 06
Add it to LinkedIn with one click.
Industry teams behind a decade of practitioner briefs
Hiring from this pool?
Sponsor a challenge and meet candidates through actual work.
Industry teams can shape briefs around the skills they hire for, then evaluate students on rubric-scored deliverables — not resumes.