Experimental design
If you like applying Experimental design, every challenge here gives you a chance to practice it on a real industry brief.
- ResearchSeniorNew
Benchmark Reward-from-Feedback Methods on a Tabletop Pick-Place
You will use a Franka Panda arm in PyBullet on a 4-object pick-and-place task. For each of the three feedback methods, train a reward model and a downstream policy until converg…
- Reinforcement Learning
- Reward Learning
- Preference Comparison
Human-Robot Interaction - ResearchSeniorNew
Quantify Sim-to-Real Gap for a Warehouse Manipulation Policy
You receive a trained pick-and-place policy (PyTorch), the simulation env (Isaac Lab), and access to a real-arm rig (or recorded teleop episodes if hardware is unavailable). Def…
- Sim To Real
- Manipulation
- Experiment Design
Open coursework - ResearchSeniorNew
Train a Small Diffusion Model for Synthetic Defect Generation
You receive 2,000 labeled defect images and 18,000 clean weld images. Train a small class-conditional latent diffusion model on the defect images (Hugging Face diffusers is fine…
- Generative Perception
- Diffusion Models
- Data Augmentation
Open coursework - DesignBeginnerNew
A/B-Test a Recommender Improvement Without Breaking Trust
You receive offline-evaluation results for both the production and candidate models plus aggregate metrics from the last 12 weeks (recipe views, save rate, weekly active users, …
- Experiment Design
- Ab Testing
- Metric Design
Machine Learning in Practice Practice your coursework on real scenarios.
Every challenge is shaped from real-world context — not generic exercises. The work mirrors what your degree prepares you for.
Why Ewance
- CodeIntermediateNew
Train a Deep Q-Network for Warehouse Robot Routing
You receive a Gymnasium-compatible warehouse simulator (50x50 grid, 8 dynamic obstacle pedestrians, 20 randomized pick locations) and a baseline A* planner script. Train a DQN a…
- Deep Q Learning
- Reinforcement Learning
- Pytorch
Open coursework - ResearchSeniorNew
Graph Transformer Research Probe for a Drug-Target Predictor
You receive a public drug-target interaction dataset (around 50,000 drug-target pairs with labels and molecular graphs), a strong GIN baseline, and a starter GraphGPS implementa…
- Graph Transformers
- Graph Neural Networks
- Message Passing
Open coursework - ResearchIntermediateNew
Hands-on Lab: Reproduce a Recent SOTA Vision Paper
Pick one of three pre-approved 2025 papers (offered by the supervisor) with a known reference codebase you may consult but not copy. Re-implement the model and training loop in …
- Pytorch
- Paper Reproduction
- Experiment Design
Open coursework - ResearchSeniorNew
Train Cooperative Agents with Multi-Agent RL
Pick an open multi-agent environment (PettingZoo's MPE 'simple_spread', Overcooked-AI, or SMAC). Implement or wrap three methods: IPPO (independent PPO per agent), MAPPO (centra…
- Multi Agent Reinforcement Learning
- Ppo
- Pytorch
Open coursework - Browse challenges
Explore role
Product Manager
Ship product that solves real user problems. Combine user research, prototyping, and stakeholder alignment to turn ambiguous briefs into measurable wins — the role at the centre of modern software teams.
- ResearchIntermediateNew
Sim-to-Real Domain Randomization for a Mobile Robot
You receive an Isaac Sim navigation environment, a baseline trained policy, a 50-episode real-bench test set (recorded sensor streams + ground truth) for offline policy evaluati…
- Domain Randomization
- Sim To Real
- Robot Navigation
Open coursework - ResearchSeniorNew
Trajectory Prediction Model for Urban Robotaxis
Use the Argoverse 2 motion-forecasting dataset (open access). Train an LSTM baseline + a transformer challenger (e.g., a small Wayformer or HiVT). Evaluate on minADE/minFDE (min…
- Trajectory Prediction
- Transformer Models
- Evaluation
Open coursework - ResearchSeniorNew
Reproduce a Mechanistic Interpretability Result on a Small Transformer
Pick a published mechanistic-interpretability paper that operates on a small (under 1 billion parameter) open-source transformer (e.g., GPT-2 small, Pythia 70M). Set up the envi…
- Mechanistic Interpretability
- Transformer Internals
- Pytorch
AI Safety and Alignment - ResearchSeniorNew
Pre-Register and Run a Small Neural-Network Ablation Study
You will study how three architectural and regularization choices (depth: 2/4/8 hidden layers; activation: ReLU vs. GELU; weight decay: 0 / 1e-4 / 1e-3) affect a small MLP's tes…
- Neural Networks
- Regularization
- Experiment Design
Open coursework Build a verifiable portfolio.
Submissions become evidence. Reviewers with shipping experience score against a rubric; the result becomes a credential anyone can verify.
Why Ewance
- ResearchIntermediateNew
Train a NeRF for Real-Estate Virtual Tours
You receive a curated dataset of 3 apartments, each with around 120 input images and known camera poses (already SfM-processed). Train a NeRF variant (Instant-NGP or Nerfacto re…
- Neural Scene Representation
- Nerf
- Pytorch
Open coursework - ResearchSeniorNew
Benchmark Long-Context Architectures on a Legal-Doc Retrieval Task
You receive a public legal-QA dataset (e.g., LongBench's legal split or similar) filtered to documents over 50,000 tokens. Implement or wrap 3 architectures: a sliding-window Tr…
- Long Context Architectures
- State Space Models
- Transformers
Advanced Deep Learning - AnalysisBeginnerNew
Run an A/B Test on Two System Prompts for a Sales Email Assistant
You will (1) design the A/B test (random assignment by rep_id, 50/50 split, 2-week duration), (2) instrument three primary metrics: reply rate (event-based), average tokens per …
- Prompt Evaluation
- Ab Testing
- Metric Design
Open coursework - ResearchIntermediateNew
Lab Project: Compare Three Architectures on Your Own Mini-Benchmark
Scope the problem yourself (suggested examples: sentiment classification on a niche domain, tabular anomaly detection, time-series forecasting on a public dataset). Define the t…
- Experiment Design
- Statistical Testing
- Pytorch
Open coursework - ResearchSeniorNew
Stress-Test Scalable Oversight on a Tool-Using Agent
Design a sandwich-oversight study: pick a task domain where non-expert oversight is plausible but not trivial (e.g., reviewing data-analysis steps, checking small bug fixes, eva…
- Scalable Oversight
- Alignment Research
- Experiment Design
AI Safety and Alignment - ResearchSeniorNew
Neuromarketing Audit for a Sustainable Fashion Retailer
Your team will design and simulate a neuromarketing experiment. First, propose two alternative store layouts (e.g., circular vs. grid) and two website homepage designs (e.g., he…
- Neuromarketing
- Experimental Design
- Eye Tracking Analysis
Consumer Behavior - CodeSeniorNew
Auto-Tune a Distributed Training Cluster's Throughput
Pick a representative fine-tune job (an open 7B model on a public instruction dataset is fine). Define the search space: NCCL_ALGO, NCCL_PROTO, num_workers, prefetch_factor, gra…
- Distributed Training
- Hyperparameter Tuning
- Nccl
Machine Learning Systems - AnalysisBeginnerNew
Chunking Strategy Bake-Off for Financial Filings
You receive 40 anonymized 10-K filings and 100 labeled questions split into 50 narrative (e.g., 'what is the company's main risk factor?') and 50 numerical (e.g., 'what was oper…
- Document Chunking
- Semantic Chunking
- Layout Aware Chunking
Retrieval-Augmented Generation - ResearchIntermediateNew
Recommend a Color Scale for a Flood-Risk Map With Evidence
Working only from the provided materials, reach and defend a single recommendation. Read the decision file (decision-file) to understand the actors, the prior complaint, and the…
- Perceptual Study
- Color Scales
- Experimental Design
Open coursework - ResearchSeniorNew
Open-Vocabulary Segmentation Benchmark for a Robotics R&D Lab
Use a curated 200-image household scene set (publicly-available HM3D renderings or COCO + a handful of household prompts). Benchmark 3 open-vocabulary segmentation models: SAM +…
- Open Vocabulary Segmentation
- Vision Language Models
- Benchmarking
Computer Vision - ResearchSeniorNew
Pretrain a Small Vision Transformer with Self-Supervised Learning
You receive 80,000 unlabeled 224x224 histology tiles plus 4,000 labeled tiles split into train/val/test. Pretrain a ViT-Small using a self-supervised method of your choice (DINO…
- Self Supervised Learning
- Vision Transformers
- Pytorch
Advanced Deep Learning - ResearchIntermediateNew
Reproduce a Vision-Model Paper Under a Reproducibility Standard
Pick a vision-model paper from CVPR or NeurIPS 2024-2025 with publicly available code and a manageable compute footprint (single-GPU under 24 hours). Reproduce the headline metr…
- Reproducibility
- Experimental Design
- Model Evaluation
AI Measurement and Evaluation
How it works
From brief to credential, in six steps.
Step 01
Browse challenges aligned to your studies.
Step 02
Accept the one that fits your goals.
Step 03
Work through it with AI Copilot guidance.
Step 04
Submit for structured evaluation.
Step 05
Earn a verified credential.
Step 06
Add it to LinkedIn with one click.
Industry teams behind a decade of practitioner briefs
Hiring from this pool?
Sponsor a challenge and meet candidates through actual work.
Industry teams can shape briefs around the skills they hire for, then evaluate students on rubric-scored deliverables — not resumes.