Model Evaluation
If you like applying Model Evaluation, every challenge here gives you a chance to practice it on a real industry brief.
- ResearchIntermediateNew
Reproduce a Vision-Model Paper Under a Reproducibility Standard
Pick a vision-model paper from CVPR or NeurIPS 2024-2025 with publicly available code and a manageable compute footprint (single-GPU under 24 hours). Reproduce the headline metr…
- Reproducibility
- Experimental Design
- Model Evaluation
AI Measurement and Evaluation - AnalysisBeginnerNew
Detect Fraudulent Refund Requests for a Mid-Market Marketplace
You receive a labeled dataset with buyer history, seller history, shipping carrier, refund reason text, and outcome label (legit / fraud). Train and evaluate at least two classi…
- Classification
- Model Calibration
- Imbalanced Classification
Open coursework - AnalysisBeginnerNew
Analyze a Learning-Analytics Dataset for At-Risk Detection
You receive an anonymized dataset of LMS engagement features (logins, assignment submissions, forum posts, video-watch time), grade history, and a binary label for end-of-semest…
- Learning Analytics
- Classification
- Fairness Metrics
Open coursework - CodeSeniorNew
Fuse Camera + Audio Cues for an Autonomous-Vehicle Edge Case
You receive a curated dataset of 4,000 short clips (5s each), each with synchronized 8-camera 360-degree video, 4-channel audio, and labels (siren-active emergency vehicle prese…
- Multimodal Perception
- Convolutional Neural Networks
- Audio Processing
Machine Perception Develop in-demand professional skills.
Each challenge names the skills it strengthens. Over time, your profile fills with the competences a hiring manager would actually look for.
Why Ewance
- CodeIntermediateNew
Lane-Change Intent Classifier from Dashcam Video
Use a public driving video dataset (e.g., Argoverse 2 sensor or BDD100K) and curate ~6,000 short clips labeled with the three-class intent. Train a temporal model (e.g., a small…
- Video Understanding
- Temporal Modeling
- Model Evaluation
Visual Intelligence and Visual Reasoning - AnalysisSeniorNew
Brain-Tumor MRI Segmentation Bake-Off
You receive a curated public multi-modal MRI brain-tumor cohort (~600 patients, T1/T1c/T2/FLAIR with whole-tumor / tumor-core / enhancing-tumor masks). Train all three architect…
- Medical Imaging
- Segmentation
- Convolutional Neural Networks
Open coursework - CodeSeniorNew
Survival-Analysis Risk Model for an Oncology Decision-Support Pilot
You receive a curated public colorectal cancer cohort (about 9,000 patients, demographics, stage, grade, comorbidities, baseline labs, censored survival times). Fit (1) a Cox pr…
- Survival Analysis
- Risk Stratification
- Model Calibration
Machine Learning for Healthcare and Biomedicine - ResearchIntermediateNew
Disease-Progression Modelling for a Neurodegeneration Biotech
You receive a curated longitudinal Parkinson's cohort (about 1,200 patients, 4-12 visits each, MDS-UPDRS sub-scores, cognitive assessments, demographics). Fit (1) a linear mixed…
- Disease Progression Modeling
- Mixed Effects Models
- State Space Models
Open coursework - Browse challenges
Explore role
Strategy Analyst
Frame the business question, model the options, build the recommendation. From market sizing to competitive analysis, this role is where strategy consulting meets in-house decision-making.
- AnalysisIntermediateNew
Structured Prediction for Insurance Claim Triage
You receive 18,000 historical claims with text, attachments-count, claim amount, customer tenure, and the ground-truth final routing bucket. Train a structured classifier (e.g.,…
- Structured Prediction
- Multi Class Classification
- Model Evaluation
Advanced Machine Learning - CodeBeginnerNew
Build an Embedding-Based Semantic Search for a Legal-Document Corpus
Embed the 380k-document corpus using a multilingual sentence-transformer (e.g. multilingual MPNet or LaBSE). Store embeddings in FAISS or pgvector. Build a search service that r…
- Deep Learning
- Ml Applications
- Python Programming
Machine Learning (CS Elective) - AnalysisIntermediateNew
Audit a Sepsis Early-Warning Model for Subgroup Performance
You receive a pre-trained vendor model, the training-data summary, and a held-out hospital-network evaluation set (about 18,000 ICU stays with sepsis labels). Compute AUROC + AU…
- Model Evaluation
- Fairness Metrics
- Model Calibration
Machine Learning for Healthcare and Biomedicine - CodeBeginnerNew
Image-Quality Triage Tool for a Tele-Radiology Network
You receive 10,000 chest-X-ray images with multi-label quality flags (rotation, clipping, motion). Train a small multi-label CNN that outputs a per-flag probability and a single…
- Medical Imaging
- Classification
- Convolutional Neural Networks
Open coursework Get recognized by recruiters and employers.
Credentials are blockchain-anchored via LearnCoin — tamper-evident, portable, link-shareable on LinkedIn and beyond.
Why Ewance
- AnalysisIntermediateNew
Run a Pre-Deployment Fairness + Drift Audit on a Hiring Model
You receive a trained classifier (joblib), the training data sample, and a held-out 'next-month' evaluation set. Compute group fairness metrics (false-positive-rate gap, true-po…
- Fairness Metrics
- Drift Detection
- Bias Mitigation
Machine Learning in Practice - ResearchSeniorNew
Audit a Production Model for Membership Inference Attacks
Use a black-box membership inference attack (e.g., the LiRA or shadow-model attack). You have query access to a sandboxed copy of the model + the original training data labels f…
- Membership Inference
- Privacy Attacks
- Model Evaluation
Open coursework - CodeBeginnerNew
Build a Face-Anonymization Tool for a Civic-Tech Newsroom
Use a pretrained face detector (RetinaFace or YOLOv8-face is fine). Build a Python tool with a Gradio or Streamlit UI that: (1) detects faces in an uploaded photo, (2) shows det…
- Object Detection
- Image Processing
- Opencv
Open coursework - ResearchSeniorNew
Self-Supervised Pretraining for a Pathology Foundation Vendor
You receive a public pathology dataset (about 80,000 unlabeled whole-slide-image patches plus a labeled 8,000-patch subtype-classification subset across 4 classes). Pretrain a R…
- Self Supervised Learning
- Medical Imaging
- Transfer Learning
Machine Learning for Imaging and Medical Image Analysis - AnalysisBeginnerNew
Design a Churn-Prediction and Retention Model for TaskFlow
Using the TaskFlow customer dataset and the VP's framing memo (both provided), design and document a churn-prediction model. Perform exploratory analysis to surface patterns and…
- Logistic Regression
- Classification
- Feature Engineering
Open coursework - CodeBeginnerNew
Build a Fairness Evaluation Harness for a Credit-Score Model
Implement a Python module that, given model predictions, ground truth, and group identifiers, computes demographic parity difference, equal-opportunity difference, predictive-pa…
- Algorithmic Fairness
- Statistical Evaluation
- Python
AI Measurement and Evaluation - AnalysisIntermediateNew
Transfer-Learning Backbone Bake-Off for Retail Product Tagging
You receive 80,000 retail product images tagged with multiple labels from a 250-tag taxonomy. Use each of the three pretrained backbones via two transfer strategies: (1) linear …
- Transfer Learning
- Fine Tuning
- Self Supervised Learning
Open coursework - CodeBeginnerNew
Ship a Churn-Prediction Mini-Project End to End
You receive a 12-month anonymized dataset of subscriber events (logins, lesson completions, payment history, support tickets) for around 200,000 users. Define churn precisely (n…
- Feature Engineering
- Model Evaluation
- Gradient Boosting
Open coursework - AnalysisBeginnerNew
Cost-Model a Foundation-Model API Migration
You receive: 90 days of API logs (request volume, token distributions), the customer's golden eval set of 200 prompts, the incumbent and new pricing schedules, and quality ratin…
- Cost Modeling
- Ai Strategy
- Model Evaluation
AI for Business and AI Product Management - AnalysisBeginnerNew
Optimize Hyperparameters with Bayesian Optimization on a Tight Budget
You receive a B2B-SaaS churn dataset (about 12,000 customer-month rows, 38 features) and a fixed sweep budget of 40 trials per model family. Implement a Bayesian optimizer (Optu…
- Bayesian Optimization
- Hyperparameter Tuning
- Ensemble Methods
Advanced Machine Learning - CodeIntermediateNew
Build a Neural Surrogate for Computational Fluid Dynamics in HVAC Design
Use a published CFD dataset (e.g., AirfRANS or a small in-house dataset if available) of around 1,000 steady-state airflow simulations on 2D building zones. Train a Fourier Neur…
- Neural Operators
- Surrogate Modeling
- Computational Fluid Dynamics
AI for Science and Engineering - CodeSeniorNew
Video Action Recognition for a Retail Loss-Prevention Startup
Use a public action-recognition dataset (UCF101 + a small curated retail-action subset; the latter is provided synthetic or you can label 50 short clips). Fine-tune a small back…
- Video Understanding
- Action Recognition
- Transfer Learning
Computer Vision
How it works
From brief to credential, in six steps.
Step 01
Browse challenges aligned to your studies.
Step 02
Accept the one that fits your goals.
Step 03
Work through it with AI Copilot guidance.
Step 04
Submit for structured evaluation.
Step 05
Earn a verified credential.
Step 06
Add it to LinkedIn with one click.
Industry teams behind a decade of practitioner briefs
Hiring from this pool?
Sponsor a challenge and meet candidates through actual work.
Industry teams can shape briefs around the skills they hire for, then evaluate students on rubric-scored deliverables — not resumes.