- DesignAdvancedNew
Design a Continuous Eval Pipeline for an Enterprise RAG Product
Design (and partially build) a continuous-eval pipeline for a RAG system: (1) a structured eval set with at least 50 queries grouped by query class; (2) automated scoring (LLM-a…
- Continuous Evaluation
- Llm Evaluation
- Retrieval Augmented Generation
AI Measurement and Evaluation - CodeAdvancedNew
Detect Change Points in a Trading Platform's Latency Telemetry
You receive 90 days of per-millisecond latency telemetry across 12 services, plus an incident log of 14 known regressions and 22 known false-alarm-class events. Implement and tu…
- Change Point Detection
- Anomaly Detection
- Time Series Analysis
Time Series Analysis and Forecasting - CodeAdvancedNew
Automate Retraining with a Drift-Triggered MLflow Pipeline
Stand up the pipeline end to end with the team's existing stack (MLflow tracking + model registry, Airflow orchestration). Wire Evidently to compute weekly drift; when drift cro…
- Mlflow
- Airflow
- Data Drift Detection
ML Engineering and Production ML - AnalysisAdvancedNew
Benchmark Approximate Nearest-Neighbor Indexes for a Code-Search Startup
You receive a 5 M-vector sample (768-dim, float32) and a 1,000-query labeled benchmark with ground-truth top-50 neighbors per query. Index the same sample in Chroma (HNSW), Qdra…
- Ann Indexes
- Hnsw
- Benchmarking
Vector Databases and Embeddings Practice your coursework on real scenarios.
Every challenge is shaped from real industry context — not generic exercises. The work mirrors what your degree prepares you for.
Why Ewance
- CodeAdvancedNew
Quantize a CNN for Battery-Powered Wildlife Cameras at a Climate Nonprofit
You receive an FP32 CNN (MobileNetV2 fine-tuned to 22 species, around 13 MB) and a hold-out test set of 4,000 images. Quantize to int8 (post-training quantization first, then qu…
- Quantization
- Qat
- Edge Deployment
Deep Learning - CodeAdvancedNew
Design Prompt Versioning and Observability for a Coding Assistant
You will (1) design a prompt-registry data model (versions, owners, environments, change log) and implement it in Postgres + a small Python SDK, (2) instrument the assistant to …
- Prompt Versioning
- Observability
- Pii Scrubbing
LLM Application Development - DesignAdvancedNew
Instrument a Model Monitoring Stack from Scratch
Pick the priority product (recommend the customer-service RAG assistant, around 40k queries/day). Define monitoring signals: input drift (Evidently/NannyML), output quality (LLM…
- Model Monitoring
- Data Drift Detection
- Llm Evaluation
ML Engineering and Production ML - CodeAdvancedNew
Containerized Model Inference on Kubernetes for a Fintech
You receive a pre-trained credit-risk model (a LightGBM model file) and a sample request payload. Containerize a FastAPI inference service, deploy to EKS or GKE (a single-zone c…
- Kubernetes
- Containerization
- Autoscaling
Cloud Computing for Data and ML - Browse challenges
Explore role
Product Manager
Ship product that solves real user problems. Combine user research, prototyping, and stakeholder alignment to turn ambiguous briefs into measurable wins — the role at the centre of modern software teams.
- AnalysisAdvancedNew
Capstone Lab: Diagnose Why a Production Model Quietly Stopped Working
You receive 6 months of production logs (model inputs, predictions, ground truth from chargebacks) plus the original training data and model card. Reproduce the recall drop in a…
- Data Drift Detection
- Model Monitoring
- Root Cause Analysis
AI/ML Practicum and Hands-on Lab - DesignAdvancedNew
Stand Up a Feature Store for a Series-B Fintech
Pick one priority feature group (recommend the 25 transaction-history features used by the fraud model). Define the offline source-of-truth (likely Snowflake or BigQuery), the o…
- Feature Store
- Feature Engineering
- Airflow
ML Engineering and Production ML - CodeAdvancedNew
Build a Canary Rollout for a Production Recommender
Pick a serving stack (Triton, Seldon Core, KServe, or BentoML). Implement two-model traffic splitting with a configurable percentage (start at 5%). Wire up online metric collect…
- Canary Deployment
- Kubernetes
- Ab Testing
ML Engineering and Production ML
How it works
From brief to credential, in six steps.
Step 01
Browse challenges aligned to your studies.
Step 02
Accept the one that fits your goals.
Step 03
Work through it with AI Copilot guidance.
Step 04
Submit for structured evaluation.
Step 05
Earn a verified credential.
Step 06
Add it to LinkedIn with one click.
Industry teams behind a decade of practitioner briefs
Hiring from this pool?
Sponsor a challenge and meet candidates through actual work.
Industry teams can shape briefs around the skills they hire for, then evaluate students on rubric-scored deliverables — not resumes.
Skills and disciplines shown on this page are derived from the Ewance challenge catalogue. When the median annual salary is available for this role via Adzuna, it will be shown above with the sample size and country.