AI & Data
Generative AI & LLMs Challenges
Generative AI & LLMs challenges put you inside the work of building with large language models. You'll develop skills in prompt patterns, few-shot prompting, chain-of-thought, and LLM API integration, learning how these models behave before you scale them.
From there you'll handle the harder edges — RAG architectures, vector database basics, fine-tuning, and prompt versioning — putting LLM guardrails and LLM evaluation around every deployment the way AI teams actually do. Each challenge you solve earns a verified credential you can share with recruiters.
- CodeIntermediateNew
Instruction-Tune a Small Model for an Edtech Tutor
You receive a 1.5B base model (e.g., SmolLM-1.7B or Qwen-1.8B), permission to use 2 hours of a rented A100, and a curated seed of around 5,000 math-tutoring dialogues. Augment w…
- Instruction Tuning
- Supervised Fine Tuning
- Dataset Curation
Open coursework - CodeIntermediateNew
Build a Tool-Calling Agent for an Internal Reporting Bot
You will implement the agent in either LangChain or LlamaIndex (your choice; defend it in the readme). Wire 4 tools: (1) read-only SQL on a sample warehouse, (2) a mocked BI met…
- Agent Orchestration
- Tool Calling
- Langchain Or Llamaindex
Open coursework - CodeIntermediateNew
Finetune a Diffusion Model for Sustainable-Fashion Mockups
You receive 1,200 product photos with paired captions and the brand's style guide. Fine-tune a Stable-Diffusion-class base model with LoRA (Low-Rank Adaptation, a parameter-effi…
- Diffusion Models
- Lora Finetuning
- Pytorch
Open coursework - CodeIntermediateNew
Extract Skills and Roles from Job Postings for a Recruiter Tool
You receive 30,000 anonymized job postings and a labelled 1,000-posting benchmark with (skill, role, seniority) spans. Fine-tune a small token classifier (e.g., DeBERTa-v3-base)…
- Information Extraction
- Token Classification
- Esco Taxonomy
Open coursework Develop in-demand professional skills.
Each challenge names the skills it strengthens. Over time, your profile fills with the competences a hiring manager would actually look for.
Why Ewance
- CodeIntermediateNew
Fine-Tune a Small Transformer for Legal-Domain EN-DE Translation
You receive a 120,000-segment parallel EN-DE legal corpus and a held-out 1,000-segment test set with reference translations. Fine-tune a small pretrained Transformer (e.g., NLLB…
- Neural Mt
- Transformer
- Fine Tuning
Open coursework - CodeIntermediateNew
Build an Evaluation Harness for an Internal LLM Assistant
You will design and implement an evaluation harness in Python that runs four test suites: (1) helpfulness (LLM-as-judge with rubric), (2) factual grounding (compare cited source…
- LLM Evaluation
- LLM As Judge
- Prompt Injection Testing
Large Language Models - DesignBeginnerNew
Build the PRD for an Internal RAG Knowledge Assistant
You receive: a description of the CS workflows (post-sale onboarding, escalation, renewal), an inventory of internal knowledge sources (Notion, Salesforce, Zendesk macros, 3 pro…
- Product Management
- Retrieval Augmented Generation
- Evaluation Design
AI for Business and AI Product Management - ResearchIntermediateNew
Run an Alignment Probe on a Coding Assistant
You will design 240 probe prompts across 3 classes: (1) over-refusal (innocuous coding asks the model should fulfill), (2) insecure code patterns (asks where the model should wa…
- Red Teaming
- Alignment Evaluation
- LLM Evaluation
Large Language Models - Browse challenges
Explore role
Strategy Analyst
Frame the business question, model the options, build the recommendation. From market sizing to competitive analysis, this role is where strategy consulting meets in-house decision-making.
- DesignIntermediateNew
Design a Continuous Eval Pipeline for an Enterprise RAG Product
Design (and partially build) a continuous-eval pipeline for a RAG system: (1) a structured eval set with at least 50 queries grouped by query class; (2) automated scoring (LLM-a…
- Continuous Evaluation
- LLM Evaluation
- Retrieval Augmented Generation
AI Measurement and Evaluation - CodeBeginnerNew
Prototype a Multimodal Visual-Question-Answering Demo
You will use a small open-source vision-language model (e.g., LLaVA-1.5-7B or PaliGemma) and prompt-engineer it for the warehouse-VQA task. Build a Gradio web demo. Construct a …
- Vision Language Models
- Multimodal Perception
- Prompt Engineering
Open coursework - ResearchIntermediateNew
Audit a Public LLM Benchmark for Validity Threats
Choose one open LLM benchmark (e.g., MMLU, GPQA, BIG-Bench-Hard, MATH). Read the benchmark paper plus at least three follow-up critiques. Audit (1) data contamination risk again…
- Benchmark Evaluation
- Data Contamination Analysis
- Annotation Methodology
AI Measurement and Evaluation - CodeIntermediateNew
Build a Cross-Lingual Retrieval-Augmented QA System
Index around 5,000 internal-knowledge docs across the three languages using a multilingual embedding model (e.g., multilingual-e5 or BGE-M3). Build the retrieval-then-answer pip…
- RAG
- Cross Lingual Retrieval
- Multilingual Embeddings
Open coursework Get recognized by recruiters and employers.
Credentials are blockchain-anchored via LearnCoin — tamper-evident, portable, link-shareable on LinkedIn and beyond.
Why Ewance
- ResearchBeginnerNew
Run a Human-Preference Study Comparing Two Coding Assistants
Design a blinded paired-comparison study: 12 developer participants, each gets the same 8 realistic coding tasks (refactor, write a function, debug, test), each task is solved b…
- Experiment Design
- Statistical Evaluation
- Human Evaluation
AI Measurement and Evaluation - CodeBeginnerNew
Structured-Output Prompts for Invoice Extraction
You receive 300 real invoice transcripts (already OCR-ed) labeled with 14 target fields, plus the current production prompt and its 12 percent failure log. Design a new prompt u…
- Structured Output
- Json Schema
- Few Shot Prompting
Prompt Engineering - AnalysisIntermediateNew
Catastrophic-Forgetting Audit on a Domain Fine-Tune
You receive the fine-tuned 7B chemistry model and its base, plus a benchmark basket (MMLU subset, GSM8K, IFEval, a small instruction-following set). Run all 4 benchmarks on both…
- Catastrophic Forgetting
- LLM Evaluation
- Fine Tuning
Fine-Tuning Large Language Models - DesignBeginnerNew
Chain-of-Thought for High-School Math Tutoring
You receive 80 practice problems across 4 topics (linear equations, factoring, systems of equations, quadratics), each with the correct answer and an expected age-appropriate ex…
- Chain Of Thought Prompting
- Zero Shot Prompting
- Few Shot Prompting
Open coursework - CodeIntermediateNew
AI-Driven Sales Lead Scoring for a B2B SaaS Scale-Up
You will receive a sample dataset of 200 leads with fields like company size, industry, email open rates, and website visits. Using AI tools, you must craft prompts to generate …
- Prompt Engineering
- Lead Scoring
- Data Analysis
Open coursework - ResearchSeniorNew
Multi-Tenant Vector Isolation for a B2B Knowledge Assistant
Build a small proof-of-concept in your chosen vector store (Pinecone or Qdrant — pick one and justify) that supports 10 simulated tenants with 1,000 vectors each. Implement the …
- Multi Tenant Isolation
- Vector Databases
- Threat Modeling
Open coursework - ResearchIntermediateNew
Red-Team a Customer-Service Chatbot for Jailbreak Resistance
Use a published taxonomy of jailbreak categories (prompt injection, persona override, encoded payloads, multi-turn escalation, refusal bypass, tool-misuse). For each category, d…
- Red Teaming
- Jailbreak Analysis
- LLM Evaluation
Open coursework - CodeIntermediateNew
LLM-Powered FAQ Chatbot for 40-Person SaaS Scale-up
You have access to TaskFlow's internal documentation, help articles, and a sample of 500 support tickets. Your task is to build a retrieval-augmented generation (RAG) pipeline: …
- LLM
- RAG
- Information Retrieval
Text Analytics and Natural Language Processing - CodeIntermediateNew
Build a Domain Instruction-Tuning Recipe for a Legal Coach
You will source instruction data from three streams: ~3,000 synthetic paralegal Q&A generated by a frontier model (anonymized prompts), ~1,500 curated examples from public legal…
- Instruction Tuning
- Lora Fine Tuning
- Data Curation
Open coursework - ResearchSeniorNew
DPO Preference-Tune a Code Assistant for Style Compliance
You receive a 7B coding base model, a client's published code-style guide (Python, around 80 pages), and a generated preference dataset (4,000 pairs of code snippets where one m…
- Dpo
- Preference Optimization
- Fine Tuning
Fine-Tuning Large Language Models - CodeIntermediateNew
Prototype Constitutional-AI Style Guardrails for an Internal Chatbot
Author a 'constitution' of 15 to 20 principles tailored to internal research use (no IP leakage, no off-label medical claims, no personnel-data fishing, etc.). Implement a criti…
- Constitutional Ai
- Alignment Techniques
- LLM Evaluation
Open coursework - ResearchIntermediateNew
Design a Capability Evaluation for an Open-Weights Coding Model
Pick a recent open-weights coding model (e.g., a Qwen, DeepSeek, or Llama variant). Design an evaluation set of around 40 coding tasks across 4 buckets: standard benign coding, …
- Capability Evaluation
- Safety Evaluation
- LLM Evaluation
AI Safety and Alignment
How it works
From brief to credential, in six steps.
Step 01
Browse challenges aligned to your studies.
Step 02
Accept the one that fits your goals.
Step 03
Work through it with AI Copilot guidance.
Step 04
Submit for structured evaluation.
Step 05
Earn a verified credential.
Step 06
Add it to LinkedIn with one click.
Industry teams behind a decade of practitioner briefs
Hiring from this pool?
Sponsor a challenge and meet candidates through actual work.
Industry teams can shape briefs around the skills they hire for, then evaluate students on rubric-scored deliverables — not resumes.