Train a Domain-Specific Reranker for a Legal-Tech Search Box
Overview
What this challenge is about.
Fine-tune a cross-encoder on 20k legal triples, evaluate it, then deliver the model and deployment plan. Get a verifiable certificate.
The scenario
The startup (~80 staff, ~USD 18M ARR) sells per-seat to corporate legal teams; nDCG improvements correlate ~0.6 with renewal probability based on their internal usage analysis.
The Brief
What you'll do, and what you'll demonstrate.
Lift contract-search nDCG@10 with a domain-fine-tuned reranker without blowing the latency budget.
Earning criteria — what you'll demonstrate
- Fine-tune a cross-encoder reranker on domain pairs
- Evaluate retrieval+rerank stacks with nDCG and Recall
- Measure inference latency under a deployment-realistic load
- Design a fallback path for ML model failures
Program Fit
Where this fits in your program.
Sharpens the same skills your degree expects you to demonstrate.
Aligned coursework coming soon.
Skills
Skills you'll demonstrate.
Each one shows up on your verified credential.
- Cross Encoder Reranker
Apply cross encoder reranker to solve real industry problems and demonstrate production-level capability.
- Fine Tuning
Apply fine tuning to solve real industry problems and demonstrate production-level capability.
- Ir Evaluation
Apply ir evaluation to solve real industry problems and demonstrate production-level capability.
- Latency Benchmarking
Apply latency benchmarking to solve real industry problems and demonstrate production-level capability.
- Deployment Design
Apply deployment design to solve real industry problems and demonstrate production-level capability.
- Transformers
Apply transformers to solve real industry problems and demonstrate production-level capability.
Careers
Career paths this challenge builds toward
Completing this challenge demonstrates skills that transfer directly to these roles:
NLP Engineer
Owning a domain-fine-tuned reranker end-to-end is core NLP-engineer work at legal-tech, biomedical, and any vertical search vendor.
This challenge sharpens
- cross-encoder-reranker
- fine-tuning
- transformers
Machine Learning Engineer
Latency-aware deployment design with a fallback plan is the MLE skillset that production ML teams hire for.
This challenge sharpens
- latency-benchmarking
- deployment-design
- fine-tuning
AI Engineer
Wiring a fine-tuned reranker into a top-K-then-rerank architecture is the kind of glue-engineering AI engineers do at any AI startup.
This challenge sharpens
- cross-encoder-reranker
- deployment-design
- ir-evaluation