Ewance
← All challenges NLP Engineer

Extract Skills and Roles from Job Postings for a Recruiter Tool

Duration
3 weeks
Level
Advanced
Type
Code
Team
1 to 5 people

The situation

The edtech (~45 staff) operates across Spain, Portugal, and Italy and uses career-path insights as a differentiator with university partners.

Your task

Turn raw job-posting text into ESCO-normalized (role, skill, seniority) tuples with measurable end-to-end accuracy.

The brief

You start with

You receive 30,000 anonymized job postings and a labeled 1,000-posting benchmark with (skill, role, seniority) spans.

What you do

  1. Fine-tune a small token classifier (e.g., DeBERTa-v3-base) for span extraction.
  2. Build a normalization layer that maps extracted skill strings to ESCO skill URIs (fuzzy match + embedding similarity).
  3. Evaluate per-class F1 and end-to-end (extraction + normalization) accuracy on the held-out benchmark.

You deliver

: pipeline code, fine-tuned model, ESCO mapping notebook, and a 3-page deployment recommendation including a refresh strategy when ESCO updates.

What you will practice

  • Fine-tune a token classifier on a real IE task
  • Normalise extracted entities to a public taxonomy (ESCO)
  • Evaluate end-to-end IE + normalization accuracy
  • Design a refresh strategy for taxonomy-dependent pipelines

A suggested way in

  1. Use Hugging Face TokenClassification trainer; DeBERTa-v3-base is a strong baseline
  2. Pre-compute ESCO skill embeddings once and cache them
  3. Report end-to-end accuracy — span extraction can be perfect and normalisation can still drop accuracy

Skills you will practice

Information extraction, Token classification, Esco taxonomy, Entity normalization, Fine tuning, Evaluation

Where it leads

NLP Engineer, Machine Learning Engineer, Data Engineer

How it is assessed

  • Extraction quality25%

    Per-class span F1 above target on held-out set.

  • Normalisation quality25%

    ESCO mapping accuracy reported with confidence intervals.

  • End-to-end evaluation25%

    End-to-end accuracy is reported alongside stage-wise metrics.

  • Deployment plan25%

    Refresh strategy for ESCO updates is concrete and operable.

Resources

  • PyTorchTool

    Train the token-classification head.

  • Hugging Face TransformersTool

    Token-classification trainer and model loading.

  • sentence-transformersTool

    Embed ESCO skill descriptions for similarity matching.

  • PythonTool

    Glue the IE and normalisation stages.

  • Weights & BiasesTool

    Track training and eval runs.

  • NotionTool

    Author the deployment recommendation.

Sample Ewance certificate of completion, verified by LearnCoin
Sample certificate
Your proof

Finish it. Earn this.

A verified certificate with your name. Anyone can check it.

Time to practice.

Solve this challenge
Related challenges

More like this.