TalentCLEF 2025 corpus: Skill and Job Title Intelligence for Human Capital Management

🚨 Current Status: Release of Task B Development set. To check when new data will be uploaded, please consult the calendar of the task

TalentCLEF2025 corpus - Task B Development set release

Introduction:

The first edition of TalentCLEF aims to develop and evaluate models designed to facilitate three essential tasks:

1. Finding/ranking candidates for job positions based on their experience and professional skills.
2. Implementing upskilling and reskilling strategies that promote the coninuous development of workers
3. Detecting emerging skills and skills gaps of importance in organizations.

With that aim, the task is divided into two tasks: 

• Task A - Multilingual Job Title Matching. This task involves developing systems to identify and rank the job titles most similar to a given one by generating a ranked list of similar titles from a specified knowledge base for each job title in a provided test set.
• Task B - Job Title-Based Skill Prediction. Task B requires developing systems that can retrieve relevant skills associated with a specified job title.

File structure: 

The files is organized into two *.zip files, TaskA.zip and TaskB.zip, each containing training, validation and test folders to support different stages of model development. So far, only the training set for both tasks has been released, but in future releases, as the tasks progress, additional data will be added to the different subfolders for each task.

TaskA includes language-specific subfolders within the training and validation directories, covering English, Spanish, German, and Chinese job title data. The tr*aining folders for TaskA contain language-specific .tsv files for each respective language. Validation folders include three essential files—queries, corpus_elements, and q_rels—for evaluating model relevance to search queries. TaskA’s test folder has queries and corpus_elements files for testing retrieval.

TaskA/
│
├── training/
│   ├── english/
│   │   └── taskA_training_en.tsv
│   ├── spanish/
│   │   └── taskA_training_es.tsv
│   └── german/
│       └── taskA_training_de.tsv
│
├── validation/
│   ├── english/
│   │   ├── queries
│   │   ├── corpus_elements
│   │   └── qrels
│   ├── spanish/
│   ├── german/
│   └── chinese/
│
└── test/
    ├── queries
    └── corpus_elements

TaskB follows a similar structure but without language-specific subfolders, providing general .tsv files for training, validation, and testing. This consistent file organization enables efficient data access and structured updates as new data versions are published.

TaskB/
│
├── training/
│   ├── job2skill.tsv
│   ├── jobid2terms.json
│   └── skillid2terms.json
│
├── validation/
│   ├── queries
│   ├── corpus_elements
│   └── qrels
│
└── test/
    ├── queries
    └── corpus_elements

Tutorials:

Resources: 

• Web
• CLEF Lab Registration Page
• Codabench Task A