DIPROMATS 2024 - Shared Task 2: testing data for narrative identification
Creators
- Peñas, Anselmo (Project leader)1
- Fraile-Hernández, Jesús M. (Researcher)1
- Moral, Pablo (Researcher)1
- Rodrigo, Álvaro (Data curator)1
- Deriu, Jan (Data curator)2
- Sharma, Rajesh (Data curator)3
- Centeno, Roberto (Data curator)4
- Rodríguez-García, Raquel (Data curator)1
- Giedemann, Patrick (Data curator)2
- Reyes-Montesinos, Julio (Data curator)1
Description
Narratives are causally connected sequences of events that are selected and evaluated as meaningful for a particular audience. They make sense of the world by identifying the significance of people, places, objects, and events in time. In international relations, international actors create strategic narratives to “construct a shared meaning of the past, present, and future of international politics to shape the behavior of domestic and international actors”
DIPROMATS 2024 Task 2 is a multiclass multilabel classification problem. Given a series of predefined narratives of each international actor, systems must determine which narrative the tweets belong to. Systems will receive the description of each narrative and a few examples of tweets in both languages (English and Spanish) that belong to each of them (few-shot learning). A tweet may be associated with one, several or none of the narratives.
The few-shot training data can be found here: https://doi.org/10.5281/zenodo.10820961
These are the testing datasets for Englsih and Spanish. They are provided without the keys so the large language models can't be contaminated. If you are interested on testing your system, write anselmo@lsi.uned.es for details on submission and leaderboards.
Files
dipromats24_t2_test_en_ids.json
Files
(156.4 kB)
Name | Size | Download all |
---|---|---|
md5:006f687638cd9018cdb8f2821a0735b1
|
78.3 kB | Preview Download |
md5:f7be5fbbc401be77d4f828e14563086f
|
78.1 kB | Preview Download |