Published July 5, 2024 | Version 1.0.0
Dataset Open

DIPROMATS 2024 - Shared Task 2: testing data for narrative identification

Description

Narratives are causally connected sequences of events that are selected and evaluated as meaningful for a particular audience. They make sense of the world by identifying the significance of people, places, objects, and events in time. In international relations, international actors create strategic narratives to “construct a shared meaning of the past, present, and future of international politics to shape the behavior of domestic and international actors”

DIPROMATS 2024 Task 2 is a multiclass multilabel classification problem. Given a series of predefined narratives of each international actor, systems must determine which narrative the tweets belong to. Systems will receive the description of each narrative and a few examples of tweets in both languages (English and Spanish) that belong to each of them (few-shot learning). A tweet may be associated with one, several or none of the narratives.

The few-shot training data can be found here: https://doi.org/10.5281/zenodo.10820961

These are the testing datasets for Englsih and Spanish. They are provided without the keys so the large language models can't be contaminated. If you are interested on testing your system, write anselmo@lsi.uned.es for details on submission and leaderboards.

Files

dipromats24_t2_test_en_ids.json

Files (156.4 kB)

Name Size Download all
md5:006f687638cd9018cdb8f2821a0735b1
78.3 kB Preview Download
md5:f7be5fbbc401be77d4f828e14563086f
78.1 kB Preview Download