DataScouting
Published June 29, 2025 | Version v1
Dataset Restricted

Media Coding Dataset for News Content Analysis

Authors/Creators

  • 1. DataScouting
  • 2. ROR icon International Hellenic University

Description

This dataset accompanies the study Beyond Manual Media Coding: Evaluating Large Language Models and Agents for News Content Analysis.

It provides a reproducible benchmark for evaluating automated content analysis methods against human-annotated ground truth.

The dataset includes:

  • articles.csv
    Contains the 200 news articles collected for this study, each with:

    • id: unique identifier

    • url: source URL of the original article

    • content: full text of the news article

  • codebook.json
    A structured JSON file defining the 26-question analysis codebook used for annotation.
    Each question entry specifies:

    • questionId: question ID (e.g., Q1)

    • prompt: annotation question text

    • questionAnswerType: type (SINGLE_CHOICE or MULTI_CHOICE)

    • eligibleQuestionAnswers: list of possible tags / codes

  • annotations.json
    Contains the complete human annotation data.
    For each article id, it provides the list of responses to all 26 codebook questions as determined by an expert annotator, establishing the ground truth labels.

 

Intended use

  • Designed for research popuses including natural language understanding, content classification, and LLM evaluation.

  • Please request access with your academic email.

Files

Restricted

The record is publicly accessible, but files are restricted. <a href="https://zenodo.org/account/settings/login?next=https://zenodo.org/records/15767938">Log in</a> to check if you have access.

Request access

If you would like to request access to these files, please fill out the form below.

You need to satisfy these conditions in order for this request to be accepted:

This resource is intended for research purposes. Please submit your request using a verified academic email address

You are currently not logged in. Do you have an account? Log in here