NewsMediaBias-Plus Dataset
Description
NewsMediaBias-Plus Dataset
Overview
The NewsMediaBias-Plus dataset is designed for the analysis of media bias and disinformation by combining textual and visual data from news articles. It aims to support research in detecting, categorizing, and understanding biased reporting in media outlets.
Dataset Description
NewsMediaBias-Plus pairs news articles with relevant images and annotations indicating perceived biases and the reliability of the content. It adds a multimodal dimension for bias detection in news media.
Contents
unique_id
: Unique identifier for each news item. Eachunique_id
matches an image for the same article.outlet
: The publisher of the article.headline
: The headline of the article.article_text
: The full content of the news article.image_description
: Description of the paired image.image
: The file path of the associated image.date_published
: The date the article was published.source_url
: The original URL of the article.canonical_link
: The canonical URL of the article.new_categories
: Categories assigned to the article.news_categories_confidence_scores
: Confidence scores for each category.
Annotation Labels
-
text_label
: Indicates the likelihood of the article being disinformation:Likely
: Likely to be disinformation.Unlikely
: Unlikely to be disinformation.
-
multimodal_label
: Indicates the likelihood of disinformation from the combination of the text snippet and image content:Likely
: Likely to be disinformation.Unlikely
: Unlikely to be disinformation.
Getting Started
Prerequisites
- Python 3.6+
- Pandas
- Hugging Face Datasets
- Hugging Face Hub
Installation
Load the dataset into Python:
from datasets import load_dataset
ds = load_dataset("vector-institute/newsmediabias-plus")
print(ds) # View structure and splits
print(ds['train'][0]) # Access the first record of the train split
print(ds['train'][:5]) # Access the first five records
Load a Few Records
from datasets import load_dataset
# Load the dataset in streaming mode
streamed_dataset = load_dataset("vector-institute/newsmediabias-plus", streaming=True)
# Get an iterable dataset
dataset_iterable = streamed_dataset['train'].take(5)
# Print the records
for record in dataset_iterable:
print(record)
Contributions
Contributions are welcome! You can:
- Add Data: Contribute more data points.
- Refine Annotations: Improve annotation accuracy.
- Share Usage Examples: Help others use the dataset effectively.
To contribute, fork the repository and create a pull request with your changes.
License
This dataset is released under a non-commercial license. See the LICENSE file for more details.
Citation
Please cite the dataset using this BibTeX entry:
@misc{vector_institute_2024_newsmediabias_plus,
title={NewsMediaBias-Plus: A Multimodal Dataset for Analyzing Media Bias},
author={Vector Institute Research Team},
year={2024},
url={https://huggingface.co/datasets/vector-institute/newsmediabias-plus}
}
Contact
For questions or support, contact Shaina Raza at: shaina.raza@vectorinstitute.ai
Disclaimer and User Guidance
Disclaimer: The labels Likely
and Unlikely
are based on LLM annotations and expert assessments, intended for informational use only. They should not be considered final judgments.
Guidance: This dataset is for research purposes. Cross-reference findings with other reliable sources before drawing conclusions. The dataset aims to encourage critical thinking, not provide definitive classifications.
Files
images.zip
Files
(3.5 GB)
Name | Size | Download all |
---|---|---|
md5:c38af710d14e30a6c35d0154380c06e4
|
139.8 MB | Download |
md5:0b57d3e3a1020035787df88d5fb2c3b9
|
154.6 MB | Download |
md5:b612c06af74301714c93ab701fc361e7
|
3.2 GB | Preview Download |