Published July 28, 2025 | Version 1.0.0
Dataset Open

Dataset - Comparative study between heuristic evaluation done by human experts versus NLP agents

  • 1. Arceus Tech
  • 2. Universidad Industrial de Santander
  • 3. ROR icon Autonomous University of Bucaramanga
  • 4. ROR icon Industrial University of Santander

Description

This dataset accompanies the research article "Comparative Study Between Heuristic Evaluation Done by Human Experts vs NLP Agents". It includes all relevant files used and produced during the study, covering both human and AI-based heuristic evaluations.

The contents are organized into the following categories:

  • Raw Evaluation Data: Original heuristic evaluation responses provided by human experts and NLP agents, organized by heuristic principle and evaluation question.

  • Supporting Materials for Analysis: Includes qualitative and quantitative analysis resources, such as tables, summaries and analysis results.

  • TF-IDF Implementation: Jupyter Notebooks (.ipynb) containing code used to preprocess data, compute TF-IDF values, and generate term frequency visualizations.

  • Supplementary Documents: PDF reports, figures, and tables used for interpretation and discussion of the evaluation results.

  • Compressed Archives: Some materials are provided in .zip format for easier access and organization of grouped files.

All files are provided in accessible, open formats to support reproducibility and further research in usability engineering, human-AI comparison, and heuristic evaluation methods.

Files

df_comments.csv

Files (10.6 MB)

Name Size Download all
md5:befc1209de4e59d446a1a29235e8f887
5.4 MB Preview Download
md5:0be00cd1f6ac0ef76916eb8dccb6528b
100.8 kB Preview Download
md5:a0bc72f536b77aaa4da182426f357e7f
183.4 kB Preview Download
md5:32fe513d649665af9690a71a3d68ecd3
44.9 kB Preview Download
md5:9e7160ded35cc62fa493cbc8a094b30a
78.2 kB Preview Download
md5:e293eb9d4e2968bcfa360d56592dc4f5
4.8 MB Preview Download

Additional details

Software

Repository URL
https://github.com/ruxailab/RUXAILAB
Development Status
Active