Published August 2, 2024 | Version v1

Self-Admitted Technical Debt in Scientific Software

  • 1. ROR icon University of Victoria

Description

# Title
Self-Admitted Technical Debt (SATD) in Scientific Software Projects

# Description
## Abstract
This dataset contains annotated code comments from nine open-source scientific software projects: Astropy, Biopython, CESM, Firedrake, MOOSE, GROMACS, Elmer, Athena, and Root. The comments are labeled to identify instances of Self-Admitted Technical Debt (SATD), with a focus on a novel category termed Scientific Debt (SD). The dataset supports research on the nature and management of technical debt in scientific software.

## Purpose
The dataset was created to explore the prevalence and characteristics of SATD in scientific software, with the aim of improving software maintainability and scientific validity.

## Content
The dataset includes over 28,680 annotated code comments, with labels indicating various types of technical debt such as Code Debt, Design Debt, and Scientific Debt. Each comment is accompanied by metadata including the project name, file path, comment introduction date, and comment removal date.

## Scope
The dataset covers nine projects across different scientific domains, including astronomy, molecular biology, and climate modeling. Data was collected from publicly available repositories and spans from the inception of each project to the present.

## Methodology
Data was extracted using GitPython to access the version control histories of the selected projects. Comments were manually labeled for SATD, with a focus on identifying Scientific Debt indicators such as assumptions, missing edge cases, computational inaccuracies, translation challenges, and new scientific findings.

## Usage Notes
This dataset can be used for research on technical debt management, software maintenance, and scientific software development. Users should have a basic understanding of programming and version control systems. Recommended tools for analysis include Python and Pandas.

## Ethical Considerations
All data was collected from publicly available sources. No personal or sensitive information is included.

# Technical Details
## File Formats
- CSV: Contains the annotated comments and metadata

## Size
- Number of records: 28,680
- Total file size: 15MB

## Version
- Version 1.0, July 2024

# Access and Use
## Access
The dataset can be downloaded from Zenodo: [Zenodo Link](https://doi.org/10.5281/zenodo.13174322)

## License
This dataset is licensed under the Creative Commons Attribution 4.0 International License (CC BY 4.0).

Files

ssw_satd.csv

Files (15.0 MB)

Name Size Download all
md5:357d318aefe22612bd68fc80ca0d56db
15.0 MB Preview Download

Additional details

Software

Repository URL
https://anonymous.4open.science/r/ScientificSATD-CBD0
Programming language
Python , Jupyter Notebook
Development Status
Active