Empirical Software Engineering
Published August 29, 2025 | Version v4
Computational notebook Open

Replication package for the paper: "404: Civility Not Found? Evaluating the Effectiveness of Small Language Models in Detecting Incivility in GitHub Conversations"

Authors/Creators

  • 1. ROR icon Universidade Federal do Ceará
  • 2. ROR icon Pontifícia Universidade Católica do Rio de Janeiro
  • 3. PUC-Rio
  • 4. Universidade Estadual do Ceara Centro de Ciencias da Saude

Description

This repository contains the dataset, code, and other materials used in the study "404: Civility Not Found? Evaluating the Effectiveness of Small Language Models in Detecting Incivility in GitHub Conversations" accepted to the research track of the 39th Brazilian Symposium on Software Engineering (SBES). The downloadable .zip archive includes all necessary files to replicate the results presented in the paper. After unzipping, you will find instructions, scripts, and data organized to support the execution and reproduction of the analyses described in the paper.

Files

README.md

Files (163.1 MB)

Name Size Download all
md5:fa16691e0092f078dc8bf536b984ee60
609.9 kB Preview Download
md5:2e11f882372623e96848cb443dddc3ed
1.1 kB Preview Download
md5:30ff1f42d7965988d6a34e4b4689e909
8.1 kB Preview Download
md5:a1a63203778f67c76cd747600bbb7625
162.5 MB Preview Download

Additional details

Software

Repository URL
https://github.com/reset-ufc/slm-evaluation-incivility
Programming language
Python , Jupyter Notebook