Software Open Access

Replication package for identify bot comments

Mehdi Golzadeh; Alexandre Decan; Eleni Constantinou; Tom Mens

This repository contains the replication package for our study about identifying bots at the level of their activity in GitHub submitted to BotSE'21 conference (*"Identifying bot activity in GitHub pull request and issue comments"*).
A link to the paper will be added to this README as soon as the paper is accepted.

Ground-truth dataset
The dataset is extracted from the ground-truth dataset of our study about [identifying bots](https://arxiv.org/abs/2010.03303) published in JSS journal.

Replication package

A- Dataset preparation.ipynb: This notebook splits the dataset to two disjoint set for training and test purposes. To avoid any conflict with GDPR regulations we've anonymised the account name columns.

B- Model construction.ipynb: We followed a Grid-search cross validation in this notebook to find the best classifier and construct the final mode. The replication package was originally created on Python 3.8  and the dependencies required to run these notebooks are listed in requirements.txt and can be automatically installed using pip install -r requirements.txt.

C- Model evaluation.ipynb: this notebook contains scripts to evaluate the classifier.

Files (9.3 MB)
Name Size
comments_classification_replicationpackage.zip
md5:b9b8dc427ad45b78f5cbf4e1b6c4e10d
9.3 MB Download
45
10
views
downloads
All versions This version
Views 4540
Downloads 1010
Data volume 92.6 MB92.6 MB
Unique views 4138
Unique downloads 1010

Share

Cite as