There is a newer version of this record available.

Software Open Access

(No) Influence of Continuous Integration on the Commit Activity in GitHub Projects — Supplementary Material

Baltes, Sebastian

Data collector(s)
Knack, Jascha

A core goal of Continuous Integration (CI) is to make small incremental changes to software projects, which are integrated frequently into a mainline repository or branch. Our paper presents an empirical study that investigates if developers adjust their commit activity towards the above-mentioned goal after projects start using CI. We analyzed the commit and merge activity in 93 GitHub projects that introduced the hosted CI system Travis CI, but have also been developed on GitHub for at least one year before introducing CI. In our analysis, we only found one non-negligible effect, an increased merge ratio, meaning that there were more merging commits in relation to all commits after the projects started using Travis CI. This effect has also been reported in related work. However, we observed the same effect in a random sample of 60 GitHub projects not using CI. Thus, it is unlikely that the effect is caused by the introduction of CI alone. We conclude that: (1) in our sample of projects, the introduction of CI did not lead to major changes in developers' commit activity, and (2) it is important to compare the commit activity to a baseline before attributing an effect to a treatment that may not be the cause for the observed effect.

To execute the analysis scripts, you also need to download the corresponding dataset: https://doi.org/10.5281/zenodo.1140260
Files (5.3 MB)
Name Size
3_merge_hash_count_branches.pdf
md5:44ab248da0f800093f95d5500a8a97a4
8.7 kB Download
3_projects_filtered_build_activity.csv
md5:6d259ac93eeb7d5fd03d05633e719471
7.1 kB Download
3_projects_filtered_commit_count.csv
md5:a8aed385bfe4232791d91a6debfa4452
10.6 kB Download
4_before_during_ci.sql
md5:ea15a5185e91132691f6e95a5180f229
13.9 kB Download
5_project_sample_languages.sql
md5:99cc30c55ad59e547b3c0e19911c8322
1.5 kB Download
6_commits_builds.sql
md5:63120620b89d181e71a39f12f771f6ab
4.6 kB Download
7_comparison_sample.sql
md5:ddb4e27b4082b2721ff459a8fb3bd29b
5.9 kB Download
analysis.zip
md5:b7a9af82a3a4dd1caf8abb8472cf5128
5.0 MB Download
bigquery-schema.zip
md5:0378325e5fd8dd1e523522cef00ecee5
1.4 kB Download
data-retrieval.zip
md5:033f65a517a044f455e7fa4ba72fdb24
290.4 kB Download
functions.R
md5:6bd22d3a45a65d339e31017b54efe948
3.0 kB Download
global.R
md5:50c23317ab83ac2b7efb1fce2658b098
12.1 kB Download
124
673
views
downloads
All versions This version
Views 12424
Downloads 67383
Data volume 260.4 MB27.1 MB
Unique views 11123
Unique downloads 32021

Share

Cite as