The Debsources Dataset: Two Decades of Free and Open Source Software
Authors/Creators
- 1. Université Grenoble Alpes, Grenoble, France
- 2. University of Victoria, Victoria, Canada
- 3. University Paris Diderot and Inria, France
Description
This is the Debsources Dataset: source code and related metadata spanning two decades of Free and Open Source Software (FOSS) history, seen through the lens of the Debian distribution.
The dataset spans more than 3 billion lines of source code as well as metadata about them such as: size metrics (lines of code, disk usage), developer-defined symbols (ctags), file-level checksums (SHA1, SHA256, TLSH), file media types (MIME), release information (which version of which package containing which source code files has been released when), and license informa-
tion (GPL, BSD, etc).
The Debsources Dataset comes as a set of tarballs containing deduplicated unique source code files organized by their SHA1 checksums (the source code), plus a portable PostgreSQL database dump (the metadata).
The Debsources Dataset is described in full in the paper The Debsources Dataset: Two Decades of Free and Open Source Software, published on the Empirical Software Engineering journal with DOI 10.1007/s10664-016-9461-5 . A preprint of the paper is available at https://upsilon.cc/~zack/research/publications/debsources-ese-2016.pdf .
Files
debsources.sha1.txt
Files
(97.9 GB)
| Name | Size | Download all |
|---|---|---|
|
md5:d2701ba63baa4279478b9c0a22d3dcfe
|
3.3 GB | Download |
|
md5:7e724da33b8b83eab284434a74c9d6d6
|
441.7 MB | Download |
|
md5:fa126cab56329758351bd2b8cb93a8a5
|
5.8 GB | Download |
|
md5:32503abedf157e26653ff8e81494feb8
|
5.7 GB | Download |
|
md5:ad48cb608f589a59d6397f53d7357231
|
6.1 GB | Download |
|
md5:6ff2516443bb66c852b60e3cff9a614f
|
5.6 GB | Download |
|
md5:a2f0857426518ebc588ba673e0594417
|
6.4 GB | Download |
|
md5:be4fc75efe301657c7b91847b29b44aa
|
5.8 GB | Download |
|
md5:76cec73dbb9bd567b3006eb7227d1e4b
|
5.6 GB | Download |
|
md5:f46066fb400dcd28f70e7c3e8062bbe8
|
6.2 GB | Download |
|
md5:6860ce355eb3fd3208c2a9a404e16e1b
|
5.4 GB | Download |
|
md5:294d3136f16272cedf1c573dc44f1089
|
5.8 GB | Download |
|
md5:fd13839b3e86431797b756476932fe52
|
6.1 GB | Download |
|
md5:d0503d3f6b31ba862505ba5e601775e0
|
5.6 GB | Download |
|
md5:38807480928d5f4c8208d2a0fcf87681
|
6.1 GB | Download |
|
md5:0c13eb03cfe4797a66272ec35d817dcc
|
6.6 GB | Download |
|
md5:1e955d5f8fa268bdb43fb30f11a389f6
|
5.5 GB | Download |
|
md5:d5d9f3a65443e9f503f3cec3cc938251
|
5.9 GB | Download |
|
md5:30716715fa6a3b7df9de5b33aa2878ec
|
1.1 kB | Preview Download |
|
md5:727cc47e1f7768aa0827637a1562d795
|
2.2 MB | Download |
|
md5:f0a9845621ced3490c92ff53cd562748
|
35.9 MB | Download |
Additional details
Related works
- Is new version of
- 10.5281/zenodo.16106 (DOI)
- Is supplement to
- 10.1007/s10664-016-9461-5 (DOI)