Estimating Usage Of Open Source Projects - Flutter Telemetry Case Study - MSR' 24
Authors/Creators
Description
This dataset (CSV) was assembled to support analysis within a case study that will be published in the proceedings of the Mining Software Repositories conference (MSR ‘24) April 14-15 2024: Estimating Usage Of Open Source Projects.
This case study explored whether publicly available metrics could serve as proxies to estimate usage of an open source project. Using the Flutter project as our case study, we collected monthly proxy metrics from GitHub, StackOverflow and Slack to compare with Flutter’s monthly active user count over the same time period: January 2018 through February 2021.
All metrics correspond to the last day of the month and/or represent aggregate activity in that month. Data from GitHub shows aggregate activity counts across the entire Flutter GitHub organization (up to 33 repositories).
Our specific metrics include:
|
Source |
Metric |
Aggregation method |
Details |
|
Flutter |
Monthly Active Users (MAU) |
Google internal tooling |
Flutter users active in the last 30 days, collected on the last day of each month |
|
GitHub |
PullRequest Authors in month |
GrimoireLab, hosted by bitergia.com |
As Google governs changes to this code base, we excluded known Google employees in code change related metrics |
|
GitHub |
Issues Created in month |
GrimoireLab, hosted by bitergia.com |
|
|
GitHub |
Issue Authors in month |
GrimoireLab, hosted by bitergia.com |
|
|
GitHub |
Fork events in month |
||
|
GitHub |
Fork cumulative count at the end of month |
||
|
StackOverflow |
Question Authors in month |
GrimoireLab, hosted by bitergia.com |
|
|
StackOverflow |
Questions in month |
GrimoireLab, hosted by bitergia.com |
|
|
Slack |
Claimed (cumulative) members at the end of the month |
fluttercommunity.slack |
|
|
Slack |
Cumulative messages at the end of the month |
fluttercommunity.slack |
Tools:
-
We used an instance of GrimoireLab hosted by Bitergia to aggregate GitHub PullRequest Authors, GitHub Issue Authors, GitHub Issues, across all repositories under the Flutter Organization, and StackOverflow Question Authors, and StackOverflow Questions for questions that mention Flutter. We used the Sorting Hat of feature GrimoireLab to identify Google employees in this sample.
-
GHArchive via BigQuery was used to count GitHub Star and Fork events across all repositories under the Flutter Organization
-
We pulled Slack activity directly from Flutter's slack channel dashboard
Files
MSR 2024_ Estimating Usage of Open Source Projects - Summary Table.csv
Files
(4.5 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:ce3ad2cb5214f6d88a8ccc13cd9b1e08
|
4.5 kB | Preview Download |
Additional details
Related works
- Is described by
- Conference proceeding: 10.1145/3643991.3645066 (DOI)