Published December 20, 2025 | Version v1.0.0
Software Open

Replication Package: Early-Stage Prediction of Review Effort in AI-Generated Pull Requests (MSR 2026 Mining Challenge)

Authors/Creators

Description

This repository contains the replication package for the MSR 2026 Mining Challenge paper “Early-Stage Prediction of Review Effort in AI-Generated Pull Requests”. It includes scripts to extract creation-time (T0) features from the AIDev dataset, train/evaluate the triage models (LightGBM and baselines), and reproduce the main tables/figures reported in the paper (performance, top-K utility, calibration, robustness checks). The package is anonymized for double-blind review; dataset access follows the AIDev preprint and official download instructions. See README inside the zip for step-by-step reproduction.

Files

zenodo-msr2026-replication-package.zip

Files (68.2 kB)

Name Size Download all
md5:54db471c0f09528bb6a7904c23aa223f
68.2 kB Preview Download

Additional details

Dates

Collected
2025-10/2025-12
Artifact preparation

Software

Programming language
Python
Development Status
Active

References

  • Li, Hao et al. The Rise of AI Teammates in Software Engineering (SE) 3.0: How Autonomous Coding Agents Are Reshaping Software Engineering. arXiv:2507.15003 (2025).