Published January 22, 2026 | Version v2
Software Open

Artifact for "LGTM! Characteristics of Auto-Merged LLM-based Agentic PRs"

  • 1. ROR icon Carnegie Mellon University
  • 2. ROR icon University of Lisbon
  • 3. Universidade de Lisboa Faculdade de Ciências
  • 4. Universidade de Lisboa

Description

AI tools are generating code faster than humans can properly review it, leading repositories to skip review and auto-merge agentic Pull Requests (PR) directly. In our study, we analyze the characteristics of auto-merged agentic PRs and compare them to human-authored ones. We examine code characteristics, repository ecosystems, and agentic tools across the AIDev dataset, spanning diverse software engineering tasks. In this artifact, we provide the source-code, mined data, and scripts to analyze the data. We find that auto-merged PRs are smaller and more focused, and that repositories tend to either auto-merge all or none agentic PRs, with more mature repositories favoring the latter. Compared to human-authored auto-merges, maintainers auto-merge agentic PRs more often but show caution toward PRs that delete existing code. Among agents, OpenAI Codex and Claude Code receive the highest auto-merge rates. These findings can inform agentic tool design and repository's auto-merge decisions.

Files

lgtm-msr26.zip

Files (7.0 MB)

Name Size Download all
md5:00192e27377538a8c7abb9a1f57fc112
7.0 MB Preview Download