Simple Measures to Improve Accountability in Peer Review for Large AI Conferences

I discuss a number of simple measures designed to improve the quality of peer review for large conferences, specifically regarding the accountability of reviewers for their crucial contributions. These measures seem to have had a positive impact for the two large AI conferences I chaired in the recent past, AAMAS-2021 (with 600+ submissions) and ECAI-2024 (with 2,300+ submissions).

This discussion paper was prepared for the Workshop on Practical Improvements to Peer Review (PIPeR), held as part of the workshop programme of the 24th International Conference on Autonomous Agents and Multiagent Systems (AAMAS-2025)  in Detroit, Michigan, on 20 May 2025.