Shaken not Stirred: Understanding and Preparing to Support Research Transparency through Publication Validation

As Heliophysics transitions to open science practices, we face a crisis where many important published results cannot be reproduced even by the authors themselves shortly after publication. Such a lack of research transparency prevents important progress across our field, including model validation efforts, event catalog creation, and machine learning and AI developments. This work will: 
(1) Define and present motivation for publication validation based on many studies of replication and reproducibility, 
(2) Outline the spectrum of open science possible for publications, ranging from the closed formats of previous generations to easily findable and completely executable work, and 
(3) Recommend a feasible minimum standard to require of publications to make validation possible and useful, and additional best practices to help publications be born transparent. 
Based on these considerations, a new more efficient infrastructure design will be proposed to support publication validation both in Heliophysics and across the sciences, which will require cloud technology for collaborative validation efforts. Iterations on the spectrum of tasks presented and the minimum standard and best practices proposed are expected to occur in an upcoming community workshop in the near future, with the goal of producing a public rubric for proposal and performance reviewers to better rank research proposals based on their open science activities and products.