The STROBE Contradiction: When Reporting Guidelines Mask, Rather Than Constrain, Inferential Overreach

Abstract

Scientific reporting guidelines such as the STROBE Statement were established to ensure epistemic discipline in observational research by transparently delineating the boundaries of legitimate inference. They serve as a crucial safeguard, guaranteeing that scientific conclusions do not exceed the evidential support provided by the data. However, analysis of recent high-profile medical observational studies reveals a critical contradiction: formal compliance is increasingly prioritized over substantive application. This technical note documents a failure in editorial enforcement, highlighting a case where published results exhibited clear, numerical non-representativeness: a violation of STROBE principles concerning external validity and bias assessment (Items 21 and 12). By reconstructing crude incidence rates (CRs) directly from the published data and comparing them against national baseline statistics, we demonstrate that internally valid relative cancer risk estimates following COVID-19 vaccination were implicitly generalized as population-level signals, despite evidence of systematic sample divergence. We posit that if STROBE is consistently treated merely as a descriptive checklist rather than as an epistemically binding constraint, its presence undermines scientific integrity by creating a false sense of methodological rigor. Maintaining this symbolic framework is less honest than abolishing it. The scientific community must restore STROBE's intended role as an enforced boundary on unwarranted inference.