IPBES Transformative Change Assessment Chapter 2. Data Management Report 2.13 Intercoder reliability within the vision database

The review corresponds to the IPBES Transformative Change Assessment. The IPBES scoping document for the transformative change assessment describes that Chapter 2 should examine the implications of different visions for sectors, sub-systems (including economic/market, financial, political, legal/judicial, educational, Indigenous and local systems, and ecosystems) and the interactions between them, at different spatial scales.

In this context, Chapter 2 experts collected Visions of a sustainable world for nature and people from multiple sources. They coded each vision according to 13 categories of variables (eg., geographic scope of vision). To assess the consistency of vision coding, an intercoder reliability (ICR) evaluation was conducted. ICR is widely recognized as a best practice to evaluate the quality of coding applied to categorical data, ensuring that the coding frame and its application are credible, consistent, and transparent.