Published March 26, 2021 | Version 1.0
Preprint Restricted

Sensitivity auditing: an important ingredient in the evaluation of models and metrics

  • 1. University of Reading
  • 2. University of Oxford
  • 3. Princeton University
  • 4. Universitat Oberta de Catalunya

Description

Mathematical models that draw inference on real systems often feed into the process of policy making. Crit- ical aspects of this science-policy interface must include: (i) acknowledge the limitations of the mathematical models, (ii) refrain from over-interpretation, and (iii) evaluate the robustness of the conclusions. Sensitivity auditing - a novel extension of sensitivity analysis, is shown here to be up to the tasks (i-iii) above. Sensitivity auditing proposes a seven-point checklist for the scrutiny of policy-relevant modelling activities and metrics (quantifications, in general). In this contribution, we review six real-world applications of sensitivity auditing to the modelling process of a range of socio-environmental systems. The examples show the flexibility of sen- sitivity auditing to illuminate crucial and hitherto neglected aspects of the working of models at the science, policy, and society nexus.

Files

Restricted

The record is publicly accessible, but files are restricted to users with access.

Additional details

Funding

European Commission
MC2020 – "Marie Curie Actions in Horizon 2020: regional and international impact" 319454