Evaluation of Counterfactual Latent-Shift Audits for Artificial Intelligence Agriculture Yield Models Under Irrigation-Expansion Regimes: An Interpretability Extrapolation Bound for Smallholder Credit Scoring
Authors/Creators
- 1. Cairo University
Description
Smallholder credit scoring increasingly relies on yield models trained in rainfed districts and then applied to households entering newly irrigated schemes, where the joint distribution of covariates and yields shifts in ways that standard interpretability diagnostics do not detect. The audit is formalised as a constrained transport problem between the training and deployment latent distributions, and the bound is expressed as a function of the Wasserstein displacement of the latent representation and the local Lipschitz constant of the attribution map. A replication-based evaluation of the before-after-control-impact estimator was conducted to characterise the operating characteristics of the audit under a declared variance structure with between-cluster SD = 6.0, residual SD = 4.5 and intraclass correlation = 0.64; power was estimated across 2000 design cells for cluster counts of 8, 16, 24 and 32 and effects of 3, 5 and 8 percentage points. The design required 52 clusters to detect a 5 percentage point effect at 80% power. The bound implies that attribution stability, not attribution magnitude, is the quantity that credit committees should monitor when scoring households under irrigation expansion.
Notes
Files
article.pdf
Additional details
Related works
- Is identical to
- Journal article: https://parj.africa/ajai_artificial_intelligen_24/article/view/evaluation-of-counterfactual-latent-shift-audits-for (URL)
References
- Alvarez-Melis, D., & Jaakkola, T. S. (2018). On the robustness of interpretability methods. arXiv preprint arXiv:1806.08049.
- Ben-David, S., Blitzer, J., Crammer, K., Kulesza, A., Pereira, F., & Vaughan, J. W. (2010). A theory of learning from different domains. Machine Learning, 79(1-2), 151-175.
- Doshi-Velez, F., & Kim, B. (2017). Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608.
- Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., Marchand, M., & Lempitsky, V. (2016). Domain-adversarial training of neural networks. Journal of Machine Learning Research, 17(59), 1-35.
- Long, M., Cao, Z., Wang, J., & Jordan, M. I. (2018). Conditional adversarial domain adaptation. Advances in Neural Information Processing Systems, 31, 1640-1650.
- Lundberg, S. M., & Lee, S.-I. (2017). A unified approach to interpreting model predictions. Advances in Neural Information Processing Systems, 30, 4765-4774.
- Peyré, G., & Cuturi, M. (2019). Computational optimal transport. Foundations and Trends in Machine Learning, 11(5-6), 355-607.
- Ribeiro, M. T., Singh, S., & Guestrin, C. (2016). "Why should I trust you?" Explaining the predictions of any classifier. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 1135-1144.
- Rudin, C. (2019). Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence, 1(5), 206-215.
- Sugiyama, M., Krauledat, M., & Müller, K.-R. (2007). Covariate shift adaptation by importance weighted cross validation. Journal of Machine Learning Research, 8, 985-1005.
- Sundararajan, M., Taly, A., & Yan, Q. (2017). Axiomatic attribution for deep networks. Proceedings of the 34th International Conference on Machine Learning, 3319-3328.
- Villani, C. (2009). Optimal transport: Old and new. Springer.
- Xie, H., You, L., Wielgosz, B., & Ringler, C. (2014). Estimating the potential for expanding smallholder irrigation in Sub-Saharan Africa. Agricultural Water Management, 131, 183-193.
- You, L., Ringler, C., Wood-Sichra, U., Robertson, R., Wood, S., Zhu, T., Nelson, G., Guo, Z., & Sun, Y. (2011). What is the irrigation potential for Africa? A combined biophysical and socioeconomic approach. Food Policy, 36(6), 770-782.