Published September 11, 2025
| Version v1
Journal article
Open
Explainable AI for EU AI Act compliance audits
Authors/Creators
- 1. Protiviti, Amsterdam, Netherlands
Description
Internal auditors play a key role in ensuring artificial intelligence (AI) compliance with the EU AI Act. This article will examine how Explainable AI (XAI) can play a critical role in assessing AI systems for meeting the specific requirements of transparency, human oversight, and fairness. When effectively implemented, XAI enables traceability, accountability, intervention in AI decisions and can be used as a tool by internal auditors. Effective AI compliance auditing requires understanding of the methods for AI monitoring, associated documentation, and user feedback mechanisms to assess risks, regulatory requirements, and ethical standards.
Files
MAB_article_150303.pdf
Files
(8.7 MB)
| Name | Size | Download all |
|---|---|---|
|
md5:c36d84f28d67f40a73ecefbf14cdf4b3
|
8.6 MB | Preview Download |
|
md5:0fb279aa52e4ced6a84f5b13414ec4cb
|
120.1 kB | Preview Download |
Additional details
References
- Breiman L (2001) Random Forests. Machine Learning 45: 5–32. https://doi.org/10.1023/A:1010933404324
- Chuan CH, Sun R, Tian S, Tsai WHS (2024) EXplainable Artificial Intelligence (XAI) for facilitating recognition of algorithmic bias: An experiment from imposed users' perspectives. Telematics and Informatics 91: 102135. https://doi.org/10.1016/j.tele.2024.102135
- Deck L, Schoeffer J, De-Arteaga M, Kühl N (2023) A critical survey on fairness benefits of XAI. XAI in Action: Past, Present, and Future Applications (preprint). https://doi.org/10.1145/3630106.3658990
- Dwork C, Hardt M, Pitassi T, Reingold O, Zemel R (2012) Fairness through awareness. In: Proceedings of the 3rd Innovations in Theoretical Computer Science Conference, 214–226. https://doi.org/10.1145/2090236.2090255
- ECIIA (2024) The AI Act: Road to compliance. A Practical Guide for Internal Auditors. https://www.eciia.eu/wp-content/uploads/2025/01/The-AI-Act-Road-to-Compliance-Final.pdf
- EP (2016) Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC. https://eur-lex.europa.eu/eli/reg/2016/679/oj/eng
- EP (2024) Regulation (EU) 2024/1689 of the European Parliament and of the Council of 13 June 2024 laying down harmonised rules on artificial intelligence. https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=OJ:L_202401689
- Ferreira L (2018) German Credit Risk – With Target. Kaggle. https://www.kaggle.com/datasets/kabure/german-credit-data-with-risk
- Fügener A, Grahl J, Gupta A, Ketter W (2021) Will humans-in-the-loop become borgs? Merits and pitfalls of working with AI. Management Information Systems Quarterly 45(3): 1527–1556. https://ssrn.com/abstract=3879937
- Gerlings J, Shollo A, Constantiou I (2020) Reviewing the need for explainable artificial intelligence (xAI). https://doi.org/10.24251/HICSS.2021.156
- Haque AKMB, Islam AKMN, Mikalef P (2023) Explainable Artificial Intelligence (XAI) from a user perspective: A synthesis of prior literature and problematizing avenues for future research. Technological Forecasting and Social Change 186: 122120. https://doi.org/10.1016/j.techfore.2022.122120
- Hofeditz L, Clausen S, Reiß A, Mirbabaie M, Stieglitz S (2022) Applying XAI to an AI-based system for candidate management to mitigate bias and discrimination in hiring. Electronic Markets 32(4): 2207–2233. https://doi.org/10.1007/s12525-022-00600-9
- Hofmann H (1994) Statlog (German Credit Data) [Dataset]. UCI Machine Learning Repository. https://archive.ics.uci.edu/dataset/144/statlog+german+credit+data
- IAASB (2013) International Standard on Assurance Engagements (ISAE) 3000 Revised: Assurance engagements other than audits or reviews of historical financial information. [ISBN 978-1-60815-167-7] https://www.iaasb.org/publications/international-standard-assurance-engagements-isae-3000-revised-assurance-engagements-other-audits-or
- IAASB (2024) Handbook of international quality management, auditing, review, other assurance, and related services pronouncements. https://www.iaasb.org/publications/2023-2024-handbook-international-quality-management-auditing-review-other-assurance-and-related
- ISO (2022) ISO/IEC 22989:2022: Information technology — Artificial intelligence — Artificial intelligence concepts and terminology.
- ISO (2023) ISO/IEC 23894:2023: Information technology — Artificial intelligence — Guidance on risk managementLaux J (2023) Institutionalised distrust and human oversight of artificial intelligence: towards a democratic design of AI governance under the European Union AI Act. AI & Society, 1–14. https://doi.org/10.1007/s00146-023-01777-z
- Longo L, Brcic M, Cabitza F, Choi J, Confalonieri R, Ser JD, Guidotti R, Hayashi Y, Herrera F, Holzinger A, Jiang R, Khosravi H, Lecue F, Malgieri G, Páez A, Samek W, Schneider J, Speith T, Stumpf S (2024) Explainable artificial intelligence (XAI) 2.0: A manifesto of open challenges and interdisciplinary research directions. Information Fusion 106: 102301. https://doi.org/10.1016/j.inffus.2024.102301
- Lundberg SM, Lee SI (2017) A unified approach to interpreting model predictions. CoRR abs/1705.07874. https://doi.org/10.48550/arXiv.1705.07874
- McDermid JA, Jia Y, Porter Z, Habli I (2021) Artificial intelligence explainability: the technical and ethical dimensions. Philosophical Transactions of the Royal Society A 379(2207): 20200363. https://doi.org/10.1098/rsta.2020.0363
- Molnar C (2019) Interpretable machine learning. https://christophm.github.io/interpretable-ml-book/
- NIST (2023) Artificial Intelligence Risk Management Framework (AI RMF 1.0). https://doi.org/10.6028/NIST.AI.100-1
- Panigutti C, Hamon R, Hupont I, Llorca DF, Yela DF, Junklewitz H, Scalzo S, Mazzini G, Sanchez I, Garrido JS, Gomez E (2023) The role of explainable AI in the context of the AI Act. In: Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency. New York, NY, USA: Association for Computing Machinery, 1139–1150. https://doi.org/10.1145/3593013.3594069
- Ribeiro MT, Singh S, Guestrin C (2016) "Why should I trust you?": Explaining the predictions of any classifier. CoRR abs/1602.04938. https://doi.org/10.18653/v1/N16-3020
- Sandu I, Wiersma M, Manichand D (2022) Time to audit your AI algorithms. Maandblad voor Accountancy en Bedrijfseconomie 96(7/8): 253–265. https://doi.org/10.5117/mab.96.90108
- Schemmer M, Kühl N, Benz C, Satzger G (2022) On the influence of explainable AI on automation bias. https://doi.org/10.48550/arXiv.2204.08859
- The IIA (2023) The IIA's Artificial Intelligence Auditing Framework. https://www.theiia.org/en/content/tools/professional/2023/the-iias-updated-ai-auditing-framework/
- The IIA (2024) Global Internal Audit Standards. https://www.theiia.org/en/standards/2024-standards/global-internal-audit-standards/
- Wörsdörfer M (2024) Mitigating the adverse effects of AI with the European Union's artificial intelligence act: Hype or hope? Global Business and Organizational Excellence 43(3): 106–126. https://doi.org/10.2139/ssrn.4630087
- Y S, Challa M (2023) A comparative analysis of explainable AI techniques for enhanced model interpretability. In: 3rd International Conference on Pervasive Computing and Social Networking (ICPCSN), Salem, India, 229–234. https://doi.org/10.1109/ICPCSN58827.2023.00043
- Zhang C, Cho S, Vasarhelyi M (2022) Explainable artificial intelligence (XAI) in auditing. International Journal of Accounting Information Systems 46: 100572. https://doi.org/10.1016/j.accinf.2022.100572