Conference paper Open Access
Fairness in Proprietary Image Tagging Algorithms: A Cross-Platform Audit on People Images
Kyriakou Kyriakos;
Barlas Pınar;
Kleanthous Styliani;
Otterbacher Jahna
There are increasing expectations that algorithms should behave in a manner that is socially just. We consider the case of
image tagging APIs and their interpretations of people images. Image taggers have become indispensable in our information
ecosystem, facilitating new modes of visual communication and sharing. Recently, they have become widely available as Cognitive Services. But while tagging APIs offer developers an inexpensive and convenient means to add functionality to their creations, most are opaque and proprietary. Through a cross-platform comparison of six taggers, we show that behaviors differ significantly. While some offer more interpretation on images, they may exhibit less fairness toward the depicted persons, by misuse of gender-related
tags and/or making judgments on a person’s physical appearance. We also discuss the difficulties of studying fairness in situations where algorithmic systems cannot be benchmarkedagainst a ground truth.
| Name | Size | |
|---|---|---|
|
ICWSM_tagging.pdf
md5:2e6c32301a60b76c422fcc28f48ba07e |
1.3 MB | Download |
| All versions | This version | |
|---|---|---|
| Views | 27 | 27 |
| Downloads | 24 | 24 |
| Data volume | 32.3 MB | 32.3 MB |
| Unique views | 25 | 25 |
| Unique downloads | 22 | 22 |
- Publication date:
- October 30, 2019
- DOI:
-
- ISBN:
- 978-1-57735-806-0
- Keyword(s):
- image tagging APIs
- Published in:
- Proceedings of the International AAAI Conference on Web and Social Media, 13(01), Association for the Advancement of Artificial Intelligence, Menlo Park, California, United States, pp. 313-322 (978-1-57735-806-0).
- Grants:
-
European Commission:
-
CyCAT - Cyprus Center for Algorithmic Transparency (810105)
- RISE - Research Center on Interactive Media, Smart System and Emerging Technologies (739578)
-
CyCAT - Cyprus Center for Algorithmic Transparency (810105)
- Communities:
- License (for files):
- Creative Commons Attribution Non Commercial No Derivatives 4.0 International