Conference paper Open Access

What Makes an Image Tagger Fair? Proprietary Auto-tagging and Interpretations on People Images

Barlas Pinar; Kleanthous Styliani; Kyriakou Kyriakos; Otterbacher Jahna


JSON-LD (schema.org) Export

{
  "inLanguage": {
    "alternateName": "eng", 
    "@type": "Language", 
    "name": "English"
  }, 
  "description": "<p>Image analysis algorithms have been a boon to personalization in digital systems and are now widely available via easy-to-use APIs.<br>\nHowever, it is important to ensure that they behave fairly in applications that involve processing images of people, such as dating apps. We conduct an experiment to shed light on the factors influencing the perception of &ldquo;fairness.&quot; Participants are shown a photo along with two descriptions (human- and algorithm-generated). They are then asked to indicate which is &ldquo;more fair&quot; in the context of a dating site, and explain their reasoning. We vary a number of factors, including the gender, race and attractiveness of the person in the photo. While participants generally found human-generated tags to be more fair, API tags were judged as being more fair in one setting - where the image depicted an &ldquo;attractive,&quot; white individual. In their explanations, participants often mention accuracy, as well as the objectivity/subjectivity of the tags in the description. We relate our work to the ongoing conversation about fairness in opaque tools like image tagging APIs, and their potential to result in harm.</p>", 
  "license": "https://creativecommons.org/licenses/by-nc-nd/4.0/legalcode", 
  "creator": [
    {
      "affiliation": "Research centre for Interactive media, Smart systems and Emerging technologies Nicosia, Cyprus", 
      "@id": "https://orcid.org/0000-0002-7882-7927", 
      "@type": "Person", 
      "name": "Barlas Pinar"
    }, 
    {
      "affiliation": "Cyprus Center for Algorithmic Transparency Open University of Cyprus Nicosia, Cyprus", 
      "@id": "https://orcid.org/0000-0003-1594-1340", 
      "@type": "Person", 
      "name": "Kleanthous Styliani"
    }, 
    {
      "affiliation": "Research centre for Interactive media, Smart systems and Emerging technologies Nicosia, Cyprus", 
      "@type": "Person", 
      "name": "Kyriakou Kyriakos"
    }, 
    {
      "affiliation": "Cyprus Center for Algorithmic Transparency Open University of Cyprus Nicosia, Cyprus", 
      "@id": "https://orcid.org/0000-0002-7655-7118", 
      "@type": "Person", 
      "name": "Otterbacher Jahna"
    }
  ], 
  "headline": "What Makes an Image Tagger Fair? Proprietary Auto-tagging and Interpretations on People Images", 
  "image": "https://zenodo.org/static/img/logos/zenodo-gradient-round.svg", 
  "datePublished": "2019-10-30", 
  "url": "https://zenodo.org/record/3522924", 
  "version": "Accepted pre-print", 
  "@type": "ScholarlyArticle", 
  "keywords": [
    "algorithmic bias", 
    "computer vision", 
    "fairness", 
    "image analysis"
  ], 
  "@context": "https://schema.org/", 
  "identifier": "https://doi.org/10.5281/zenodo.3522924", 
  "@id": "https://doi.org/10.5281/zenodo.3522924", 
  "workFeatured": {
    "url": "http://www.cyprusconferences.org/umap2019/", 
    "alternateName": "UMAP '19", 
    "location": "Larnaca, Cyprus", 
    "@type": "Event", 
    "name": "The 27th ACM Conference on User Modeling, Adaptation and Personalization"
  }, 
  "name": "What Makes an Image Tagger Fair? Proprietary Auto-tagging and Interpretations on People Images"
}
42
25
views
downloads
All versions This version
Views 4243
Downloads 2525
Data volume 138.1 MB138.1 MB
Unique views 3738
Unique downloads 2424

Share

Cite as