Conference paper Open Access

What Makes an Image Tagger Fair? Proprietary Auto-tagging and Interpretations on People Images

Barlas Pinar; Kleanthous Styliani; Kyriakou Kyriakos; Otterbacher Jahna


MARC21 XML Export

<?xml version='1.0' encoding='UTF-8'?>
<record xmlns="http://www.loc.gov/MARC21/slim">
  <leader>00000nam##2200000uu#4500</leader>
  <datafield tag="041" ind1=" " ind2=" ">
    <subfield code="a">eng</subfield>
  </datafield>
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">algorithmic bias</subfield>
  </datafield>
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">computer vision</subfield>
  </datafield>
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">fairness</subfield>
  </datafield>
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">image analysis</subfield>
  </datafield>
  <controlfield tag="005">20200120145304.0</controlfield>
  <datafield tag="500" ind1=" " ind2=" ">
    <subfield code="a">This work has been partly supported by the project that has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 739578 (RISE – Call: H2020-WIDESPREAD-01-2016-2017-TeamingPhase2) and the Government of the Republic of Cyprus through the Directorate General for European Programmes, Coordination and Development.</subfield>
  </datafield>
  <controlfield tag="001">3522924</controlfield>
  <datafield tag="711" ind1=" " ind2=" ">
    <subfield code="d">9-12 June 2019</subfield>
    <subfield code="g">UMAP '19</subfield>
    <subfield code="a">The 27th ACM Conference on User Modeling, Adaptation and Personalization</subfield>
    <subfield code="c">Larnaca, Cyprus</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Cyprus Center for Algorithmic Transparency Open University of Cyprus Nicosia, Cyprus</subfield>
    <subfield code="0">(orcid)0000-0003-1594-1340</subfield>
    <subfield code="a">Kleanthous Styliani</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Research centre for Interactive media, Smart systems and Emerging technologies Nicosia, Cyprus</subfield>
    <subfield code="a">Kyriakou Kyriakos</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Cyprus Center for Algorithmic Transparency Open University of Cyprus Nicosia, Cyprus</subfield>
    <subfield code="0">(orcid)0000-0002-7655-7118</subfield>
    <subfield code="a">Otterbacher Jahna</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">5522547</subfield>
    <subfield code="z">md5:7770255913aba31a4f08837041d666a1</subfield>
    <subfield code="u">https://zenodo.org/record/3522924/files/UMAP_fairnessintagging_authorscopy.pdf</subfield>
  </datafield>
  <datafield tag="542" ind1=" " ind2=" ">
    <subfield code="l">open</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="y">Conference website</subfield>
    <subfield code="u">http://www.cyprusconferences.org/umap2019/</subfield>
  </datafield>
  <datafield tag="260" ind1=" " ind2=" ">
    <subfield code="c">2019-10-30</subfield>
  </datafield>
  <datafield tag="909" ind1="C" ind2="O">
    <subfield code="p">openaire</subfield>
    <subfield code="p">user-rise-teaming-cyprus</subfield>
    <subfield code="o">oai:zenodo.org:3522924</subfield>
  </datafield>
  <datafield tag="100" ind1=" " ind2=" ">
    <subfield code="u">Research centre for Interactive media, Smart systems and Emerging technologies Nicosia, Cyprus</subfield>
    <subfield code="0">(orcid)0000-0002-7882-7927</subfield>
    <subfield code="a">Barlas Pinar</subfield>
  </datafield>
  <datafield tag="245" ind1=" " ind2=" ">
    <subfield code="a">What Makes an Image Tagger Fair? Proprietary Auto-tagging and Interpretations on People Images</subfield>
  </datafield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">user-rise-teaming-cyprus</subfield>
  </datafield>
  <datafield tag="536" ind1=" " ind2=" ">
    <subfield code="c">810105</subfield>
    <subfield code="a">Cyprus Center for Algorithmic Transparency</subfield>
  </datafield>
  <datafield tag="536" ind1=" " ind2=" ">
    <subfield code="c">739578</subfield>
    <subfield code="a">Research Center on Interactive Media, Smart System and Emerging Technologies</subfield>
  </datafield>
  <datafield tag="540" ind1=" " ind2=" ">
    <subfield code="u">http://creativecommons.org/licenses/by-nc-nd/4.0/legalcode</subfield>
    <subfield code="a">Creative Commons Attribution Non Commercial No Derivatives 4.0 International</subfield>
  </datafield>
  <datafield tag="650" ind1="1" ind2="7">
    <subfield code="a">cc-by</subfield>
    <subfield code="2">opendefinition.org</subfield>
  </datafield>
  <datafield tag="520" ind1=" " ind2=" ">
    <subfield code="a">&lt;p&gt;Image analysis algorithms have been a boon to personalization in digital systems and are now widely available via easy-to-use APIs.&lt;br&gt;
However, it is important to ensure that they behave fairly in applications that involve processing images of people, such as dating apps. We conduct an experiment to shed light on the factors influencing the perception of &amp;ldquo;fairness.&amp;quot; Participants are shown a photo along with two descriptions (human- and algorithm-generated). They are then asked to indicate which is &amp;ldquo;more fair&amp;quot; in the context of a dating site, and explain their reasoning. We vary a number of factors, including the gender, race and attractiveness of the person in the photo. While participants generally found human-generated tags to be more fair, API tags were judged as being more fair in one setting - where the image depicted an &amp;ldquo;attractive,&amp;quot; white individual. In their explanations, participants often mention accuracy, as well as the objectivity/subjectivity of the tags in the description. We relate our work to the ongoing conversation about fairness in opaque tools like image tagging APIs, and their potential to result in harm.&lt;/p&gt;</subfield>
  </datafield>
  <datafield tag="773" ind1=" " ind2=" ">
    <subfield code="n">doi</subfield>
    <subfield code="i">isVersionOf</subfield>
    <subfield code="a">10.5281/zenodo.3522923</subfield>
  </datafield>
  <datafield tag="773" ind1=" " ind2=" ">
    <subfield code="g">95-103</subfield>
    <subfield code="b">ACM</subfield>
    <subfield code="a">New York</subfield>
    <subfield code="z">978-1-4503-6021-0</subfield>
    <subfield code="t">Proceedings of the 27th ACM Conference on User Modeling, Adaptation and Personalization</subfield>
  </datafield>
  <datafield tag="024" ind1=" " ind2=" ">
    <subfield code="a">10.5281/zenodo.3522924</subfield>
    <subfield code="2">doi</subfield>
  </datafield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">publication</subfield>
    <subfield code="b">conferencepaper</subfield>
  </datafield>
</record>
18
9
views
downloads
All versions This version
Views 1819
Downloads 99
Data volume 49.7 MB49.7 MB
Unique views 1617
Unique downloads 88

Share

Cite as