Conference paper Open Access

Social B(eye)as: Human andMachine Descriptions of People Images

Pınar Barlas; Kyriakos Kyriakou; Styliani Kleanthous; Jahna Otterbacher


JSON-LD (schema.org) Export

{
  "inLanguage": {
    "alternateName": "eng", 
    "@type": "Language", 
    "name": "English"
  }, 
  "description": "<p>Image analysis algorithms have become an indispensable tool in our information ecosystem, facilitating new forms of visual communication and information sharing. At the same time, they enable large-scale sociotechnical research which would otherwise be difficult to carry out. However, their outputs may exhibit social bias, especially when analyzing people images. Since<br>\nmost algorithms are proprietary and opaque, we propose a method of auditing their outputs for social biases. To be able to compare how algorithms interpret a controlled set of people images, we collected descriptions across six image tagging APIs. In order to compare these results to human behavior, we also collected descriptions on the same images from crowdworkers in two anglophone regions. While the APIs do not output explicitly offensive descriptions, as humans do, future work should consider if and how they reinforce social inequalities in implicit ways. Beyond computer vision auditing, the dataset of human- and machine-produced<br>\ntags, and the typology of tags, can be used to explore a range of research questions related to both algorithmic<br>\nand human behaviors.</p>", 
  "license": "http://creativecommons.org/licenses/by-nc-nd/4.0/legalcode", 
  "creator": [
    {
      "affiliation": "Research Centre on Interactive Media, Smart Systems and Emerging Technologies (Nicosia, CYPRUS)", 
      "@type": "Person", 
      "name": "P\u0131nar Barlas"
    }, 
    {
      "affiliation": "Research Centre on Interactive Media, Smart Systems and Emerging Technologies (Nicosia, CYPRUS)", 
      "@type": "Person", 
      "name": "Kyriakos Kyriakou"
    }, 
    {
      "affiliation": "Research Centre on Interactive Media, Smart Systems and Emerging Technologies (Nicosia, CYPRUS) and Cyprus Center for Algorithmic Transparency, Open University of Cyprus (Latsia, CYPRUS)", 
      "@type": "Person", 
      "name": "Styliani Kleanthous"
    }, 
    {
      "affiliation": "Research Centre on Interactive Media, Smart Systems and Emerging Technologies (Nicosia, CYPRUS) and Cyprus Center for Algorithmic Transparency, Open University of Cyprus (Latsia, CYPRUS)", 
      "@type": "Person", 
      "name": "Jahna Otterbacher"
    }
  ], 
  "headline": "Social B(eye)as: Human andMachine Descriptions of People Images", 
  "image": "https://zenodo.org/static/img/logos/zenodo-gradient-round.svg", 
  "datePublished": "2019-10-30", 
  "url": "https://zenodo.org/record/3522936", 
  "version": "Published", 
  "keywords": [
    "APIs", 
    "image tagging", 
    "social biases"
  ], 
  "@context": "https://schema.org/", 
  "identifier": "https://doi.org/10.7910/DVN/APZKSS", 
  "@id": "https://doi.org/10.7910/DVN/APZKSS", 
  "@type": "ScholarlyArticle", 
  "name": "Social B(eye)as: Human andMachine Descriptions of People Images"
}
18
11
views
downloads
Views 18
Downloads 11
Data volume 10.7 MB
Unique views 16
Unique downloads 10

Share

Cite as