Journal article Open Access
Augmenting Automated Kinship Verification with Targeted Human Input
Hettiachchi, D; van Berkel, N.; Hosio, S.; Lopez, M. B.; Kostakos, V.; Goncalves, J.
Kinship verification is the problem whereby a third party determines whether two people are related. Despite previous research in Psychology and Machine Vision, the factors affecting a person’s verification ability are poorly understood. Through an online crowdsourcing study, we investigate the impact of gender, race and medium type (image vs video) on kinship verification - taking into account the demographics of both raters and ratees. A total of 325 workers completed over 50,000 kinship verification tasks consisting of pairs of faces shown in images and videos from three widely used datasets. Our results identify an own-race bias and a higher verification accuracy for same-gender image pairs than opposite-gender image pairs. Our results demonstrate that humans can still outperform current state-of-the-art automated unsupervised approaches. Furthermore, we show that humans perform better when presented with videos instead of still images. Our findings contribute to the design of future human-in-the-loop kinship verification tasks, including time-critical use cases such as identifying missing persons.
| Name | Size | |
|---|---|---|
|
pacis20.pdf
md5:272ac471375d09e1491a1669c0587b8e |
520.0 kB | Download |
| All versions | This version | |
|---|---|---|
| Views | 29 | 29 |
| Downloads | 20 | 20 |
| Data volume | 10.4 MB | 10.4 MB |
| Unique views | 27 | 27 |
| Unique downloads | 19 | 19 |
- Publication date:
- June 1, 2020
- DOI:
-
- Meeting:
- Pacific Asian Conference on Information Systems (PACIS)
- License (for files):
- Creative Commons Attribution 4.0 International