Implicit Biases in Research Evaluation - TIER - CoARA, June 27th, 2025, Coniglione M.
Authors/Creators
-
1.
University of Milano-Bicocca
Description
This presentation stems from a survey addressed to researchers in academic institutions and funding agencies, aimed at understanding perceptions of research evaluation and excellence across Europe and beyond, conducted within the TIER (Towards an Inclusive Evaluation of Research) working group of CoARA and presented during an online TIER workshop, the 27th June, 2025.
Specifically, these slides present an approach to detecting implicit biases — particularly those related to gender — in evaluation settings. The core finding is that language framing can be used as a proxy for measuring biases that would not otherwise be openly acknowledged. From the survey, which reached approximately 2,000 researchers, it emerged that respondents changed their assessments of stereotypical statements when the same content was expressed using different framings. This led us to investigate the underlying cognitive mechanisms more deeply, with the aim of identifying possible solutions for more equitable practices in research evaluation settings.
Files
Implicit_bias_27june25_TIER_Coniglione.pdf
Files
(3.5 MB)
| Name | Size | Download all |
|---|---|---|
|
md5:0f6e0e68fdb73564753b1a73c929e948
|
3.5 MB | Preview Download |
Additional details
Dates
- Created
-
2025-06-27Discussed during TIER online workshop "Inclusive Excellence: How and Why?"
References
- Boroditsky, L. (2011). How language shapes thought. Scientific American, 304(2), 62–65. https://doi.org/10.1038/scientificamerican0211-62
- Lupyan, G. (2016). The centrality of language in human cognition. Language Learning, 66(3), 516–553. https://doi.org/10.1111/lang.12155
- Flusberg, S. J., Holmes, K. J., Thibodeau, P. H., Nabi, R. L., & Matlock, T. (2024). The psychology of framing: How everyday language shapes the way we think, feel, and act. Psychological Science in the Public Interest, 25(1), 1–61. https://doi.org/10.1177/15291006241246966
- Tversky, A., & Kahneman, D. (1981). The framing of decisions and the psychology of choice. Science, 211(4481), 453–458. https://doi.org/10.1126/science.7455683
- Entman, R. M. (1993). Framing: Toward clarification of a fractured paradigm. Journal of Communication, 43(4), 51–58. https://doi.org/10.1111/j.1460-2466.1993.tb01304.x
- Kahneman, D. (2011). Thinking, fast and slow. Farrar, Straus and Giroux.
- Bargh, J. A., & Chartrand, T. L. (1999). The unbearable automaticity of being. American Psychologist, 54(7), 462–479. https://doi.org/10.1037/0003-066X.54.7.462
- Greenwald, A. G., Dasgupta, N., Dovidio, J. F., Kang, J., Moss-Racusin, C. A., & Teachman, B. A. (2022). Implicit-bias remedies: Treating discriminatory bias as a public-health problem. Psychological Science in the Public Interest, 23(1), 7–40. https://doi.org/10.1177/15291006211070781
- Tourangeau, R., & Yan, T. (2007). Sensitive questions in surveys. Psychological Bulletin, 133(5), 859–883. https://doi.org/10.1037/0033-2909.133.5.859
- Lupyan, G., & Clark, A. (2015). Words and the world: Predictive coding and the language-perception-cognition interface. Current Directions in Psychological Science, 24(4), 279–284. https://doi.org/10.1177/0963721415570732
- Régner, I., Thinus-Blanc, C., Netter, A., Schmader, T., & Huguet, P. (2019). Committees with implicit biases promote fewer women when they do not believe gender bias exists. Nature Human Behaviour, 3(11), 1171–1179. https://doi.org/10.1038/s41562-019-0686-3