Representation of Semantic Encoding in Low and Intermediate Level Visual Regions
Authors/Creators
- 1. Cognitive Computational Neuroscience Lab, Bilkent University
- 2. Division of Psychology and Language Sciences, University College London
- 3. Department of Neuroscience, Bilkent University
- 4. Computational Cognitive Neuroscience and Quantitative Psychiatry Justus-Liebig-Universität Gießen
Description
Understanding how the visual system processes and categorizes objects is a fundamental question in neuroscience. This study investigated whether early visual areas encode semantic category information independently of low-level visual features. Using fMRI data from the Kay Natural Images dataset, we focused on V1–V4 and LOC. We explored three binary distinctions: animate vs. inanimate, natural vs. human-made, and face-present vs face-absent. We also included an extended face category encompassing partial and animal faces. To address these questions, we used Representational Similarity Analysis (RSA) and controlled for low-level structure with features from AlexNet's Conv2 layer. Our results revealed that both animacy and the extended face category are represented across early, intermediate, and higher visual areas, independent of low- level visual features. Significant encoding emerged in V2–V4 and LOC, highlighting an early prioritization of evolutionarily relevant information within the visual system.
Files
ISP2025-ImpactfulScholars-Manuscript.pdf
Files
(16.5 MB)
| Name | Size | Download all |
|---|---|---|
|
md5:81aeda47264ef83b0476ecbfbf495baa
|
11.8 MB | Download |
|
md5:7302634ae0cf4e4cb8d8203250da1fd0
|
7.8 kB | Download |
|
md5:cbe6a772f34165d867e743bcc4da04ef
|
4.1 MB | Preview Download |
|
md5:8d711c255fea153bce9c66dd482f2151
|
609.9 kB | Preview Download |
|
md5:e5f86f34de37ff8bb49aad97f33296f6
|
47.5 kB | Preview Download |
Additional details
Related works
- Is referenced by
- Presentation: https://youtu.be/3DyoGHaCn8M?feature=shared (URL)
Funding
- Neuromatch
- Impact Scholars Program
References
- Bar, M. (2003). A cortical mechanism for triggering top‐down facilitation in visual object recognition. Journal of Cognitive Neuroscience, 15(4), 600–609. https://doi.org/10.1162/089892903321662976
- Cichy, R. M., Pantazis, D., & Oliva, A. (2014). Resolving human object recognition in space and time. Nature Neuroscience, 17(3), 455–462. https://doi.org/10.1038/nn.3635
- Freedman, D. J., Riesenhuber, M., Poggio, T., & Miller, E. K. (2001). Categorical representation of visual stimuli in the primate prefrontal cortex. Science, 291(5502), 312–316.
- Gilbert, C. D., & Li, W. (2013). Top‐down influences on visual processing. Nature Reviews Neuroscience, 14(5), 350–363. https://doi.org/10.1038/nrn3464
- Grill‐Spector, K., & Weiner, K. S. (2014). The functional architecture of the ventral temporal cortex and its role in categorization. Nature Reviews Neuroscience, 15(8), 536–548.
- Hubel, D. H., & Wiesel, T. N. (1962). Receptive fields, binocular interaction and functional architecture in the cat's visual cortex. Journal of Physiology, 160(1), 106–154.
- Kay, K. N., Naselaris, T., Prenger, R. J., & Gallant, J. L. (2008). Identifying natural images from human brain activity. Nature, 452(7185), 352–355. https://doi.org/10.1038/nature06713
- Kriegeskorte, N., Mur, M., & Bandettini, P. (2008). Representational similarity analysis— connecting the branches of systems neuroscience. Frontiers in Systems Neuroscience, 2, Article 4. https://doi.org/10.3389/neuro.06.004.2008
- Lamme, V. A. F., & Roelfsema, P. R. (2000). The distinct modes of vision offered by feedforward and recurrent processing. Trends in Neurosciences, 23(11), 571–579. https://doi.org/10.1016/S0166-2236(00)01657-X
- Long, B., Yu, C. P., & Konkle, T. (2018). Mid‐level visual features underlie the high‐level categorical organization of the ventral stream. Proceedings of the National Academy of Sciences, 115(38), E9015–E9024.
- Riesenhuber, M., & Poggio, T. (1999). Hierarchical models of object recognition in cortex. Nature Neuroscience, 2(11), 1019–1025. https://doi.org/10.1038/14819
- Zapala, M. A. & Schork, N. J. (2006). Multivariate regression analysis of distance matrices for testing associations between gene expression patterns and related variables. Proceedings of the National Academy of Sciences, 103(51), 19430–19435.