Perceptual similarity of visual patterns predicts dynamic neural activation patterns measured with MEG

Susan G. Wardle, Nikolaus Kriegeskorte, Tijl Grootswagers, Seyed Mahdi Khaligh-Razavi, Thomas A. Carlson*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

46 Citations (Scopus)

Abstract

Perceptual similarity is a cognitive judgment that represents the end-stage of a complex cascade of hierarchical processing throughout visual cortex. Previous studies have shown a correspondence between the similarity of coarse-scale fMRI activation patterns and the perceived similarity of visual stimuli, suggesting that visual objects that appear similar also share similar underlying patterns of neural activation. Here we explore the temporal relationship between the human brain's time-varying representation of visual patterns and behavioral judgments of perceptual similarity. The visual stimuli were abstract patterns constructed from identical perceptual units (oriented Gabor patches) so that each pattern had a unique global form or perceptual 'Gestalt'. The visual stimuli were decodable from evoked neural activation patterns measured with magnetoencephalography (MEG), however, stimuli differed in the similarity of their neural representation as estimated by differences in decodability. Early after stimulus onset (from 50 ms), a model based on retinotopic organization predicted the representational similarity of the visual stimuli. Following the peak correlation between the retinotopic model and neural data at 80 ms, the neural representations quickly evolved so that retinotopy no longer provided a sufficient account of the brain's time-varying representation of the stimuli. Overall the strongest predictor of the brain's representation was a model based on human judgments of perceptual similarity, which reached the limits of the maximum correlation with the neural data defined by the 'noise ceiling'. Our results show that large-scale brain activation patterns contain a neural signature for the perceptual Gestalt of composite visual features, and demonstrate a strong correspondence between perception and complex patterns of brain activity.

Original languageEnglish
Pages (from-to)59-70
Number of pages12
JournalNeuroImage
Volume132
DOIs
Publication statusPublished - 15 May 2016

Keywords

  • Decoding
  • Gestalt perception
  • Magnetoencephalography (MEG)
  • Perceptual similarity
  • Representational geometry
  • Representational similarity analysis

Fingerprint Dive into the research topics of 'Perceptual similarity of visual patterns predicts dynamic neural activation patterns measured with MEG'. Together they form a unique fingerprint.

Cite this