Dataset Information

Performance-optimized hierarchical models predict neural responses in higher visual cortex.

ABSTRACT: The ventral visual stream underlies key human visual object recognition abilities. However, neural encoding in the higher areas of the ventral stream remains poorly understood. Here, we describe a modeling approach that yields a quantitatively accurate model of inferior temporal (IT) cortex, the highest ventral cortical area. Using high-throughput computational techniques, we discovered that, within a class of biologically plausible hierarchical neural network models, there is a strong correlation between a model's categorization performance and its ability to predict individual IT neural unit response data. To pursue this idea, we then identified a high-performing neural network that matches human performance on a range of recognition tasks. Critically, even though we did not constrain this model to match neural data, its top output layer turns out to be highly predictive of IT spiking responses to complex naturalistic images at both the single site and population levels. Moreover, the model's intermediate layers are highly predictive of neural responses in the V4 cortex, a midlevel visual area that provides the dominant cortical input to IT. These results show that performance optimization--applied in a biologically appropriate model class--can be used to build quantitative predictive models of neural processing.

SUBMITTER: Yamins DL

PROVIDER: S-EPMC4060707 | biostudies-literature | 2014 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Performance-optimized hierarchical models predict neural responses in higher visual cortex.

Yamins Daniel L K DL Hong Ha H Cadieu Charles F CF Solomon Ethan A EA Seibert Darren D DiCarlo James J JJ

Proceedings of the National Academy of Sciences of the United States of America 20140508 23

The ventral visual stream underlies key human visual object recognition abilities. However, neural encoding in the higher areas of the ventral stream remains poorly understood. Here, we describe a modeling approach that yields a quantitatively accurate model of inferior temporal (IT) cortex, the highest ventral cortical area. Using high-throughput computational techniques, we discovered that, within a class of biologically plausible hierarchical neural network models, there is a strong correlati ...[more]

PMID: 24812127

Similar Datasets

Project description:Variability in cortical neuronal responses to sensory stimuli and in perceptual decision making performance is substantial. Moment-to-moment fluctuations in waking state or arousal can account for much of this variability. Yet, this variability is rarely characterized across the full spectrum of waking states, leaving the characteristics of the optimal state for sensory processing unresolved. Using pupillometry in concert with extracellular multiunit and intracellular whole-cell recordings, we found that the magnitude and reliability of visually evoked responses in primary visual cortex (V1) of awake, passively behaving male mice increase as a function of arousal and are largest during sustained locomotion periods. During these high-arousal, sustained locomotion periods, cortical neuronal membrane potential was at its most depolarized and least variable. Contrastingly, behavioral performance of mice on two distinct visual detection tasks was generally best at a range of intermediate arousal levels, but worst during high arousal with locomotion. These results suggest that large, reliable responses to visual stimuli in V1 occur at a distinct arousal level from that associated with optimal visual detection performance. Our results clarify the relation between neuronal responsiveness and the continuum of waking states, and suggest new complexities in the relation between primary sensory cortical activity and behavior.SIGNIFICANCE STATEMENT Cortical sensory processing strongly depends on arousal. In the mouse visual system, locomotion (associated with high arousal) has previously been shown to enhance the sensory responses of neurons in primary visual cortex (V1). Yet, arousal fluctuates on a moment-to-moment basis, even during quiescent periods. The characteristics of V1 sensory processing across the continuum of arousal are unclear. Furthermore, the arousal level corresponding to optimal visual detection performance is unknown. We show that the magnitude and reliability of sensory-evoked V1 responses are monotonic increasing functions of arousal, and largest during locomotion. Visual detection behavior, however, is suboptimal during high arousal with locomotion, and usually best during intermediate arousal. Our study provides a more complete picture of the dependence of V1 sensory processing on arousal.

Dataset Information

Performance-optimized hierarchical models predict neural responses in higher visual cortex.

Publications

Performance-optimized hierarchical models predict neural responses in higher visual cortex.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets