Browse
Submit Data
Databases
API
Help

Dataset Information

24 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Beyond the feedforward sweep: feedback computations in the visual cortex.

ABSTRACT: Visual perception involves the rapid formation of a coarse image representation at the onset of visual processing, which is iteratively refined by late computational processes. These early versus late time windows approximately map onto feedforward and feedback processes, respectively. State-of-the-art convolutional neural networks, the main engine behind recent machine vision successes, are feedforward architectures. Their successes and limitations provide critical information regarding which visual tasks can be solved by purely feedforward processes and which require feedback mechanisms. We provide an overview of recent work in cognitive neuroscience and machine vision that highlights the possible role of feedback processes for both visual recognition and beyond. We conclude by discussing important open questions for future research.

SUBMITTER: Kreiman G

PROVIDER: S-EPMC7456511 | biostudies-literature | 2020 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Beyond the feedforward sweep: feedback computations in the visual cortex.

Kreiman Gabriel G Serre Thomas T

Annals of the New York Academy of Sciences 20200228 1

Visual perception involves the rapid formation of a coarse image representation at the onset of visual processing, which is iteratively refined by late computational processes. These early versus late time windows approximately map onto feedforward and feedback processes, respectively. State-of-the-art convolutional neural networks, the main engine behind recent machine vision successes, are feedforward architectures. Their successes and limitations provide critical information regarding which v ...[more]

PMID: 32112444

Similar Datasets

Segregation of feedforward and feedback projections in mouse visual cortex.

Project description:Hierarchical organization is a common feature of mammalian neocortex. Neurons that send their axons from lower to higher areas of the hierarchy are referred to as "feedforward" (FF) neurons, whereas those projecting in the opposite direction are called "feedback" (FB) neurons. Anatomical, functional, and theoretical studies suggest that these different classes of projections play fundamentally different roles in perception. In primates, laminar differences in projection patterns often distinguish the two projection streams. In rodents, however, these differences are less clear, despite an established hierarchy of visual areas. Thus the rodent provides a strong test of the hypothesis that FF and FB neurons form distinct populations. We tested this hypothesis by injecting retrograde tracers into two different hierarchical levels of mouse visual cortex (area 17 and anterolateral area [AL]) and then determining the relative proportions of double-labeled FF and FB neurons in an area intermediate to them (lateromedial area [LM]). Despite finding singly labeled neurons densely intermingled with no laminar segregation, we found few double-labeled neurons (?5% of each singly labeled population). We also examined the development of FF and FB connections. FF connections were present at the earliest timepoint we examined (postnatal day 2, P2), while FB connections were not detectable until P11. Our findings indicate that, even in cortices without laminar segregation of FF and FB neurons, the two projection systems are largely distinct at the neuronal level and also differ with respect to the timing of their axonal outgrowth.

| S-EPMC3219532 | biostudies-literature

A direct interareal feedback-to-feedforward circuit in primate visual cortex.

Project description:The mammalian sensory neocortex consists of hierarchically organized areas reciprocally connected via feedforward (FF) and feedback (FB) circuits. Several theories of hierarchical computation ascribe the bulk of the computational work of the cortex to looped FF-FB circuits between pairs of cortical areas. However, whether such corticocortical loops exist remains unclear. In higher mammals, individual FF-projection neurons send afferents almost exclusively to a single higher-level area. However, it is unclear whether FB-projection neurons show similar area-specificity, and whether they influence FF-projection neurons directly or indirectly. Using viral-mediated monosynaptic circuit tracing in macaque primary visual cortex (V1), we show that V1 neurons sending FF projections to area V2 receive monosynaptic FB inputs from V2, but not other V1-projecting areas. We also find monosynaptic FB-to-FB neuron contacts as a second motif of FB connectivity. Our results support the existence of FF-FB loops in primate cortex, and suggest that FB can rapidly and selectively influence the activity of incoming FF signals.

| S-EPMC8363744 | biostudies-literature

Alpha and gamma oscillations characterize feedback and feedforward processing in monkey visual cortex.

Project description:Cognitive functions rely on the coordinated activity of neurons in many brain regions, but the interactions between cortical areas are not yet well understood. Here we investigated whether low-frequency (?) and high-frequency (?) oscillations characterize different directions of information flow in monkey visual cortex. We recorded from all layers of the primary visual cortex (V1) and found that ?-waves are initiated in input layer 4 and propagate to the deep and superficial layers of cortex, whereas ?-waves propagate in the opposite direction. Simultaneous recordings from V1 and downstream area V4 confirmed that ?- and ?-waves propagate in the feedforward and feedback direction, respectively. Microstimulation in V1 elicited ?-oscillations in V4, whereas microstimulation in V4 elicited ?-oscillations in V1, thus providing causal evidence for the opposite propagation of these rhythms. Furthermore, blocking NMDA receptors, thought to be involved in feedback processing, suppressed ? while boosting ?. These results provide new insights into the relation between brain rhythms and cognition.

| S-EPMC4210002 | biostudies-literature

Engagement of Pulvino-cortical Feedforward and Feedback Pathways in Cognitive Computations.

Project description:Computational modeling of brain mechanisms of cognition has largely focused on the cortex, but recent experiments have shown that higher-order nuclei of the thalamus participate in major cognitive functions and are implicated in psychiatric disorders. Here, we show that a pulvino-cortical circuit model, composed of the pulvinar and two cortical areas, captures several physiological and behavioral observations related to the macaque pulvinar. Effective connections between the two cortical areas are gated by the pulvinar, allowing the pulvinar to shift the operation regime of these areas during attentional processing and working memory and resolve conflict in decision making. Furthermore, cortico-pulvinar projections that engage the thalamic reticular nucleus enable the pulvinar to estimate decision confidence. Finally, feedforward and feedback pulvino-cortical pathways participate in frequency-dependent inter-areal interactions that modify the relative hierarchical positions of cortical areas. Overall, our model suggests that the pulvinar provides crucial contextual modulation to cortical computations associated with cognition.

| S-EPMC6650151 | biostudies-literature

Sensory experience inversely regulates feedforward and feedback excitation-inhibition ratio in rodent visual cortex.

Project description:Brief (2-3d) monocular deprivation (MD) during the critical period induces a profound loss of responsiveness within binocular (V1b) and monocular (V1m) regions of rodent primary visual cortex. This has largely been ascribed to long-term depression (LTD) at thalamocortical synapses, while a contribution from intracortical inhibition has been controversial. Here we used optogenetics to isolate and measure feedforward thalamocortical and feedback intracortical excitation-inhibition (E-I) ratios following brief MD. Despite depression at thalamocortical synapses, thalamocortical E-I ratio was unaffected in V1b and shifted toward excitation in V1m, indicating that thalamocortical excitation was not effectively reduced. In contrast, feedback intracortical E-I ratio was shifted toward inhibition in V1m, and a computational model demonstrated that these opposing shifts produced an overall suppression of layer 4 excitability. Thus, feedforward and feedback E-I ratios can be independently tuned by visual experience, and enhanced feedback inhibition is the primary driving force behind loss of visual responsiveness.

| S-EPMC6224193 | biostudies-literature

The operating regime of local computations in primary visual cortex.

Project description:In V1, local circuitry depends on the position in the orientation map: close to pinwheel centers, recurrent inputs show variable orientation preferences; within iso-orientation domains, inputs are relatively uniformly tuned. Physiological properties such as cell's membrane potentials, spike outputs, and temporal characteristics change systematically with map location. We investigate in a firing rate and a Hodgkin-Huxley network model what constraints these tuning characteristics of V1 neurons impose on the cortical operating regime. Systematically varying the strength of both recurrent excitation and inhibition, we test a wide range of model classes and find the likely models to account for the experimental observations. We show that recent intracellular and extracellular recordings from cat V1 provide the strongest evidence for a regime where excitatory and inhibitory recurrent inputs are balanced and dominate the feed-forward input. Our results are robust against changes in model assumptions such as spatial extent and strength of lateral inhibition. Intriguingly, the most likely recurrent regime is in a region of parameter space where small changes have large effects on the network dynamics, and it is close to a regime of "runaway excitation," where the network shows strong self-sustained activity. This could make the cortical response particularly sensitive to modulation.

| S-EPMC2722429 | biostudies-literature

Ultra-Rapid serial visual presentation reveals dynamics of feedforward and feedback processes in the ventral visual pathway.

Project description:Human visual recognition activates a dense network of overlapping feedforward and recurrent neuronal processes, making it hard to disentangle processing in the feedforward from the feedback direction. Here, we used ultra-rapid serial visual presentation to suppress sustained activity that blurs the boundaries of processing steps, enabling us to resolve two distinct stages of processing with MEG multivariate pattern classification. The first processing stage was the rapid activation cascade of the bottom-up sweep, which terminated early as visual stimuli were presented at progressively faster rates. The second stage was the emergence of categorical information with peak latency that shifted later in time with progressively faster stimulus presentations, indexing time-consuming recurrent processing. Using MEG-fMRI fusion with representational similarity, we localized recurrent signals in early visual cortex. Together, our findings segregated an initial bottom-up sweep from subsequent feedback processing, and revealed the neural signature of increased recurrent processing demands for challenging viewing conditions.

| S-EPMC6029845 | biostudies-literature

Cooperative and competitive interactions facilitate stereo computations in macaque primary visual cortex.

Project description:Inferring depth from binocular disparities is a difficult problem for the visual system because local features in the left- and right-eye images must be matched correctly to solve this "stereo correspondence problem." Cortical architecture and computational studies suggest that lateral interactions among neurons could help resolve local uncertainty about disparity encoded in individual neurons by incorporating contextual constraints. We found that correlated activity among pairs of neurons in primary visual cortex depended both on disparity-tuning relationships and the stimuli displayed within the receptive fields of the neurons. Nearby pairs of neurons with distinct disparity tuning exhibited a decrease in spike correlation at competing disparities soon after response onset. Distant neuronal pairs of similar disparity tuning exhibited an increase in spike correlation at mutually preferred disparities. The observed correlated activity and response dynamics suggests that local competitive and distant cooperative interactions improve disparity tuning of individual neurons over time. Such interactions could represent a neural substrate for the principal constraints underlying cooperative stereo algorithms.

| S-EPMC5788183 | biostudies-other

Causal evidence for retina-dependent and -independent visual motion computations in mouse cortex.

Project description:How neuronal computations in the sensory periphery contribute to computations in the cortex is not well understood. We examined this question in the context of visual-motion processing in the retina and primary visual cortex (V1) of mice. We disrupted retinal direction selectivity, either exclusively along the horizontal axis using FRMD7 mutants or along all directions by ablating starburst amacrine cells, and monitored neuronal activity in layer 2/3 of V1 during stimulation with visual motion. In control mice, we found an over-representation of cortical cells preferring posterior visual motion, the dominant motion direction an animal experiences when it moves forward. In mice with disrupted retinal direction selectivity, the over-representation of posterior-motion-preferring cortical cells disappeared, and their responses at higher stimulus speeds were reduced. This work reveals the existence of two functionally distinct, sensory-periphery-dependent and -independent computations of visual motion in the cortex.

| S-EPMC5490790 | biostudies-literature

Visual crowding illustrates the inadequacy of local vs. global and feedforward vs. feedback distinctions in modeling visual perception.

Project description:Experimentalists tend to classify models of visual perception as being either local or global, and involving either feedforward or feedback processing. We argue that these distinctions are not as helpful as they might appear, and we illustrate these issues by analyzing models of visual crowding as an example. Recent studies have argued that crowding cannot be explained by purely local processing, but that instead, global factors such as perceptual grouping are crucial. Theories of perceptual grouping, in turn, often invoke feedback connections as a way to account for their global properties. We examined three types of crowding models that are representative of global processing models, and two of which employ feedback processing: a model based on Fourier filtering, a feedback neural network, and a specific feedback neural architecture that explicitly models perceptual grouping. Simulations demonstrate that crucial empirical findings are not accounted for by any of the models. We conclude that empirical investigations that reject a local or feedforward architecture offer almost no constraints for model construction, as there are an uncountable number of global and feedback systems. We propose that the identification of a system as being local or global and feedforward or feedback is less important than the identification of a system's computational details. Only the latter information can provide constraints on model development and promote quantitative explanations of complex phenomena.

| S-EPMC4204448 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data