A sparse object coding scheme in area V4.
Ontology highlight
ABSTRACT:
SUBMITTER: Carlson ET
PROVIDER: S-EPMC3070463 | biostudies-other | 2011 Feb
REPOSITORIES: biostudies-other
Publications
A sparse object coding scheme in area V4.
Carlson Eric T ET Rasquinha Russell J RJ Zhang Kechen K Connor Charles E CE
Current biology : CB 20110201 4
Sparse coding has long been recognized as a primary goal of image transformation in the visual system. Sparse coding in early visual cortex is achieved by abstracting local oriented spatial frequencies and by excitatory/inhibitory surround modulation. Object responses are thought to be sparse at subsequent processing stages, but neural mechanisms for higher-level sparsification are not known. Here, convergent results from macaque area V4 neural recording and simulated V4 populations trained on n ...[more]
Similar Datasets
Project description:Edge blur, a prevalent feature of natural images, is believed to facilitate multiple visual processes including segmentation and depth perception. Furthermore, image descriptions that explicitly combine blur and shape information provide complete representations of naturalistic scenes. Here we report the first demonstration of blur encoding in primate visual cortex: neurons in macaque V4 exhibit tuning for both object shape and boundary blur, with observed blur tuning not explained by potential confounds including stimulus size, intensity, or curvature. A descriptive model wherein blur selectivity is cast as a distinct neural process that modulates the gain of shape-selective V4 neurons explains observed data, supporting the hypothesis that shape and blur are fundamental features of a sufficient neural code for natural image representation in V4.
| S-EPMC5792439 | biostudies-literature
Project description:The primate visual system has an exquisite ability to discriminate partially occluded shapes. Recent electrophysiological recordings suggest that response dynamics in intermediate visual cortical area V4, shaped by feedback from prefrontal cortex (PFC), may play a key role. To probe the algorithms that may underlie these findings, we build and test a model of V4 and PFC interactions based on a hierarchical predictive coding framework. We propose that probabilistic inference occurs in two steps. Initially, V4 responses are driven solely by bottom-up sensory input and are thus strongly influenced by the level of occlusion. After a delay, V4 responses combine both feedforward input and feedback signals from the PFC; the latter reflect predictions made by PFC about the visual stimulus underlying V4 activity. We find that this model captures key features of V4 and PFC dynamics observed in experiments. Specifically, PFC responses are strongest for occluded stimuli and delayed responses in V4 are less sensitive to occlusion, supporting our hypothesis that the feedback signals from PFC underlie robust discrimination of occluded shapes. Thus, our study proposes that area V4 and PFC participate in hierarchical inference, with feedback signals encoding top-down predictions about occluded shapes.
| S-EPMC5930045 | biostudies-literature
Project description:BackgroundThe shading of an object provides an important cue for recognition, especially for determining its 3D shape. However, neuronal mechanisms that allow the recovery of 3D shape from shading are poorly understood. The aim of our study was to determine the neuronal basis of 3D shape from shading coding in area V4 of the awake macaque monkey.ResultsWe recorded the responses of V4 cells to stimuli presented parafoveally while the monkeys fixated a central spot. We used a set of stimuli made of 8 different 3D shapes illuminated from 4 directions (from above, the left, the right and below) and different 2D controls for each stimulus. The results show that V4 neurons present a broad selectivity to 3D shape and illumination direction, but without a preference for a unique illumination direction. However, 3D shape and illumination direction selectivities are correlated suggesting that V4 neurons can use the direction of illumination present in complex patterns of shading present on the surface of objects. In addition, a vast majority of V4 neurons (78%) have statistically different responses to the 3D and 2D versions of the stimuli, while responses to 3D are not systematically stronger than those to 2D controls. However, a hierarchical cluster analysis showed that the different classes of stimuli (3D, 2D controls) are clustered in the V4 cells response space suggesting a coding of 3D stimuli based on the population response. The different illumination directions also tend to be clustered in this space.ConclusionTogether, these results show that area V4 participates, at the population level, in the coding of complex shape from the shading patterns coming from the illumination of the surface of corrugated objects. Hence V4 provides important information for one of the steps of cortical processing of the 3D aspect of objects in natural light environment.
| S-EPMC2790458 | biostudies-literature
Project description:The localization of distinct landmarks plays a crucial role in encoding new spatial memories. In mammals, this function is performed by hippocampal neurons that sparsely encode an animal's location relative to surrounding objects. Similarly, the dorsolateral pallium (DL) is essential for spatial learning in teleost fish. The DL of weakly electric gymnotiform fish receives both electrosensory and visual input from the preglomerular nucleus (PG), which has been hypothesized to encode the temporal sequence of electrosensory or visual landmark/food encounters. Here, we show that DL neurons in the Apteronotid fish and in the Carassius auratus (goldfish) have a hyperpolarized resting membrane potential (RMP) combined with a high and dynamic spike threshold that increases following each spike. Current-evoked spikes in DL cells are followed by a strong small-conductance calcium-activated potassium channel (SK)-mediated after-hyperpolarizing potential (AHP). Together, these properties prevent high frequency and continuous spiking. The resulting sparseness of discharge and dynamic threshold suggest that DL neurons meet theoretical requirements for generating spatial memory engrams by decoding the landmark/food encounter sequences encoded by PG neurons. Thus, DL neurons in teleost fish may provide a promising, simple system to study the core cell and network mechanisms underlying spatial memory.
| S-EPMC6709220 | biostudies-literature
Project description:We have previously analyzed shape processing dynamics in macaque monkey posterior inferotemporal cortex (PIT). We described how early PIT responses to individual contour fragments evolve into tuning for multifragment shape configurations. Here, we analyzed curvature processing dynamics in area V4, which provides feedforward inputs to PIT. We contrasted 2 hypotheses: 1) that V4 curvature tuning evolves from tuning for simpler elements, analogous to PIT shape synthesis and 2) that V4 curvature tuning emerges immediately, based on purely feedforward mechanisms. Our results clearly supported the first hypothesis. Early V4 responses carried information about individual contour orientations. Tuning for multiorientation (curved) contours developed gradually over ∼50 ms. Together, the current and previous results suggest a partial sequence for shape synthesis in ventral pathway cortex. We propose that early orientation signals are synthesized into curved contour fragment representations in V4 and that these signals are transmitted to PIT, where they are then synthesized into multifragment shape representations. The observed dynamics might additionally or alternatively reflect influences from earlier (V1, V2) and later (central and anterior IT) processing stages in the ventral pathway. In either case, the dynamics of contour information in V4 and PIT appear to reflect a sequential hierarchical process of shape synthesis.
| S-EPMC3513958 | biostudies-literature
Project description:Aftereffects are perceptual illusions caused by visual adaptation to one or more stimulus attribute, such as orientation, motion, or shape. Neurophysiological studies seeking to understand the basis of visual adaptation have observed firing rate reduction and changes in tuning of stimulus-selective neurons following periods of prolonged visual stimulation. In the domain of shape, recent psychophysical work has shown that adaptation to a convex pattern induces a subsequently seen rectangle to appear slightly concave. In the present study, we investigate the possible contribution of V4 neurons of rhesus monkeys, which are thought to be involved in the coding of convexity, to shape-specific adaptation. Visually responsive neurons were monitored during the brief presentation of simple shapes varying in their convexity level. Each test presentation was preceded by either a blank period or several seconds of adaptation to a convex or concave stimulus, presented in two different sizes. Adaptation consistently shifted the tuning of neurons away from the convex or concave adapter, including shifting response to the neutral rectangle in the direction of the opposite convexity. This repulsive shift resembled the known perceptual distortion associated with adaptation to such stimuli. In addition, adaptation caused a nonspecific response decrease, as well as a specific decrease for repeated stimuli. The latter effects were observed whether or not the adapting and test stimuli matched closely in their size. Taken together, these results provide evidence for shape-specific adaptation of neurons in area V4, which may contribute to the perception of the convexity aftereffect.
| S-EPMC2724890 | biostudies-literature
Project description:Color is special among basic visual features in that it can form a defining part of objects that are engrained in our memory. Whereas most neuroimaging research on human color vision has focused on responses related to external stimulation, the present study investigated how sensory-driven color vision is linked to subjective color perception induced by object imagery. We recorded fMRI activity in male and female volunteers during viewing of abstract color stimuli that were red, green, or yellow in half of the runs. In the other half we asked them to produce mental images of colored, meaningful objects (such as tomato, grapes, banana) corresponding to the same three color categories. Although physically presented color could be decoded from all retinotopically mapped visual areas, only hV4 allowed predicting colors of imagined objects when classifiers were trained on responses to physical colors. Importantly, only neural signal in hV4 was predictive of behavioral performance in the color judgment task on a trial-by-trial basis. The commonality between neural representations of sensory-driven and imagined object color and the behavioral link to neural representations in hV4 identifies area hV4 as a perceptual hub linking externally triggered color vision with color in self-generated object imagery.SIGNIFICANCE STATEMENT Humans experience color not only when visually exploring the outside world, but also in the absence of visual input, for example when remembering, dreaming, and during imagery. It is not known where neural codes for sensory-driven and internally generated hue converge. In the current study we evoked matching subjective color percepts, one driven by physically presented color stimuli, the other by internally generated color imagery. This allowed us to identify area hV4 as the only site where neural codes of corresponding subjective color perception converged regardless of its origin. Color codes in hV4 also predicted behavioral performance in an imagery task, suggesting it forms a perceptual hub for color perception.
| S-EPMC6705916 | biostudies-literature
Project description:During the preparation of saccadic eye movements, visual attention is confined to the target of intended fixation and there is a corresponding diminution of visual sensitivity at nontarget locations. Neurons within the macaque visual cortex exhibit correlates of these perceptual changes, such as in area V4, where neuronal responses are enhanced during the preparation of saccades to stimuli within the receptive field (RF), and responses are suppressed during the preparation of saccades to other locations. Both the perceptual and neurophysiological effects suggest that the sensitivity of visual cortical neurons to input is dynamic during saccade preparation. We probed the contrast sensitivity of area V4 neurons to nontarget stimuli at varying times during the preparation of saccades to locations outside of the neuron's receptive field. We found that the contrast sensitivity of many neurons is profoundly altered within 50 ms of saccade onset. The luminance or color contrast sensitivity of individual V4 neurons could increase, decrease, or remain unchanged before saccade onset. For luminance contrast sensitivity, decreases in sensitivity were more frequent and larger in magnitude, resulting in an overall decrement in sensitivity across the population. For color contrast, the effects were smaller and more heterogeneous, resulting in little or no overall change in sensitivity across the population. Our results demonstrate the dynamic influence that saccade preparation has on the sensitivity of visual cortical neurons and suggest a basis for the changes in perception known to occur during saccade preparation.
| S-EPMC2722339 | biostudies-literature
Project description:Previous studies have shown that neurons in area V4 are involved in the processing of shapes of intermediate complexity and are sensitive to curvature. These studies also suggest that curvature-tuned neurons are position invariant. We sought to examine the mechanisms that endow V4 neurons with these properties. Consistent with previous studies, we found that response rank order to the most- and least-preferred stimuli was preserved throughout the receptive field. However, a fine-grained analysis of shape tuning revealed a surprising result: V4 neurons tuned to highly curved shapes exhibit very limited translation invariance. At a fine spatial scale, these neurons exhibit local variation in orientation. In contrast, neurons that prefer straight contours exhibit spatially invariant orientation-tuning and homogenous fine-scale orientation maps. Both of these patterns are consistent with a simple orientation-pooling model, with tuning for straight or curved shapes resulting, respectively, from pooling of homogenous or heterogeneous orientation signals inherited from early visual areas.
| S-EPMC3694358 | biostudies-literature
Project description:We hide grayscale secret images into a grayscale cover image, which is considered to be a challenging steganography problem. Our goal is to develop a steganography scheme with enhanced embedding capacity while preserving the visual quality of the stego-image as well as the extracted secret image, and ensuring that the stego-image is resistant to steganographic attacks. The novel embedding rule of our scheme helps to hide secret image sparse coefficients into the oversampled cover image sparse coefficients in a staggered manner. The stego-image is constructed by using the Alternating Direction Method of Multipliers (ADMM) to solve the Least Absolute Shrinkage and Selection Operator (LASSO) formulation of the underlying minimization problem. Finally, the secret images are extracted from the constructed stego-image using the reverse of our embedding rule. Using these components together, to achieve the above mentioned competing goals, forms our most novel contribution. We term our scheme SABMIS (Sparse Approximation Blind Multi-Image Steganography). We perform extensive experiments on several standard images. By choosing the size of the length and the width of the secret images to be half of the length and the width of cover image, respectively, we obtain embedding capacities of 2 bpp (bits per pixel), 4 bpp, 6 bpp, and 8 bpp while embedding one, two, three, and four secret images, respectively. Our focus is on hiding multiple secret images. For the case of hiding two and three secret images, our embedding capacities are higher than all the embedding capacities obtained in the literature until now (3 times and 6 times than the existing best, respectively). For the case of hiding four secret images, although our capacity is slightly lower than one work (about 2/3rd), we do better on the other two goals (quality of stego-image & extracted secret image as well as resistance to steganographic attacks). For our experiments, there is very little deterioration in the quality of the stego-images as compared to their corresponding cover images. Like all other competing works, this is supported visually as well as over 30 dB of Peak Signal-to-Noise Ratio (PSNR) values. The good quality of the stego-images is further validated by multiple numerical measures. None of the existing works perform this exhaustive validation. When using SABMIS, the quality of the extracted secret images is almost same as that of the corresponding original secret images. This aspect is also not demonstrated in all competing literature. SABMIS further improves the security of the inherently steganographic attack resistant transform based schemes. Thus, it is one of the most secure schemes among the existing ones. Additionally, we demonstrate that SABMIS executes in few minutes, and show its application on the real-life problems of securely transmitting medical images over the internet.
| S-EPMC9748825 | biostudies-literature