Dataset Information

Neural Decoding of Bistable Sounds Reveals an Effect of Intention on Perceptual Organization.

ABSTRACT: Auditory signals arrive at the ear as a mixture that the brain must decompose into distinct sources based to a large extent on acoustic properties of the sounds. An important question concerns whether listeners have voluntary control over how many sources they perceive. This has been studied using pure high (H) and low (L) tones presented in the repeating pattern HLH-HLH-, which can form a bistable percept heard either as an integrated whole (HLH-) or as segregated into high (H-H-) and low (-L-) sequences. Although instructing listeners to try to integrate or segregate sounds affects reports of what they hear, this could reflect a response bias rather than a perceptual effect. We had human listeners (15 males, 12 females) continuously report their perception of such sequences and recorded neural activity using MEG. During neutral listening, a classifier trained on patterns of neural activity distinguished between periods of integrated and segregated perception. In other conditions, participants tried to influence their perception by allocating attention either to the whole sequence or to a subset of the sounds. They reported hearing the desired percept for a greater proportion of time than when listening neutrally. Critically, neural activity supported these reports; stimulus-locked brain responses in auditory cortex were more likely to resemble the signature of segregation when participants tried to hear segregation than when attempting to perceive integration. These results indicate that listeners can influence how many sound sources they perceive, as reflected in neural responses that track both the input and its perceptual organization.SIGNIFICANCE STATEMENT Can we consciously influence our perception of the external world? We address this question using sound sequences that can be heard either as coming from a single source or as two distinct auditory streams. Listeners reported spontaneous changes in their perception between these two interpretations while we recorded neural activity to identify signatures of such integration and segregation. They also indicated that they could, to some extent, choose between these alternatives. This claim was supported by corresponding changes in responses in auditory cortex. By linking neural and behavioral correlates of perception, we demonstrate that the number of objects that we perceive can depend not only on the physical attributes of our environment, but also on how we intend to experience it.

SUBMITTER: Billig AJ

PROVIDER: S-EPMC5852662 | biostudies-other | 2018 Mar

REPOSITORIES: biostudies-other

ACCESS DATA

Publications

Neural Decoding of Bistable Sounds Reveals an Effect of Intention on Perceptual Organization.

Billig Alexander J AJ Davis Matthew H MH Carlyon Robert P RP

The Journal of neuroscience : the official journal of the Society for Neuroscience 20180213 11

Auditory signals arrive at the ear as a mixture that the brain must decompose into distinct sources based to a large extent on acoustic properties of the sounds. An important question concerns whether listeners have voluntary control over how many sources they perceive. This has been studied using pure high (H) and low (L) tones presented in the repeating pattern HLH-HLH-, which can form a bistable percept heard either as an integrated whole (HLH-) or as segregated into high (H-H-) and low (-L-) ...[more]

PMID: 29440556

Similar Datasets

Project description:Material properties, such as softness or stickiness, determine how an object can be used. Based on our real-life experience, we form strong expectations about how objects should behave under force, given their typical material properties. Such expectations have been shown to modulate perceptual processes, but we currently do not know how expectation influences the temporal dynamics of the cortical visual analysis for objects and their materials. Here, we tracked the neural representations of expected and unexpected material behaviors using time-resolved EEG decoding in a violation-of-expectation paradigm, where objects fell to the ground and deformed in expected or unexpected ways. Participants were 25 men and women. Our study yielded three key results: First, both objects and materials were represented rapidly and in a temporally sustained fashion. Second, objects exhibiting unexpected material behaviors were more successfully decoded than objects exhibiting expected behaviors within 190 ms after the impact, which might indicate additional processing demands when expectations are unmet. Third, general signals of expectation fulfillment that generalize across specific objects and materials were found within the first 150 ms after the impact. Together, our results provide new insights into the temporal neural processing cascade that underlies the analysis of real-world material behaviors. They reveal a sequence of predictions, with cortical signals progressing from a general signature of expectation fulfillment toward increased processing of unexpected material behaviors.SIGNIFICANCE STATEMENT In the real world, we can make accurate predictions about how an object's material shapes its behavior: For instance, we know that cups are typically made of porcelain and shatter when we accidentally drop them. Here, we use EEG to experimentally test how expectations about material behaviors impact neural processing. We showed our participants videos of objects that exhibited expected material behaviors (e.g., a glass shattering when falling to the ground) or unexpected material behaviors (e.g., a glass melting on impact). Our results reveal a hierarchy of predictions in cortex: The visual system rapidly generates signals that index whether expectations about material behaviors are met. These signals are followed by increased processing of objects displaying unexpected material behaviors.

Project description:The visual system exploits past experience at multiple timescales to resolve perceptual ambiguity in the retinal image. For example, perception of a bistable stimulus can be biased toward one interpretation over another when preceded by a brief presentation of a disambiguated version of the stimulus (positive priming) or through intermittent presentations of the ambiguous stimulus (stabilization). Similarly, prior presentations of unambiguous stimuli can be used to explicitly "train" a long-lasting association between a percept and a retinal location (perceptual association). These phenonema have typically been regarded as independent processes, with short-term biases attributed to perceptual memory and longer-term biases described as associative learning. Here we tested for interactions between these two forms of experience-dependent perceptual bias and demonstrate that short-term processes strongly influence long-term outcomes. We first demonstrate that the establishment of long-term perceptual contingencies does not require explicit training by unambiguous stimuli, but can arise spontaneously during the periodic presentation of brief, ambiguous stimuli. Using rotating Necker cube stimuli, we observed enduring, retinotopically specific perceptual biases that were expressed from the outset and remained stable for up to 40 min, consistent with the known phenomenon of perceptual stabilization. Further, bias was undiminished after a break period of 5 min, but was readily reset by interposed periods of continuous, as opposed to periodic, ambiguous presentation. Taken together, the results demonstrate that perceptual biases can arise naturally and may principally reflect the brain's tendency to favor recent perceptual interpretation at a given retinal location. Further, they suggest that an association between retinal location and perceptual state, rather than a physical stimulus, is sufficient to generate long-term biases in perceptual organization.

Project description:The consequences of cortical resection, a treatment for humans with pharmaco-resistant epilepsy, provide a unique opportunity to advance our understanding of the nature and extent of cortical (re)organization. Despite the importance of visual processing in daily life, the neural and perceptual sequellae of occipitotemporal resections remain largely unexplored. Using psychophysical and fMRI investigations, we compared the neural and visuoperceptual profiles of 10 children or adolescents following unilateral cortical resections and their age- and gender-matched controls. Dramatically, with the exception of two individuals, both of whom had relatively greater cortical alterations, all patients showed normal perceptual performance on tasks of intermediate- and high-level vision, including face and object recognition. Consistently, again with the exception of the same two individuals, both univariate and multivariate fMRI analyses revealed normal selectivity and representational structure of category-selective regions. Furthermore, the spatial organization of category-selective regions obeyed the typical medial-to-lateral topographic organization albeit unilaterally in the structurally preserved hemisphere rather than bilaterally. These findings offer novel insights into the malleability of cortex in the pediatric population and suggest that, although experience may be necessary for the emergence of neural category-selectivity, this emergence is not necessarily contingent on the integrity of particular cortical structures.SIGNIFICANCE STATEMENT One approach to reduce seizure activity in patients with pharmaco-resistant epilepsy involves the resection of the epileptogenic focus. The impact of these resections on the perceptual behaviors and organization of visual cortex remain largely unexplored. Here, we characterized the visuoperceptual and neural profiles of ventral visual cortex in a relatively large sample of post-resection pediatric patients. Two major findings emerged. First, most patients exhibited preserved visuoperceptual performance across a wide-range of visual behaviors. Second, normal topography, magnitude, and representational structure of category-selective organization were uncovered in the spared hemisphere. These comprehensive imaging and behavioral investigations uncovered novel evidence concerning the neural representations and visual functions in children who have undergone cortical resection, and have implications for cortical plasticity more generally.

Dataset Information

Neural Decoding of Bistable Sounds Reveals an Effect of Intention on Perceptual Organization.

Publications

Neural Decoding of Bistable Sounds Reveals an Effect of Intention on Perceptual Organization.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets