Cortical encoding of melodic expectations in human temporal cortex.
Ontology highlight
ABSTRACT:
SUBMITTER: Di Liberto GM
PROVIDER: S-EPMC7053998 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:The perception of a melody is invariant to the absolute properties of its constituting notes, but depends on the relation between them-the melody's relative pitch profile. In fact, a melody's "Gestalt" is recognized regardless of the instrument or key used to play it. Pitch processing in general is assumed to occur at the level of the auditory cortex. However, it is unknown whether early auditory regions are able to encode pitch sequences integrated over time (i.e., melodies) and whether the resulting representations are invariant to specific keys. Here, we presented participants different melodies composed of the same 4 harmonic pitches during functional magnetic resonance imaging recordings. Additionally, we played the same melodies transposed in different keys and on different instruments. We found that melodies were invariantly represented by their blood oxygen level-dependent activation patterns in primary and secondary auditory cortices across instruments, and also across keys. Our findings extend common hierarchical models of auditory processing by showing that melodies are encoded independent of absolute pitch and based on their relative pitch profile as early as the primary auditory cortex.
| S-EPMC3827712 | biostudies-literature
Project description:How is temporal information processed in human visual cortex? Visual input is relayed to V1 through segregated transient and sustained channels in the retina and lateral geniculate nucleus (LGN). However, there is intense debate as to how sustained and transient temporal channels contribute to visual processing beyond V1. The prevailing view associates transient processing predominately with motion-sensitive regions and sustained processing with ventral stream regions, while the opposing view suggests that both temporal channels contribute to neural processing beyond V1. Using fMRI, we measured cortical responses to time-varying stimuli and then implemented a two temporal channel-encoding model to evaluate the contributions of each channel. Different from the general linear model of fMRI that predicts responses directly from the stimulus, the encoding approach first models neural responses to the stimulus from which fMRI responses are derived. This encoding approach not only predicts cortical responses to time-varying stimuli from milliseconds to seconds but also, reveals differential contributions of temporal channels across visual cortex. Consistent with the prevailing view, motion-sensitive regions and adjacent lateral occipitotemporal regions are dominated by transient responses. However, ventral occipitotemporal regions are driven by both sustained and transient channels, with transient responses exceeding the sustained. These findings propose a rethinking of temporal processing in the ventral stream and suggest that transient processing may contribute to rapid extraction of the content of the visual input. Importantly, our encoding approach has vast implications, because it can be applied with fMRI to decipher neural computations in millisecond resolution in any part of the brain.
| S-EPMC5754759 | biostudies-literature
Project description:Local feedforward and recurrent connectivity are rife in the frontal areas of the cerebral cortex, which gives rise to rich heterogeneous dynamics observed in such areas. Recently, similar local connectivity motifs have been discovered among Purkinje and molecular layer interneurons of the cerebellar cortex, however, task-related activity in these neurons has often been associated with relatively simple facilitation and suppression dynamics. Here, we show that the rodent cerebellar cortex supports heterogeneity in task-related neuronal activity at a scale similar to the cerebral cortex. We provide a computational model that inculcates recent anatomical insights into local microcircuit motifs to show the putative basis for such heterogeneity. We also use cell-type specific chronic viral lesions to establish the involvement of cerebellar lobules in associative learning behaviors. Functional heterogeneity in neuronal profiles may not merely be the remit of the associative cerebral cortex, similar principles may be at play in subcortical areas, even those with seemingly crystalline and homogenous cytoarchitectures like the cerebellum.
| S-EPMC10663630 | biostudies-literature
Project description:Optimal perceptual decisions require sensory signals to be combined with prior information about stimulus probability. Although several theories propose that probabilistic information about stimulus occurrence is encoded in sensory cortex, evidence from neuronal recordings has not yet fully supported this view. We recorded activity from single neurons in inferior temporal cortex (IT) while monkeys performed a task that involved discriminating degraded images of faces and fruit. The relative probability of the cue being a face versus a fruit was manipulated by a latent variable that was not revealed to the monkeys and that changed unpredictably over the course of each recording session. In addition to responding to stimulus identity (face or fruit), population responses in IT encoded the long-term stimulus probability of whether a face or a fruit stimulus was more likely to occur. Face-responsive neurons showed reduced firing rates to expected faces, an effect consistent with "expectation suppression," but expected stimuli were decoded from multivariate population signals with greater accuracy. These findings support "predictive coding" theories, whereby neural signals in the mammalian visual system actively encode and update predictions about the local sensory environment.
| S-EPMC5021632 | biostudies-literature
Project description:Functional neuroimaging research provides detailed observations of the response patterns that natural sounds (e.g. human voices and speech, animal cries, environmental sounds) evoke in the human brain. The computational and representational mechanisms underlying these observations, however, remain largely unknown. Here we combine high spatial resolution (3 and 7 Tesla) functional magnetic resonance imaging (fMRI) with computational modeling to reveal how natural sounds are represented in the human brain. We compare competing models of sound representations and select the model that most accurately predicts fMRI response patterns to natural sounds. Our results show that the cortical encoding of natural sounds entails the formation of multiple representations of sound spectrograms with different degrees of spectral and temporal resolution. The cortex derives these multi-resolution representations through frequency-specific neural processing channels and through the combined analysis of the spectral and temporal modulations in the spectrogram. Furthermore, our findings suggest that a spectral-temporal resolution trade-off may govern the modulation tuning of neuronal populations throughout the auditory cortex. Specifically, our fMRI results suggest that neuronal populations in posterior/dorsal auditory regions preferably encode coarse spectral information with high temporal precision. Vice-versa, neuronal populations in anterior/ventral auditory regions preferably encode fine-grained spectral information with low temporal precision. We propose that such a multi-resolution analysis may be crucially relevant for flexible and behaviorally-relevant sound processing and may constitute one of the computational underpinnings of functional specialization in auditory cortex.
| S-EPMC3879146 | biostudies-literature
Project description:Reading-related responses in the lateral ventral temporal cortex (VTC) show a consistent spatial layout across individuals, which is puzzling, since reading skills are acquired during childhood. Here, we tested the hypothesis that white matter fascicles and gray matter microstructure predict the location of reading-related responses in lateral VTC. We obtained functional (fMRI), diffusion (dMRI), and quantitative (qMRI) magnetic resonance imaging data in 30 adults. fMRI was used to map reading-related responses by contrasting responses in a reading task with those in adding and color tasks; dMRI was used to identify the brain's fascicles and to map their endpoint densities in lateral VTC; qMRI was used to measure proton relaxation time (T1), which depends on cortical tissue microstructure. We fit linear models that predict reading-related responses in lateral VTC from endpoint density and T1 and used leave-one-subject-out cross-validation to assess prediction accuracy. Using a subset of our participants (N=10, feature selection set), we find that i) endpoint densities of the arcuate fasciculus (AF), inferior longitudinal fasciculus (ILF), and vertical occipital fasciculus (VOF) are significant predictors of reading-related responses, and ii) cortical T1 of lateral VTC further improves the predictions of the fascicle model. In the remaining participants (N=20, validation set), we show that a linear model that includes T1, AF, ILF and VOF significantly predicts i) the map of reading-related responses across lateral VTC and ii) the location of the visual word form area, a region critical for reading. Overall, our data-driven approach reveals that the AF, ILF, VOF and cortical microstructure have a consistent spatial relationship with an individual's reading-related responses in lateral VTC.
| S-EPMC8416179 | biostudies-literature
Project description:Natural speech is organized according to a hierarchical structure, with individual speech sounds combining to form abstract linguistic units, and abstract linguistic units combining to form higher-order linguistic units. Since the boundaries between these units are not always indicated by acoustic cues, they must often be computed internally. Signatures of this internal computation were reported by Ding et al. (2016), who presented isochronous sequences of mono-syllabic words that combined to form phrases that combined to form sentences, and showed that cortical responses simultaneously encode boundaries at multiple levels of the linguistic hierarchy. In the present study, we designed melodic sequences that were hierarchically organized according to Western music conventions. Specifically, isochronous sequences of "sung" nonsense syllables were constructed such that syllables combined to form triads outlining individual chords, which combined to form harmonic progressions. EEG recordings were made while participants listened to these sequences with the instruction to detect when violations in the sequence structure occurred. We show that cortical responses simultaneously encode boundaries at multiple levels of a melodic hierarchy, suggesting that the encoding of hierarchical structure is not unique to speech. No effect of musical training on cortical encoding was observed.
| S-EPMC6703931 | biostudies-literature
Project description:Faces convey information about identity and emotional state, both of which are important for our social interactions. Models of face processing propose that changeable versus invariant aspects of a face, specifically facial expression/gaze direction versus facial identity, are coded by distinct neural pathways and yet neurophysiological data supporting this separation are incomplete. We recorded activity from neurons along the inferior bank of the superior temporal sulcus (STS), while monkeys viewed images of conspecific faces and non-face control stimuli. Eight monkey identities were used, each presented with 3 different facial expressions (neutral, fear grin, and threat). All facial expressions were displayed with both a direct and averted gaze. In the posterior STS, we found that about one-quarter of face-responsive neurons are sensitive to social cues, the majority of which being sensitive to only one of these cues. In contrast, in anterior STS, not only did the proportion of neurons sensitive to social cues increase, but so too did the proportion of neurons sensitive to conjunctions of identity with either gaze direction or expression. These data support a convergence of signals related to faces as one moves anteriorly along the inferior bank of the STS, which forms a fundamental part of the face-processing network.
| S-EPMC4537444 | biostudies-literature
Project description:Musical imagery is the voluntary internal hearing of music in the mind without the need for physical action or external stimulation. Numerous studies have already revealed brain areas activated during imagery. However, it remains unclear to what extent imagined music responses preserve the detailed temporal dynamics of the acoustic stimulus envelope and, crucially, whether melodic expectations play any role in modulating responses to imagined music, as they prominently do during listening. These modulations are important as they reflect aspects of the human musical experience, such as its acquisition, engagement, and enjoyment. This study explored the nature of these modulations in imagined music based on EEG recordings from 21 professional musicians (6 females and 15 males). Regression analyses were conducted to demonstrate that imagined neural signals can be predicted accurately, similarly to the listening task, and were sufficiently robust to allow for accurate identification of the imagined musical piece from the EEG. In doing so, our results indicate that imagery and listening tasks elicited an overlapping but distinctive topography of neural responses to sound acoustics, which is in line with previous fMRI literature. Melodic expectation, however, evoked very similar frontal spatial activation in both conditions, suggesting that they are supported by the same underlying mechanisms. Finally, neural responses induced by imagery exhibited a specific transformation from the listening condition, which primarily included a relative delay and a polarity inversion of the response. This transformation demonstrates the top-down predictive nature of the expectation mechanisms arising during both listening and imagery.SIGNIFICANCE STATEMENT It is well known that the human brain is activated during musical imagery: the act of voluntarily hearing music in our mind without external stimulation. It is unclear, however, what the temporal dynamics of this activation are, as well as what musical features are precisely encoded in the neural signals. This study uses an experimental paradigm with high temporal precision to record and analyze the cortical activity during musical imagery. This study reveals that neural signals encode music acoustics and melodic expectations during both listening and imagery. Crucially, it is also found that a simple mapping based on a time-shift and a polarity inversion could robustly describe the relationship between listening and imagery signals.
| S-EPMC8412990 | biostudies-literature
Project description:Prediction of successful memory encoding is important for learning. High-frequency activity (HFA), such as gamma frequency activity (30-150 Hz) of cortical oscillations, is induced during memory tasks and is thought to reflect underlying neuronal processes. Previous studies have demonstrated that medio-temporal electrophysiological characteristics are related to memory formation, but the effects of neocortical neural activity remain underexplored. The main aim of the present study was to evaluate the ability of gamma activity in human electrocorticography (ECoG) signals to differentiate memory processes into remembered and forgotten memories. A support vector machine (SVM) was employed, and ECoG recordings were collected from six subjects during verbal memory recognition task performance. Two-class classification using an SVM was performed to predict subsequently remembered vs. forgotten trials based on individually selected frequencies (low gamma, 30-60 Hz; high gamma, 60-150 Hz) at time points during pre- and during stimulus intervals. The SVM classifier distinguished memory performance between remembered and forgotten trials with a mean maximum accuracy of 87.5% using temporal cortical gamma activity during the 0- to 1-s interval. Our results support the functional relevance of ECoG for memory formation and suggest that lateral temporal cortical HFA may be utilized for memory prediction.
| S-EPMC8185029 | biostudies-literature