What you say versus how you say it: Comparing sentence comprehension and emotional prosody processing using fMRI.
Ontology highlight
ABSTRACT:
SUBMITTER: Seydell-Greenwald A
PROVIDER: S-EPMC7056507 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:This study investigated the interaction of prosody and thematic fit/plausibility information during the processing of sentences containing temporary early closure (correct) or late closure (incorrect) syntactic ambiguities using event-related potentials (ERPs). Early closure sentences with congruent and incongruent prosody were presented where the temporarily ambiguous NP was either a plausible or an implausible continuation for the subordinate verb (e.g. "While the band played the song/beer pleased all the customers."). N400 and P600 components were examined at critical points in each condition. The CPS was examined in sentences with congruent prosody. Prosodic and thematic fit cues interacted immediately (N400-P600) at the implausible NP (beer), when it was paired with incongruent prosody. Incongruent prosody paired with a plausible NP (song) resulted in garden-path effects (N400-P600) at the critical verb (pleased). These findings provide strong evidence that prosodic and thematic fit/plausibility cues interact to aid the parser in syntactic structure building.
| S-EPMC5997268 | biostudies-literature
Project description:The reproducibility of three different aspects of fMRI activations-namely binary activation maps, effect size and spatial distribution of local maxima-was evaluated for an auditory sentence comprehension task with high attention demand on a group of 17 subjects that were scanned on five different occasions. While in the scanner subjects were asked to listen to a series of six short everyday sentences from the CUNY sentence test. Comprehension and attention to the stimuli were monitored after each listen condition epoch by having subjects answer a series of multiple-choice questions. Statistical maps of activation for the listen condition were computed at three different levels: overall results for all imaging sessions, group-level/single-session results for each of the five imaging occasions, and single-subject/single-session results computed for each subject and each scanning occasion independently. The experimental task recruited a distributed bilateral network with processing nodes located in the lateral temporal cortex, inferior frontal cortex, medial BA6, medial occipital cortex and subcortical structures such as the putamen and the thalamus. Reproducibility of these activations at the group level was high (83.95% of the imaged volume was consistently classified as active/inactive across all five imaging sessions), indicating that sites of neuronal activity associated with auditory comprehension can reliably be detected with fMRI in healthy subjects, across repeated measures after group averaging. At the single-subject level reproducibility ranged from moderate to high, although no significant differences were found on behavioral measures across subjects or sessions. This result suggests that contextual differences-i.e., those specific to each imaging session, can modulate our ability to detect fMRI activations associated with speech comprehension in individual subjects.
| S-EPMC3008333 | biostudies-literature
Project description:Individuals with Autism Spectrum Disorder (ASD) are characterized by severe deficits in social communication, whereby the nature of their impairments in emotional prosody processing have yet to be specified. Here, we investigated emotional prosody processing in individuals with ASD and controls with novel, lifelike behavioral and neuroimaging paradigms. Compared to controls, individuals with ASD showed reduced emotional prosody recognition accuracy on a behavioral task. On the neural level, individuals with ASD displayed reduced activity of the STS, insula and amygdala for complex vs basic emotions compared to controls. Moreover, the coupling between the STS and amygdala for complex vs basic emotions was reduced in the ASD group. Finally, groups differed with respect to the relationship between brain activity and behavioral performance. Brain activity during emotional prosody processing was more strongly related to prosody recognition accuracy in ASD participants. In contrast, the coupling between STS and anterior cingulate cortex (ACC) activity predicted behavioral task performance more strongly in the control group. These results provide evidence for aberrant emotional prosody processing of individuals with ASD. They suggest that the differences in the relationship between the neural and behavioral level of individuals with ASD may account for their observed deficits in social communication.
| S-EPMC5390729 | biostudies-literature
Project description:Catecholamine (CA) function has been widely implicated in cognitive functions that are tied to the prefrontal cortex and striatal areas. The present study investigated the effects of methylphenidate, which is a CA agonist, on the electroencephalogram (EEG) response related to semantic processing using a double-blind, placebo-controlled, randomized, crossover, within-subject design. Forty-eight healthy participants read semantically congruent or incongruent sentences after receiving 20-mg methylphenidate or a placebo while their brain activity was monitored with EEG. To probe whether the catecholaminergic modulation is task-dependent, in one condition participants had to focus on comprehending the sentences, while in the other condition, they only had to attend to the font size of the sentence. The results demonstrate that methylphenidate has a task-dependent effect on semantic processing. Compared to placebo, when semantic processing was task-irrelevant, methylphenidate enhanced the detection of semantic incongruence as indexed by a larger N400 amplitude in the incongruent sentences; when semantic processing was task-relevant, methylphenidate induced a larger N400 amplitude in the semantically congruent condition, which was followed by a larger late positive complex effect. These results suggest that CA-related neurotransmitters influence language processing, possibly through the projections between the prefrontal cortex and the striatum, which contain many CA receptors.
| S-EPMC7609945 | biostudies-literature
Project description:Much research in cognitive neuroscience supports prediction as a canonical computation of cognition across domains. Is such predictive coding implemented by feedback from higher-order domain-general circuits, or is it locally implemented in domain-specific circuits? What information sources are used to generate these predictions? This study addresses these two questions in the context of language processing. We present fMRI evidence from a naturalistic comprehension paradigm (1) that predictive coding in the brain's response to language is domain-specific, and (2) that these predictions are sensitive both to local word co-occurrence patterns and to hierarchical structure. Using a recently developed continuous-time deconvolutional regression technique that supports data-driven hemodynamic response function discovery from continuous BOLD signal fluctuations in response to naturalistic stimuli, we found effects of prediction measures in the language network but not in the domain-general multiple-demand network, which supports executive control processes and has been previously implicated in language comprehension. Moreover, within the language network, surface-level and structural prediction effects were separable. The predictability effects in the language network were substantial, with the model capturing over 37% of explainable variance on held-out data. These findings indicate that human sentence processing mechanisms generate predictions about upcoming words using cognitive processes that are sensitive to hierarchical structure and specialized for language processing, rather than via feedback from high-level executive control mechanisms.
| S-EPMC7140726 | biostudies-literature
Project description:Sentences such as The author started the book are indeterminate because they do not make explicit what the subject (the author) started doing with the object (the book). In principle, indeterminate sentences allow for an infinite number of interpretations. One theory, however, assumes that these sentences are resolved by semanticcoercion, a linguistic process that forces the noun book to be interpreted as an activity (e.g., writing the book) or by a process that interpolates this activity information in the resulting enriched semantic composition. An alternative theory, pragmatic, assumes classical semantic composition, whereby meaning arises from the denotation of words and how they are combined syntactically, with enrichment obtained via pragmatic inferences beyond linguistic-semantic processes. Cognitive neuroscience studies investigating the neuroanatomical and functional correlates of indeterminate sentences have shown activations either at the ventromedial pre-frontal cortex (vmPFC) or at the left inferior frontal gyrus (L-IFG). These studies have supported the semantic coercion theory assuming that one of these regions is where enriched semantic composition takes place. Employing functional magnetic resonance imaging (fMRI), we found that indeterminate sentences activate bilaterally the superior temporal gyrus (STG), the right inferior frontal gyrus (R-IFG), and the anterior cingulate cortex (ACC), more so than control sentences (The author wrote the book). Activation of indeterminate sentences exceeded that of anomalous sentences (…drank the book) and engaged more left- and right-hemisphere areas than other sentence types. We suggest that the widespread activations for indeterminate sentences represent the deployment of pragmatic-inferential processes, which seek to enrich sentence content without necessarily resorting to semantic coercion.
| S-EPMC5168646 | biostudies-literature
Project description:BACKGROUND: Although impaired decoding of emotional prosody has frequently been associated with Parkinson's disease (PD), to date only few reports have sought to explore the effect of Parkinson's treatment on disturbances of prosody decoding. In particular, little is known about how surgical treatment approaches such as high frequency deep brain stimulation (DBS) affect emotional speech perception in patients with PD. Accordingly, the objective of this study was to evaluate the effect of subthalamic nucleus (STN) stimulation on prosody processing. METHODOLOGY/PRINCIPAL FINDINGS: To this end the performance of 13 PD patients on three tasks requiring the decoding of emotional speech was assessed and subsequently compared to the performance of healthy control individuals. To delineate the effect of STN-DBS, all patients were tested with stimulators turned on as well as with stimulators turned off. Results revealed that irrespective of whether assessments were made "on" or "off" stimulation, patients' performance was less accurate as compared to healthy control participants on all tasks employed in this study. However, while accuracy appeared to be unaffected by stimulator status, a facilitation of reactions specific to highly conflicting emotional stimulus material (i.e. stimulus material presenting contradicting emotional messages on a verbal and non-verbal prosodic level) was observed during "on" stimulation assessments. CONCLUSION: In sum, presented results suggest that the processing of emotional speech is indeed modulated by STN-DBS. Observed alterations might, on the one hand, reflect a more efficient processing of highly conflicting stimulus material following DBS. However, on the other hand, given the lack of an improvement in accuracy, increased impulsivity associated with STN stimulation needs to be taken into consideration.
| S-EPMC3084266 | biostudies-other
Project description:The aim of this study was to validate a procedure for performing the audio-visual paradigm introduced by Wendt et al. (2015) with reduced practical challenges. The original paradigm records eye fixations using an eye tracker and calculates the duration of sentence comprehension based on a bootstrap procedure. In order to reduce practical challenges, we first reduced the measurement time by evaluating a smaller measurement set with fewer trials. The results of 16 listeners showed effects comparable to those obtained when testing the original full measurement set on a different collective of listeners. Secondly, we introduced electrooculography as an alternative technique for recording eye movements. The correlation between the results of the two recording techniques (eye tracker and electrooculography) was r = 0.97, indicating that both methods are suitable for estimating the processing duration of individual participants. Similar changes in processing duration arising from sentence complexity were found using the eye tracker and the electrooculography procedure. Thirdly, the time course of eye fixations was estimated with an alternative procedure, growth curve analysis, which is more commonly used in recent studies analyzing eye tracking data. The results of the growth curve analysis were compared with the results of the bootstrap procedure. Both analysis methods show similar processing durations.
| S-EPMC5072642 | biostudies-other
Project description:Previous studies have shown that brain regions for mentalizing, including temporoparietal junction (TPJ) and medial prefrontal cortex (mPFC), are activated in understanding the nonliteral meaning of sentences. A different set of brain regions, including left inferior frontal gyrus (IFG), is activated for dealing with pragmatic incongruence. Here we demonstrate that individuals' cognitive empathic ability modulates the brain activity underlying the processing of pragmatic constraints during sentence comprehension. The lian … dou … construction in Chinese (similar to English even) normally describes an event of low expectedness; it also introduces a pragmatic scale against which the likelihood of an underspecified event can be inferred. By embedding neutral or highly likely events in the construction, we created underspecified and incongruent sentences and compared both with control sentences in which events of low expectedness were described. Imaging results showed that (i) left TPJ was activated for the underspecified sentences, and the activity in mPFC correlated with individuals' fantasizing ability and (ii) anterior cingulate cortex (ACC) was activated for the incongruent sentences, and the activity in bilateral IFG correlated with individuals' perspective taking ability. These findings suggest that brain activations in making pragmatic inference and in dealing with pragmatic failure are modulated by different components of cognitive empathy.
| S-EPMC4127016 | biostudies-literature
Project description:Non-canonical sentence comprehension impairments are well-documented in aphasia. Studies of neurotypical controls indicate that prosody can aid comprehension by facilitating attention towards critical pitch inflections and phrase boundaries. However, no studies have examined how prosody may engage specific cognitive and neural resources during non-canonical sentence comprehension in persons with left hemisphere damage. Experiment 1 examines the relationship between comprehension of non-canonical sentences spoken with typical and atypical prosody and several cognitive measures in 25 persons with chronic left hemisphere stroke and 20 matched controls. Experiment 2 explores the neural resources critical for non-canonical sentence comprehension with each prosody type using region-of-interest-based multiple regressions. Lower orienting attention abilities and greater inferior frontal and parietal damage predicted lower comprehension, but only for sentences with typical prosody. Our results suggest that typical sentence prosody may engage attention resources to support non-canonical sentence comprehension, and this relationship may be disrupted following left hemisphere stroke.
| S-EPMC7064294 | biostudies-literature