Dataset Information

Emotional cues during simultaneous face and voice processing: electrophysiological insights.

ABSTRACT: Both facial expression and tone of voice represent key signals of emotional communication but their brain processing correlates remain unclear. Accordingly, we constructed a novel implicit emotion recognition task consisting of simultaneously presented human faces and voices with neutral, happy, and angry valence, within the context of recognizing monkey faces and voices task. To investigate the temporal unfolding of the processing of affective information from human face-voice pairings, we recorded event-related potentials (ERPs) to these audiovisual test stimuli in 18 normal healthy subjects; N100, P200, N250, P300 components were observed at electrodes in the frontal-central region, while P100, N170, P270 were observed at electrodes in the parietal-occipital region. Results indicated a significant audiovisual stimulus effect on the amplitudes and latencies of components in frontal-central (P200, P300, and N250) but not the parietal occipital region (P100, N170 and P270). Specifically, P200 and P300 amplitudes were more positive for emotional relative to neutral audiovisual stimuli, irrespective of valence, whereas N250 amplitude was more negative for neutral relative to emotional stimuli. No differentiation was observed between angry and happy conditions. The results suggest that the general effect of emotion on audiovisual processing can emerge as early as 200 msec (P200 peak latency) post stimulus onset, in spite of implicit affective processing task demands, and that such effect is mainly distributed in the frontal-central region.

SUBMITTER: Liu T

PROVIDER: S-EPMC3285164 | biostudies-literature | 2012

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Emotional cues during simultaneous face and voice processing: electrophysiological insights.

Liu Taosheng T Pinheiro Ana A Zhao Zhongxin Z Nestor Paul G PG McCarley Robert W RW Niznikiewicz Margaret A MA

PloS one 20120222 2

Both facial expression and tone of voice represent key signals of emotional communication but their brain processing correlates remain unclear. Accordingly, we constructed a novel implicit emotion recognition task consisting of simultaneously presented human faces and voices with neutral, happy, and angry valence, within the context of recognizing monkey faces and voices task. To investigate the temporal unfolding of the processing of affective information from human face-voice pairings, we reco ...[more]

PMID: 22383987

Similar Datasets

Project description:Threatening stimuli seem to capture attention more swiftly than neutral stimuli. This attention bias has been observed under different experimental conditions and with different types of stimuli. It remains unclear whether this adaptive behaviour reflects the function of automatic or controlled attention mechanisms. Additionally, the spatiotemporal dynamics of its neural correlates are largely unknown. The present study investigates these issues using an Emotional Flanker Task synchronized with EEG recordings. A group of 32 healthy participants saw response-relevant images (emotional scenes from IAPS or line drawings of objects) flanked by response-irrelevant distracters (i.e., emotional scenes flanked by line drawings or vice versa). We assessed behavioural and ERP responses drawn from four task conditions (Threat-Central, Neutral-Central, Threat-Peripheral, and Neutral-Peripheral) and subjected these responses to repeated-measures ANOVA models. When presented as response-relevant targets, threatening images attracted faster and more accurate responses. They did not affect response accuracy to targets when presented as response-irrelevant flankers. However, response times were significantly slower when threatening images flanked objects than when neutral images were shown as flankers. This result replicated the well-known Emotional Flanker Effect. Behavioural responses to response-relevant threatening targets were accompanied by significant modulations of ERP activity across all time-windows and regions of interest and displayed some meaningful correlations. The Emotional Flanker Effect was accompanied by a modulation over parietal and central-parietal regions within a time-window between 550-690ms. Such a modulation suggests that the attentional disruption to targets caused by response-irrelevant threatening flankers appears to reflect less neural resources available, which are seemingly drawn away by distracting threatening flankers. The observed spatiotemporal dynamics seem to concur with understanding of the important adaptive role attributed to threat-related attention bias.

Project description:A central question in affective science and one that is relevant for its clinical applications is how emotions provided by different stimuli are experienced and represented in the brain. Following the traditional view emotional signals are recognized with the help of emotion concepts that are typically used in descriptions of mental states and emotional experiences, irrespective of the sensory modality. This perspective motivated the search for abstract representations of emotions in the brain, shared across variations in stimulus type (face, body, voice) and sensory origin (visual, auditory). On the other hand, emotion signals like for example an aggressive gesture, trigger rapid automatic behavioral responses and this may take place before or independently of full abstract representation of the emotion. This pleads in favor specific emotion signals that may trigger rapid adaptative behavior only by mobilizing modality and stimulus specific brain representations without relying on higher order abstract emotion categories. To test this hypothesis, we presented participants with naturalistic dynamic emotion expressions of the face, the whole body, or the voice in a functional magnetic resonance (fMRI) study. To focus on automatic emotion processing and sidestep explicit concept-based emotion recognition, participants performed an unrelated target detection task presented in a different sensory modality than the stimulus. By using multivariate analyses to assess neural activity patterns in response to the different stimulus types, we reveal a stimulus category and modality specific brain organization of affective signals. Our findings are consistent with the notion that under ecological conditions emotion expressions of the face, body and voice may have different functional roles in triggering rapid adaptive behavior, even if when viewed from an abstract conceptual vantage point, they may all exemplify the same emotion. This has implications for a neuroethologically grounded emotion research program that should start from detailed behavioral observations of how face, body, and voice expressions function in naturalistic contexts.

Project description:BackgroundAutism spectrum disorder (ASD) is a neurodevelopmental disorder characterized by impairments in social cognition. The biological basis of deficits in social cognition in ASD, and their difficulty in processing emotional face information in particular, remains unclear. Atypical communication within and between brain regions has been reported in ASD. Interregional phase-locking is a neurophysiological mechanism mediating communication among brain areas and is understood to support cognitive functions. In the present study we investigated interregional magnetoencephalographic phase synchronization during the perception of emotional faces in adolescents with ASD.MethodsA total of 22 adolescents with ASD (18 males, mean age =14.2 ± 1.15 years, 22 right-handed) with mild to no cognitive delay and 17 healthy controls (14 males, mean age =14.4 ± 0.33 years, 16 right-handed) performed an implicit emotional processing task requiring perception of happy, angry and neutral faces while we recorded neuromagnetic signals. The faces were presented rapidly (80 ms duration) to the left or right of a central fixation cross and participants responded to a scrambled pattern that was presented concurrently on the opposite side of the fixation point. Task-dependent interregional phase-locking was calculated among source-resolved brain regions.ResultsTask-dependent increases in interregional beta synchronization were observed. Beta-band interregional phase-locking in adolescents with ASD was reduced, relative to controls, during the perception of angry faces in a distributed network involving the right fusiform gyrus and insula. No significant group differences were found for happy or neutral faces, or other analyzed frequency ranges. Significant reductions in task-dependent beta connectivity strength, clustering and eigenvector centrality (all P <0.001) in the right insula were found in adolescents with ASD, relative to controls.ConclusionsReduced beta synchronization may reflect inadequate recruitment of task-relevant networks during emotional face processing in ASD. The right insula, specifically, was a hub of reduced functional connectivity and may play a prominent role in the inability to effectively extract emotional information from faces. These findings suggest that functional disconnection in brain networks mediating emotional processes may contribute to deficits in social cognition in this population.

Dataset Information

Emotional cues during simultaneous face and voice processing: electrophysiological insights.

Publications

Emotional cues during simultaneous face and voice processing: electrophysiological insights.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets