Browse
Submit Data
Databases
API
Help

Dataset Information

17 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Audiovisual non-verbal dynamic faces elicit converging fMRI and ERP responses.

ABSTRACT: In an everyday social interaction we automatically integrate another's facial movements and vocalizations, be they linguistic or otherwise. This requires audiovisual integration of a continual barrage of sensory input-a phenomenon previously well-studied with human audiovisual speech, but not with non-verbal vocalizations. Using both fMRI and ERPs, we assessed neural activity to viewing and listening to an animated female face producing non-verbal, human vocalizations (i.e. coughing, sneezing) under audio-only (AUD), visual-only (VIS) and audiovisual (AV) stimulus conditions, alternating with Rest (R). Underadditive effects occurred in regions dominant for sensory processing, which showed AV activation greater than the dominant modality alone. Right posterior temporal and parietal regions showed an AV maximum in which AV activation was greater than either modality alone, but not greater than the sum of the unisensory conditions. Other frontal and parietal regions showed Common-activation in which AV activation was the same as one or both unisensory conditions. ERP data showed an early superadditive effect (AV > AUD + VIS, no rest), mid-range underadditive effects for auditory N140 and face-sensitive N170, and late AV maximum and common-activation effects. Based on convergence between fMRI and ERP data, we propose a mechanism where a multisensory stimulus may be signaled or facilitated as early as 60 ms and facilitated in sensory-specific regions by increasing processing speed (at N170) and efficiency (decreasing amplitude in auditory and face-sensitive cortical activation and ERPs). Finally, higher-order processes are also altered, but in a more complex fashion.

SUBMITTER: Brefczynski-Lewis J

PROVIDER: S-EPMC2707948 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

Identifying Core Affect in Individuals from fMRI Responses to Dynamic Naturalistic Audiovisual Stimuli.

Project description:Recent research has demonstrated that affective states elicited by viewing pictures varying in valence and arousal are identifiable from whole brain activation patterns observed with functional magnetic resonance imaging (fMRI). Identification of affective states from more naturalistic stimuli has clinical relevance, but the feasibility of identifying these states on an individual trial basis from fMRI data elicited by dynamic multimodal stimuli is unclear. The goal of this study was to determine whether affective states can be similarly identified when participants view dynamic naturalistic audiovisual stimuli. Eleven participants viewed 5s audiovisual clips in a passive viewing task in the scanner. Valence and arousal for individual trials were identified both within and across participants based on distributed patterns of activity in areas selectively responsive to audiovisual naturalistic stimuli while controlling for lower level features of the stimuli. In addition, the brain regions identified by searchlight analyses to represent valence and arousal were consistent with previously identified regions associated with emotion processing. These findings extend previous results on the distributed representation of affect to multimodal dynamic stimuli.

| S-EPMC5012606 | biostudies-literature

The role of emotion in dynamic audiovisual integration of faces and voices.

Project description:We used human electroencephalogram to study early audiovisual integration of dynamic angry and neutral expressions. An auditory-only condition served as a baseline for the interpretation of integration effects. In the audiovisual conditions, the validity of visual information was manipulated using facial expressions that were either emotionally congruent or incongruent with the vocal expressions. First, we report an N1 suppression effect for angry compared with neutral vocalizations in the auditory-only condition. Second, we confirm early integration of congruent visual and auditory information as indexed by a suppression of the auditory N1 and P2 components in the audiovisual compared with the auditory-only condition. Third, audiovisual N1 suppression was modulated by audiovisual congruency in interaction with emotion: for neutral vocalizations, there was N1 suppression in both the congruent and the incongruent audiovisual conditions. For angry vocalizations, there was N1 suppression only in the congruent but not in the incongruent condition. Extending previous findings of dynamic audiovisual integration, the current results suggest that audiovisual N1 suppression is congruency- and emotion-specific and indicate that dynamic emotional expressions compared with non-emotional expressions are preferentially processed in early audiovisual integration.

| S-EPMC4420746 | biostudies-literature

Third-person self-talk facilitates emotion regulation without engaging cognitive control: Converging evidence from ERP and fMRI.

Project description:Does silently talking to yourself in the third-person constitute a relatively effortless form of self control? We hypothesized that it does under the premise that third-person self-talk leads people to think about the self similar to how they think about others, which provides them with the psychological distance needed to facilitate self control. We tested this prediction by asking participants to reflect on feelings elicited by viewing aversive images (Study 1) and recalling negative autobiographical memories (Study 2) using either "I" or their name while measuring neural activity via ERPs (Study 1) and fMRI (Study 2). Study 1 demonstrated that third-person self-talk reduced an ERP marker of self-referential emotional reactivity (i.e., late positive potential) within the first second of viewing aversive images without enhancing an ERP marker of cognitive control (i.e., stimulus preceding negativity). Conceptually replicating these results, Study 2 demonstrated that third-person self-talk was linked with reduced levels of activation in an a priori defined fMRI marker of self-referential processing (i.e., medial prefrontal cortex) when participants reflected on negative memories without eliciting increased levels of activity in a priori defined fMRI markers of cognitive control. Together, these results suggest that third-person self-talk may constitute a relatively effortless form of self-control.

| S-EPMC5495792 | biostudies-literature

Subjectively salient faces differ from emotional faces: ERP evidence.

Project description:The self-face is processed differently than emotional faces. A question arises whether other highly familiar and subjectively significant non-self faces (e.g. partner's face) are also differentiated from emotional faces. The aim of this event-related potential (ERP) study was to investigate the neural correlates of personally-relevant faces (the self and a close-other's) as well as emotionally positive (happy) and neutral faces. Participants were tasked with the simple detection of faces. Amplitudes of N170 were more negative in the right than in the left hemisphere and were not modulated by type of face. A similar pattern of N2 and P3 results for the self-face and close-other's face was observed: they were associated with decreased N2 and increased P3 relative to happy and neutral faces. However, the self-face was preferentially processed also when compared to a close-other's face as revealed by lower N2 and higher P3 amplitudes. Nonparametric cluster-based permutation tests showed an analogous pattern of results: significant clusters for the self-face compared with all other faces (close-other's, happy, neutral) and for close-other's face compared to happy and neutral faces. In summary, the self-face prioritization was observed, as indicated by significant differences between one's own face and all other faces. Crucially, both types of personally-relevant faces differed from happy faces. These findings point to the pivotal role of subjective evaluation of the saliency factor.

| S-EPMC10864357 | biostudies-literature

Subliminal Emotional Faces Elicit Predominantly Right-Lateralized Amygdala Activation: A Systematic Meta-Analysis of fMRI Studies

Project description:Prior research suggests that conscious face processing occurs preferentially in right hemisphere occipito-parietal regions. However, less is known about brain regions associated with non-conscious processing of faces, and whether a right-hemispheric dominance persists in line with specific affective responses. We aim to review the neural responses systematically, quantitatively, and qualitatively underlying subliminal face processing. PubMed was searched for Functional Magnetic Resonance Imaging (fMRI) publications assessing subliminal emotional face stimuli up to March 2022. Activation Likelihood Estimation (ALE) meta-analyses and narrative reviews were conducted on all studies that met ALE requirements. Risk of bias was assessed using the AXIS tool. In a meta-analysis of all 22 eligible studies (merging clinical and non-clinical populations, whole brain and region of interest analyses), bilateral amygdala activation was reported in the left (x = −19.2, y = 1.5, z = −17.1) in 59% of studies, and in the right (x = 24.4, y = −1.7, z = −17.4) in 68% of studies. In a second meta-analysis of non-clinical participants only (n = 18), bilateral amygdala was again reported in the left (x = −18, y = 3.9, z = −18.4) and right (x = 22.8, y = −0.9, z = −17.4) in 56% of studies for both clusters. In a final meta-analysis of whole-brain studies only (n=14), bilateral amygdala was also reported in the left (x = −20.2, y = 2.9, z = −17.2) in 64% of studies, and right (x = 24.2, y = −0.7, z = −17.8) in 71% of studies. The findings suggest that non-consciously detected emotional faces may influence amygdala activation, especially right-lateralized (a higher percentage of convergence in studies), which are integral for pre-conscious affect and long-term memory processing.

| S-EPMC9339677 | biostudies-literature

Dynamic human and avatar facial expressions elicit differential brain responses.

Project description:Computer-generated characters, so-called avatars, are widely used in advertising, entertainment, human-computer interaction or as research tools to investigate human emotion perception. However, brain responses to avatar and human faces have scarcely been studied to date. As such, it remains unclear whether dynamic facial expressions of avatars evoke different brain responses than dynamic facial expressions of humans. In this study, we designed anthropomorphic avatars animated with motion tracking and tested whether the human brain processes fearful and neutral expressions in human and avatar faces differently. Our fMRI results showed that fearful human expressions evoked stronger responses than fearful avatar expressions in the ventral anterior and posterior cingulate gyrus, the anterior insula, the anterior and posterior superior temporal sulcus, and the inferior frontal gyrus. Fearful expressions in human and avatar faces evoked similar responses in the amygdala. We did not find different responses to neutral human and avatar expressions. Our results highlight differences, but also similarities in the processing of fearful human expressions and fearful avatar expressions even if they are designed to be highly anthropomorphic and animated with motion tracking. This has important consequences for research using dynamic avatars, especially when processes are investigated that involve cortical and subcortical regions.

| S-EPMC7235958 | biostudies-literature

From Sensory Perception to Lexical-Semantic Processing: An ERP Study in Non-Verbal Children with Autism.

Project description:This study examines electrocortical activity associated with visual and auditory sensory perception and lexical-semantic processing in nonverbal (NV) or minimally-verbal (MV) children with Autism Spectrum Disorder (ASD). Currently, there is no agreement on whether these children comprehend incoming linguistic information and whether their perception is comparable to that of typically developing children. Event-related potentials (ERPs) of 10 NV/MV children with ASD and 10 neurotypical children were recorded during a picture-word matching paradigm. Atypical ERP responses were evident at all levels of processing in children with ASD. Basic perceptual processing was delayed in both visual and auditory domains but overall was similar in amplitude to typically-developing children. However, significant differences between groups were found at the lexical-semantic level, suggesting more atypical higher-order processes. The results suggest that although basic perception is relatively preserved in NV/MV children with ASD, higher levels of processing, including lexical- semantic functions, are impaired. The use of passive ERP paradigms that do not require active participant response shows significant potential for assessment of non-compliant populations such as NV/MV children with ASD.

| S-EPMC4999236 | biostudies-literature

Typical asymmetry in the hemispheric activation during an fMRI verbal comprehension paradigm is related to better performance in verbal and non-verbal tasks in patients with epilepsy.

Project description:Chronic exposure to seizures in patients with left hemisphere (LH) epileptic focus could favor higher activation in the contralateral hemisphere during language processing, but the cognitive effects of this remain unclear. This study assesses the relationship between asymmetry in hemispheric activation during language fMRI and performance in verbal and non-verbal tasks. Whereas prior studies primarily used fMRI paradigms that favor frontal lobe activation and less prominent activation of the medial or superior temporal lobes, we used a verbal comprehension paradigm previously demonstrated to activate reliably receptive language areas. Forty-seven patients with drug-resistant epilepsy candidates for surgery underwent a multidisciplinary assessment, including a comprehensive neuropsychological evaluation and an fMRI verbal comprehension paradigm. Patients were distributed in two groups depending on laterality indexes (LI): typical hemispheric asymmetry (unilateral left activation preponderance; n = 23) and atypical hemispheric asymmetry (bilateral or unilateral right preponderance; n = 24). Right-handedness and right hemisphere (RH) focus were significant predictors of typical asymmetry. Patients with typical activation pattern presented better performance intelligence quotient and verbal learning than patients with atypical hemispheric asymmetry (for all, p < 0.014). Patients with LH focus had more frequently atypical hemispheric asymmetry than patients with RH focus (p = 0.05). Specifically, they showed lower LI and this was related to worse performance in verbal and non-verbal tasks. In conclusion, an increased activation of homologous RH areas for verbal comprehension processing could imply a competition of cognitive resources in the performance of the same task, disrupting cognitive performance.

| S-EPMC6154460 | biostudies-literature

Joint ICA of ERP and fMRI during error-monitoring.

Project description:The anterior cingulate cortex (ACC) is commonly separated into two functional divisions: the cognitive division, which lies in the caudal region and the affective division, which lies in the rostral region of the ACC. Both regions of the ACC are engaged during error-monitoring tasks; however, little is known about the temporal sequencing associated with cognition and affective processes during error-monitoring. Here we use joint Independent Component Analysis (jICA) to couple event-related potential (ERP) time courses and functional magnetic resonance imaging (fMRI) spatial maps to examine the spatio-temporal stages of engagement in the two divisions of the ACC during error-monitoring. Consistent with hypotheses, two of the five significant spatio-temporal components identified by jICA revealed that the error-related negativity (ERN) ERP was associated with distinct spatial fMRI patterns in the ACC. The ERN(1) was associated with activity in the caudal ACC and lateral prefrontal cortex (lPFC) while the ERN(2) was associated with activity in the rostral ACC. These results suggest that during error-monitoring the caudal ACC and lPFC engage prior to the rostral ACC. These results suggest that cognition precedes affect during error-monitoring.

| S-EPMC3230687 | biostudies-literature

Dynamic faces speed up the onset of auditory cortical spiking responses during vocal detection.

Project description:How low-level sensory areas help mediate the detection and discrimination advantages of integrating faces and voices is the subject of intense debate. To gain insights, we investigated the role of the auditory cortex in face/voice integration in macaque monkeys performing a vocal-detection task. Behaviorally, subjects were slower to detect vocalizations as the signal-to-noise ratio decreased, but seeing mouth movements associated with vocalizations sped up detection. Paralleling this behavioral relationship, as the signal to noise ratio decreased, the onset of spiking responses were delayed and magnitudes were decreased. However, when mouth motion accompanied the vocalization, these responses were uniformly faster. Conversely, and at odds with previous assumptions regarding the neural basis of face/voice integration, changes in the magnitude of neural responses were not related consistently to audiovisual behavior. Taken together, our data reveal that facilitation of spike latency is a means by which the auditory cortex partially mediates the reaction time benefits of combining faces and voices.

| S-EPMC3845123 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data