Dataset Information

Cross-Modal Coordination of Face-Directed Gaze and Emotional Speech Production in School-Aged Children and Adolescents with ASD.

ABSTRACT: Autism spectrum disorder involves persistent difficulties in social communication. Although these difficulties affect both verbal and nonverbal communication, there are no quantitative behavioral studies to date investigating the cross-modal coordination of verbal and nonverbal communication in autism. The objective of the present study was to characterize the dynamic relation between speech production and facial expression in children with autism and to establish how face-directed gaze modulates this cross-modal coordination. In a dynamic mimicry task, experiment participants watched and repeated neutral and emotional spoken sentences with accompanying facial expressions. Analysis of audio and motion capture data quantified cross-modal coordination between simultaneous speech production and facial expression. Whereas neurotypical children produced emotional sentences with strong cross-modal coordination and produced neutral sentences with weak cross-modal coordination, autistic children produced similar levels of cross-modal coordination for both neutral and emotional sentences. An eyetracking analysis revealed that cross-modal coordination of speech production and facial expression was greater when the neurotypical child spent more time looking at the face, but weaker when the autistic child spent more time looking at the face. In sum, social communication difficulties in autism spectrum disorder may involve deficits in cross-modal coordination. This finding may inform how autistic individuals are perceived in their daily conversations.

SUBMITTER: Sorensen T

PROVIDER: S-EPMC6892887 | biostudies-literature | 2019 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Cross-Modal Coordination of Face-Directed Gaze and Emotional Speech Production in School-Aged Children and Adolescents with ASD.

Sorensen Tanner T Zane Emily E Feng Tiantian T Narayanan Shrikanth S Grossman Ruth R

Scientific reports 20191204 1

Autism spectrum disorder involves persistent difficulties in social communication. Although these difficulties affect both verbal and nonverbal communication, there are no quantitative behavioral studies to date investigating the cross-modal coordination of verbal and nonverbal communication in autism. The objective of the present study was to characterize the dynamic relation between speech production and facial expression in children with autism and to establish how face-directed gaze modulate ...[more]

PMID: 31797950

Similar Datasets

Project description:ObjectivesCochlear implants (CIs) are remarkable in allowing individuals with severe to profound hearing loss to perceive speech. Despite these gains in speech understanding, however, CI users often struggle to perceive elements such as vocal emotion and prosody, as CIs are unable to transmit the spectro-temporal detail needed to decode affective cues. This issue becomes particularly important for children with CIs, but little is known about their emotional development. In a previous study, pediatric CI users showed deficits in voice emotion recognition with child-directed stimuli featuring exaggerated prosody. However, the large intersubject variability and differential developmental trajectory known in this population incited us to question the extent to which exaggerated prosody would facilitate performance in this task. Thus, the authors revisited the question with both adult-directed and child-directed stimuli.DesignVocal emotion recognition was measured using both child-directed (CDS) and adult-directed (ADS) speech conditions. Pediatric CI users, aged 7-19 years old, with no cognitive or visual impairments and who communicated through oral communication with English as the primary language participated in the experiment (n = 27). Stimuli comprised 12 sentences selected from the HINT database. The sentences were spoken by male and female talkers in a CDS or ADS manner, in each of the five target emotions (happy, sad, neutral, scared, and angry). The chosen sentences were semantically emotion-neutral. Percent correct emotion recognition scores were analyzed for each participant in each condition (CDS vs. ADS). Children also completed cognitive tests of nonverbal IQ and receptive vocabulary, while parents completed questionnaires of CI and hearing history. It was predicted that the reduced prosodic variations found in the ADS condition would result in lower vocal emotion recognition scores compared with the CDS condition. Moreover, it was hypothesized that cognitive factors, perceptual sensitivity to complex pitch changes, and elements of each child's hearing history may serve as predictors of performance on vocal emotion recognition.ResultsConsistent with our hypothesis, pediatric CI users scored higher on CDS compared with ADS speech stimuli, suggesting that speaking with an exaggerated prosody-akin to "motherese"-may be a viable way to convey emotional content. Significant talker effects were also observed in that higher scores were found for the female talker for both conditions. Multiple regression analysis showed that nonverbal IQ was a significant predictor of CDS emotion recognition scores while Years using CI was a significant predictor of ADS scores. Confusion matrix analyses revealed a dependence of results on specific emotions; for the CDS condition's female talker, participants had high sensitivity (d' scores) to happy and low sensitivity to the neutral sentences while for the ADS condition, low sensitivity was found for the scared sentences.ConclusionsIn general, participants had higher vocal emotion recognition to the CDS condition which also had more variability in pitch and intensity and thus more exaggerated prosody, in comparison to the ADS condition. Results suggest that pediatric CI users struggle with vocal emotion perception in general, particularly to adult-directed speech. The authors believe these results have broad implications for understanding how CI users perceive emotions both from an auditory communication standpoint and a socio-developmental perspective.

Project description:Highlights • Atypical insula activation during facial emotion processing in conduct disorder.• Adolescents with conduct disorder have a reduced gaze allocation to the eyes.• Correcting for gaze behavior reduced group differences in right insula. Background Conduct disorder (CD) is characterized by severe aggressive and antisocial behavior. Initial evidence suggests neural deficits and aberrant eye gaze pattern during emotion processing in CD; both concepts, however, have not yet been studied simultaneously. The present study assessed the functional brain correlates of emotional face processing with and without consideration of concurrent eye gaze behavior in adolescents with CD compared to typically developing (TD) adolescents. Methods 58 adolescents (23CD/35TD; average age = 16 years/range = 14–19 years) underwent an implicit emotional face processing task. Neuroimaging analyses were conducted for a priori-defined regions of interest (insula, amygdala, and medial orbitofrontal cortex) and using a full-factorial design assessing the main effects of emotion (neutral, anger, fear), group and the interaction thereof (cluster-level, p < .05 FWE-corrected) with and without consideration of concurrent eye gaze behavior (i.e., time spent on the eye region). Results Adolescents with CD showed significant hypo-activations during emotional face processing in right anterior insula compared to TD adolescents, independent of the emotion presented. In-scanner eye-tracking data revealed that adolescents with CD spent significantly less time on the eye, but not mouth region. Correcting for eye gaze behavior during emotional face processing reduced group differences previously observed for right insula. Conclusions Atypical insula activation during emotional face processing in adolescents with CD may partly be explained by attentional mechanisms (i.e., reduced gaze allocation to the eyes, independent of the emotion presented). An increased understanding of the mechanism causal for emotion processing deficits observed in CD may ultimately aid the development of personalized intervention programs.

Dataset Information

Cross-Modal Coordination of Face-Directed Gaze and Emotional Speech Production in School-Aged Children and Adolescents with ASD.

Publications

Cross-Modal Coordination of Face-Directed Gaze and Emotional Speech Production in School-Aged Children and Adolescents with ASD.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets