Dataset Information

Multimodal Communication in Aphasia: Perception and Production of Co-speech Gestures During Face-to-Face Conversation.

ABSTRACT: The role of nonverbal communication in patients with post-stroke language impairment (aphasia) is not yet fully understood. This study investigated how aphasic patients perceive and produce co-speech gestures during face-to-face interaction, and whether distinct brain lesions would predict the frequency of spontaneous co-speech gesturing. For this purpose, we recorded samples of conversations in patients with aphasia and healthy participants. Gesture perception was assessed by means of a head-mounted eye-tracking system, and the produced co-speech gestures were coded according to a linguistic classification system. The main results are that meaning-laden gestures (e.g., iconic gestures representing object shapes) are more likely to attract visual attention than meaningless hand movements, and that patients with aphasia are more likely to fixate co-speech gestures overall than healthy participants. This implies that patients with aphasia may benefit from the multimodal information provided by co-speech gestures. On the level of co-speech gesture production, we found that patients with damage to the anterior part of the arcuate fasciculus showed a higher frequency of meaning-laden gestures. This area lies in close vicinity to the premotor cortex and is considered to be important for speech production. This may suggest that the use of meaning-laden gestures depends on the integrity of patients' speech production abilities.

SUBMITTER: Preisig BC

PROVIDER: S-EPMC6010555 | biostudies-literature | 2018

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Multimodal Communication in Aphasia: Perception and Production of Co-speech Gestures During Face-to-Face Conversation.

Preisig Basil C BC Eggenberger Noëmi N Cazzoli Dario D Nyffeler Thomas T Gutbrod Klemens K Annoni Jean-Marie JM Meichtry Jurka R JR Nef Tobias T Müri René M RM

Frontiers in human neuroscience 20180614

The role of nonverbal communication in patients with post-stroke language impairment (aphasia) is not yet fully understood. This study investigated how aphasic patients perceive and produce co-speech gestures during face-to-face interaction, and whether distinct brain lesions would predict the frequency of spontaneous co-speech gesturing. For this purpose, we recorded samples of conversations in patients with aphasia and healthy participants. Gesture perception was assessed by means of a head-mo ...[more]

PMID: 29962942

Similar Datasets

Project description:Background and aimsHumans communicate primarily through spoken language and speech perception is a core function of the human auditory system. Among the autistic community, atypical sensory reactivity and social communication difficulties are pervasive, yet the research literature lacks in-depth self-report data on speech perception in this population. The present study aimed to elicit detailed first-person accounts of autistic individuals' abilities and difficulties perceiving the spoken word.MethodsSemi-structured interviews were conducted with nine autistic adults. The interview schedule addressed interviewees' experiences of speech perception, factors influencing those experiences, and responses to those experiences. Resulting interview transcripts underwent thematic analysis. The six-person study team included two autistic researchers, to reduce risk of neurotypical 'overshadowing' of autistic voices.ResultsMost interviewees reported pronounced difficulties perceiving speech in the presence of competing sounds. They emphasised that such listening difficulties are distinct from social difficulties, though the two can add and interact. Difficulties were of several varieties, ranging from powerful auditory distraction to drowning out of voices by continuous sounds. Contributing factors encompassed not only features of the soundscape but also non-acoustic factors such as multisensory processing and social cognition. Participants also identified compounding factors, such as lack of understanding of listening difficulties. Impacts were diverse and sometimes disabling, affecting socialising, emotions, fatigue, career, and self-image. A wide array of coping mechanisms was described.ConclusionsThe first in-depth qualitative investigation of autistic speech-perception experiences has revealed diverse and widespread listening difficulties. These can combine with other internal, interpersonal, and societal factors to induce profound impacts. Lack of understanding of such listening difficulties - by the self, by communication partners, by institutions, and especially by clinicians - appears to be a crucial exacerbating factor. Many autistic adults have developed coping strategies to lessen speech-perception difficulties or mitigate their effects, and these are generally self-taught due to lack of clinical support.ImplicationsThere is a need for carefully designed, adequately powered confirmatory research to verify, quantify, and disentangle the various forms of listening difficulty, preferably using large samples to explore heterogeneity. More immediate benefit might be obtained through development of self-help and clinical guidance materials, and by raising awareness of autistic listening experiences and needs, among the autistic community, communication partners, institutions, and clinicians.

Project description:Previous work on placement expressions (e.g., "she put the cup on the table") has demonstrated cross-linguistic differences in the specificity of placement expressions in the native language (L1), with some languages preferring more general, widely applicable expressions and others preferring more specific expressions based on more fine-grained distinctions. Research on second language (L2) acquisition of an additional spoken language has shown that learning the appropriate L2 placement distinctions poses a challenge for adult learners whose L2 semantic representations can be non-target like and have fuzzy boundaries. Unknown is whether similar effects apply to learners acquiring a L2 in a different sensory-motor modality, e.g., hearing learners of a sign language. Placement verbs in signed languages tend to be highly iconic and to exhibit transparent semantic boundaries. This may facilitate acquisition of signed placement verbs. In addition, little is known about how exposure to different semantic boundaries in placement events in a typologically different language affects lexical semantic meaning in the L1. In this study, we examined placement event descriptions (in American Sign Language (ASL) and English) in hearing L2 learners of ASL who were native speakers of English. L2 signers' ASL placement descriptions looked similar to those of two Deaf, native ASL signer controls, suggesting that the iconicity and transparency of placement distinctions in the visual modality may facilitate L2 acquisition. Nevertheless, L2 signers used a wider range of handshapes in ASL and used them less appropriately, indicating that fuzzy semantic boundaries occur in cross-modal L2 acquisition as well. In addition, while the L2 signers' English verbal expressions were not different from those of a non-signing control group, placement distinctions expressed in co-speech gesture were marginally more ASL-like for L2 signers, suggesting that exposure to different semantic boundaries can cause changes to how placement is conceptualized in the L1 as well.

Project description:Purpose Individuals with primary progressive apraxia of speech (AOS) have AOS in which disruptions in articulation and prosody predominate the speech pattern. Many develop aphasia and/or dysarthria later in the disease course. The aim of this study was to describe the communication limitations in these patients, as measured by (a) the patient via the Communicative Participation Item Bank (CPIB) and (b) the speech-language pathologist via the American Speech-Language-Hearing Association's (ASHA) Functional Communication Measures (FCMs) and an adapted motor speech disorder (MSD) severity rating. Method Speech and language evaluations were completed for 24 patients with progressive AOS (n = 7 with isolated AOS; n = 17 with a combination of AOS and aphasia). Descriptive comparisons were utilized to evaluate differences in communication measures among patients with various combinations of MSDs and aphasia. Differences associated with phonetic predominant or prosodic predominant AOS were also examined. Across the entire cohort, correlations were calculated between the participation ratings and other clinical assessment measures. Results The CPIB reflected greater limitations for those with aphasia and AOS compared to isolated AOS, but was not notably different when dysarthria occurred with AOS (n = 9/24). Across the cohort, there were statistically significant correlations between the CPIB and ASHA FCM-Motor Speech and Language Expression ratings and the MSD severity rating. The CPIB did not correlate with the ASHA FCM-Language Comprehension or other speech-language measures. Conclusions Patients with neurodegenerative AOS experience reduced participation in communication that is further exacerbated by co-occurring language deficits. The study suggests measures of severity cannot be assumed to correlate with measures of participation restrictions and offers a foundation for further research examining the day-to-day sequela of progressive speech and language disorders. Supplemental Material https://doi.org/10.23641/asha.12743252.

Project description:Face-to-face communication is multimodal; it encompasses spoken words, facial expressions, gaze, and co-speech gestures. In contrast to linguistic symbols (e.g., spoken words or signs in sign language) relying on mostly explicit conventions, gestures vary in their degree of conventionality. Bodily signs may have a general accepted or conventionalized meaning (e.g., a head shake) or less so (e.g., self-grooming). We hypothesized that subjective perception of conventionality in co-speech gestures relies on the classical language network, i.e., the left hemispheric inferior frontal gyrus (IFG, Broca's area) and the posterior superior temporal gyrus (pSTG, Wernicke's area) and studied 36 subjects watching video-recorded story retellings during a behavioral and an functional magnetic resonance imaging (fMRI) experiment. It is well documented that neural correlates of such naturalistic videos emerge as intersubject covariance (ISC) in fMRI even without involving a stimulus (model-free analysis). The subjects attended either to perceived conventionality or to a control condition (any hand movements or gesture-speech relations). Such tasks modulate ISC in contributing neural structures and thus we studied ISC changes to task demands in language networks. Indeed, the conventionality task significantly increased covariance of the button press time series and neuronal synchronization in the left IFG over the comparison with other tasks. In the left IFG, synchronous activity was observed during the conventionality task only. In contrast, the left pSTG exhibited correlated activation patterns during all conditions with an increase in the conventionality task at the trend level only. Conceivably, the left IFG can be considered a core region for the processing of perceived conventionality in co-speech gestures similar to spoken language. In general, the interpretation of conventionalized signs may rely on neural mechanisms that engage during language comprehension.

Dataset Information

Multimodal Communication in Aphasia: Perception and Production of Co-speech Gestures During Face-to-Face Conversation.

Publications

Multimodal Communication in Aphasia: Perception and Production of Co-speech Gestures During Face-to-Face Conversation.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets