Dataset Information

Hearing Status Affects Children's Emotion Understanding in Dynamic Social Situations: An Eye-Tracking Study.

ABSTRACT:

Objectives

For children to understand the emotional behavior of others, the first two steps involve emotion encoding and emotion interpreting, according to the Social Information Processing model. Access to daily social interactions is prerequisite to a child acquiring these skills, and barriers to communication such as hearing loss impede this access. Therefore, it could be challenging for children with hearing loss to develop these two skills. The present study aimed to understand the effect of prelingual hearing loss on children's emotion understanding, by examining how they encode and interpret nonverbal emotional cues in dynamic social situations.

Design

Sixty deaf or hard-of-hearing (DHH) children and 71 typically hearing (TH) children (3-10 years old, mean age 6.2 years, 54% girls) watched videos of prototypical social interactions between a target person and an interaction partner. At the end of each video, the target person did not face the camera, rendering their facial expressions out of view to participants. Afterward, participants were asked to interpret the emotion they thought the target person felt at the end of the video. As participants watched the videos, their encoding patterns were examined by an eye tracker, which measured the amount of time participants spent looking at the target person's head and body and at the interaction partner's head and body. These regions were preselected for analyses because they had been found to provide cues for interpreting people's emotions and intentions.

Results

When encoding emotional cues, both the DHH and TH children spent more time looking at the head of the target person and at the head of the interaction partner than they spent looking at the body or actions of either person. Yet, compared with the TH children, the DHH children looked at the target person's head for a shorter time (b = -0.03, p = 0.030), and at the target person's body (b = 0.04, p = 0.006) and at the interaction partner's head (b = 0.03, p = 0.048) for a longer time. The DHH children were also less accurate when interpreting emotions than their TH peers (b = -0.13, p = 0.005), and their lower scores were associated with their distinctive encoding pattern.

Conclusions

The findings suggest that children with limited auditory access to the social environment tend to collect visually observable information to compensate for ambiguous emotional cues in social situations. These children may have developed this strategy to support their daily communication. Yet, to fully benefit from such a strategy, these children may need extra support for gaining better social-emotional knowledge.

SUBMITTER: Tsou YT

PROVIDER: S-EPMC8221710 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ObjectivesUnilateral hearing loss increases the risk of academic and behavioral challenges for school-aged children. Previous research suggests that remote microphone (RM) systems offer the most consistent benefits for children with unilateral hearing loss in classroom environments relative to other nonsurgical interventions. However, generalizability of previous laboratory work is limited because of the specific listening situations evaluated, which often included speech and noise signals originating from the side. In addition, early studies focused on speech recognition tasks requiring limited cognitive engagement. However, those laboratory conditions do not reflect characteristics of contemporary classrooms, which are cognitively demanding and typically include multiple talkers of interest in relatively diffuse background noise. The purpose of this study was to evaluate the potential effects of rerouting amplification systems, specifically a RM system and a contralateral routing of signal (CROS) system, on speech recognition and comprehension of school-age children in a laboratory environment designed to emulate the dynamic characteristics of contemporary classrooms. It was expected that listeners would benefit from the CROS system when the head shadow limits audibility (e.g., monaural indirect listening). It was also expected that listeners would benefit from the RM system only when the RM was near the talker of interest.DesignTwenty-one children (10 to 14 years, M = 11.86) with normal hearing participated in laboratory tests of speech recognition and comprehension. Unilateral hearing loss was simulated by presenting speech-shaped masking noise to one ear via an insert earphone. Speech stimuli were presented from 1 of 4 loudspeakers located at either 0°, +45°, -90°, and -135° or 0°, -45°, +90°, and +135°. Cafeteria noise was presented from separate loudspeakers surrounding the listener. Participants repeated sentences (sentence recognition) and also answered questions after listening to an unfamiliar story (comprehension). They were tested unaided, with a RM system (microphone near the front loudspeaker), and with a CROS system (ear-level microphone on the ear with simulated hearing loss).ResultsRelative to unaided listening, both rerouting systems reduced sentence recognition performance for most signals originating near the ear with normal hearing (monaural direct loudspeakers). Only the RM system improved speech recognition for midline signals, which were near the RM. Only the CROS system significantly improved speech recognition for signals originating near the ear with simulated hearing loss (monaural indirect loudspeakers). Although the benefits were generally small (approximately 6.5 percentage points), the CROS system also improved comprehension scores, which reflect overall listening across all four loudspeakers. Conversely, the RM system did not improve comprehension scores relative to unaided listening.ConclusionsBenefits of the CROS system in this study were small, specific to situations where speech is directed toward the ear with hearing loss, and relative only to a RM system utilizing one microphone. Although future study is warranted to evaluate the generalizability of the findings, the data demonstrate both CROS and RM systems are nonsurgical interventions that have the potential to improve speech recognition and comprehension for children with limited useable unilateral hearing in dynamic, noisy classroom situations.

Project description:BackgroundCurrent tasks measuring social cognition are usually 'pen and paper' tasks, have ceiling effects and include complicated test instructions that may be difficult to understand for those with cognitive impairment. We therefore aimed to develop a set of simple, instructionless, quantitative, tasks of emotion recognition using the methodology of eye tracking, with the subsequent aim of assessing their utility in individuals with behavioural variant frontotemporal dementia (bvFTD).MethodsUsing the Eyelink 1000 Plus eye tracker, 18 bvFTD and 22 controls completed tasks of simple and complex emotion recognition that involved viewing four images (one target face (simple) or pair of eyes (complex) and the others non-target) followed by a target emotion word and lastly the original four images alongside the emotion word. A dwell time change score was then calculated as the main outcome measure by subtracting the percentage dwell time for the target image before the emotion word appeared away from the percentage dwell time for the target image after the emotion word appeared. All participants also underwent a standard cognitive battery and volumetric T1-weighted magnetic resonance imaging.ResultsAnalysis using a mixed effects model showed that the average (standard deviation) mean dwell time change score in the target interest area was 35 (27)% for the control group compared with only 4 (18)% for the bvFTD group (p < 0.05) for the simple emotion recognition task, and 15 (26)% for the control group compared with only 2 (18)% for the bvFTD group (p < 0.05) for the complex emotion recognition task. Worse performance in the bvFTD group correlated with atrophy in the right ventromedial prefrontal and orbitofrontal cortices, brain regions previously implicated in social cognition.ConclusionsIn summary, eye tracking is a viable tool for assessing social cognition in individuals with bvFTD, being well-tolerated and able to overcome some of the problems associated with standard psychometric tasks.

Project description:BackgroundCognitive ergonomics design of patient monitoring may reduce human factor errors in high-stress environments. Eye-tracking is a suitable tool to gain insight into the distribution of visual attention of healthcare professionals with patient monitors, which may facilitate their further development.MethodsThis prospective, exploratory, high-fidelity simulation study compared anesthesia personnel's visual attention (fixation count and dwell-time) to 15 areas of interest on the patient monitor during non-critical and critical anesthesia situations. Furthermore, we examined the extent to which participants' experience influenced visual attention and which vital signs displayed on the patient monitor received the most visual attention. We used mixed zero-inflated Poisson regression and mixed linear models to analyze the data.ResultsAnalyzing 23 ten-minute scenarios, we found significantly more fixations to the areas of interest on the patient monitor during critical than non-critical situations (rate ratio of 1.45; 95% CI 1.33 to 1.59; p < 0.001). However, the dwell-time on the areas of interest did not significantly differ between the non-critical and critical situations (coefficient of - 1.667; 95% CI - 4.549 to 1.229; p = 0.27). The professional experience did not significantly influence the visual attention (fixation: rate ratio of 0.88; 95% CI 0.54 to 1.43; p = 0.61 and dwell-time: coefficient of 0.889; 95% CI - 1.465 to 3.229; p = 0.27). Over all situations, anesthesia personnel paid the most attention to the vital signs blood pressure (fixation: mean [SD] of 108 [74.83]; dwell-time: mean [SD] of 27 [15.90] seconds), end-expiratory carbon dioxide (fixation: mean [SD] of 59 [47.39]; dwell-time: mean [SD] of 30 [21.51] seconds), and the electrocardiogram (fixation: mean [SD] of 58 [64.70]; dwell-time: mean [SD] of 15 [14.95] seconds).ConclusionsCritical anesthesia situations increased anesthesia personnel's visual interaction with the patient monitor. Furthermore, we found that their visual attention focused mainly on a few vital signs. To assist clinicians in critical situations, manufacturers should optimize monitors to convey necessary information as easily and quickly as possible and optimize the visibility of less frequently observed but equally critical vital signs, especially when they are in an abnormal range.

Project description:As children learn they use their speech to express words and their hands to gesture. This study investigates the interplay between real-time gestures and speech as children construct cognitive understanding during a hands-on science task. 12 children (M = 6, F = 6) from Kindergarten (n = 5) and first grade (n = 7) participated in this study. Each verbal utterance and gesture during the task were coded, on a complexity scale derived from dynamic skill theory. To explore the interplay between speech and gestures, we applied a cross recurrence quantification analysis (CRQA) to the two coupled time series of the skill levels of verbalizations and gestures. The analysis focused on (1) the temporal relation between gestures and speech, (2) the relative strength and direction of the interaction between gestures and speech, (3) the relative strength and direction between gestures and speech for different levels of understanding, and (4) relations between CRQA measures and other child characteristics. The results show that older and younger children differ in the (temporal) asymmetry in the gestures-speech interaction. For younger children, the balance leans more toward gestures leading speech in time, while the balance leans more toward speech leading gestures for older children. Secondly, at the group level, speech attracts gestures in a more dynamically stable fashion than vice versa, and this asymmetry in gestures and speech extends to lower and higher understanding levels. Yet, for older children, the mutual coupling between gestures and speech is more dynamically stable regarding the higher understanding levels. Gestures and speech are more synchronized in time as children are older. A higher score on schools' language tests is related to speech attracting gestures more rigidly and more asymmetry between gestures and speech, only for the less difficult understanding levels. A higher score on math or past science tasks is related to less asymmetry between gestures and speech. The picture that emerges from our analyses suggests that the relation between gestures, speech and cognition is more complex than previously thought. We suggest that temporal differences and asymmetry in influence between gestures and speech arise from simultaneous coordination of synergies.

Project description:One of the most important social cognitive skills in humans is the ability to "put oneself in someone else's shoes," that is, to take another person's perspective. In socially situated communication, perspective taking enables the listener to arrive at a meaningful interpretation of what is said (sentence meaning) and what is meant (speaker's meaning) by the speaker. To successfully decode the speaker's meaning, the listener has to take into account which information he/she and the speaker share in their common ground (CG). We here further investigated competing accounts about when and how CG information affects language comprehension by means of reaction time (RT) measures, accuracy data, event-related potentials (ERPs), and eye-tracking. Early integration accounts would predict that CG information is considered immediately and would hence not expect to find costs of CG integration. Late integration accounts would predict a rather late and effortful integration of CG information during the parsing process that might be reflected in integration or updating costs. Other accounts predict the simultaneous integration of privileged ground (PG) and CG perspectives. We used a computerized version of the referential communication game with object triplets of different sizes presented visually in CG or PG. In critical trials (i.e., conflict trials), CG information had to be integrated while privileged information had to be suppressed. Listeners mastered the integration of CG (response accuracy 99.8%). Yet, slower RTs, and enhanced late positivities in the ERPs showed that CG integration had its costs. Moreover, eye-tracking data indicated an early anticipation of referents in CG but an inability to suppress looks to the privileged competitor, resulting in later and longer looks to targets in those trials, in which CG information had to be considered. Our data therefore support accounts that foresee an early anticipation of referents to be in CG but a rather late and effortful integration if conflicting information has to be processed. We show that both perspectives, PG and CG, contribute to socially situated language processing and discuss the data with reference to theoretical accounts and recent findings on the use of CG information for reference resolution.