Auditory-visual fusion in speech perception in children with cochlear implants.
Ontology highlight
ABSTRACT:
SUBMITTER: Schorr EA
PROVIDER: S-EPMC1317952 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Spatial hearing skills are essential for children as they grow, learn and play. These skills provide critical cues for determining the locations of sources in the environment, and enable segregation of important sounds, such as speech, from background maskers or interferers. Spatial hearing depends on availability of monaural cues and binaural cues. The latter result from integration of inputs arriving at the two ears from sounds that vary in location. The binaural system has exquisite mechanisms for capturing differences between the ears in both time of arrival and intensity. The major cues that are thus referred to as being vital for binaural hearing are: interaural differences in time (ITDs) and interaural differences in levels (ILDs). In children with normal hearing (NH), spatial hearing abilities are fairly well developed by age 4-5 years. In contrast, most children who are deaf and hear through cochlear implants (CIs) do not have an opportunity to experience normal, binaural acoustic hearing early in life. These children may function by having to utilize auditory cues that are degraded with regard to numerous stimulus features. In recent years there has been a notable increase in the number of children receiving bilateral CIs, and evidence suggests that while having two CIs helps them function better than when listening through a single CI, these children generally perform worse than their NH peers. This paper reviews some of the recent work on bilaterally implanted children. The focus is on measures of spatial hearing, including sound localization, release from masking for speech understanding in noise and binaural sensitivity using research processors. Data from behavioral and electrophysiological studies are included, with a focus on the recent work of the authors and their collaborators. The effects of auditory plasticity and deprivation on the emergence of binaural and spatial hearing are discussed along with evidence for reorganized processing from both behavioral and electrophysiological studies. The consequences of both unilateral and bilateral auditory deprivation during development suggest that the relevant set of issues is highly complex with regard to successes and the limitations experienced by children receiving bilateral cochlear implants. This article is part of a Special Issue entitled <Annual Reviews 2016>.
| S-EPMC5647834 | biostudies-literature
Project description:The mechanism underlying visual-induced auditory interaction is still under discussion. Here, we provide evidence that the mirror mechanism underlies visual-auditory interactions. In this study, visual stimuli were divided into two major groups-mirror stimuli that were able to activate mirror neurons and non-mirror stimuli that were not able to activate mirror neurons. The two groups were further divided into six subgroups as follows: visual speech-related mirror stimuli, visual speech-irrelevant mirror stimuli, and non-mirror stimuli with four different luminance levels. Participants were 25 children with cochlear implants (CIs) who underwent an event-related potential (ERP) and speech recognition task. The main results were as follows: (1) there were significant differences in P1, N1, and P2 ERPs between mirror stimuli and non-mirror stimuli; (2) these ERP differences between mirror and non-mirror stimuli were partly driven by Brodmann areas 41 and 42 in the superior temporal gyrus; (3) ERP component differences between visual speech-related mirror and non-mirror stimuli were partly driven by Brodmann area 39 (visual speech area), which was not observed when comparing the visual speech-irrelevant stimulus and non-mirror groups; and (4) ERPs evoked by visual speech-related mirror stimuli had more components correlated with speech recognition than ERPs evoked by non-mirror stimuli, while ERPs evoked by speech-irrelevant mirror stimuli were not significantly different to those induced by the non-mirror stimuli. These results indicate the following: (1) mirror and non-mirror stimuli differ in their associated neural activation; (2) the visual-auditory interaction possibly led to ERP differences, as Brodmann areas 41 and 42 constitute the primary auditory cortex; (3) mirror neurons could be responsible for the ERP differences, considering that Brodmann area 39 is associated with processing information about speech-related mirror stimuli; and (4) ERPs evoked by visual speech-related mirror stimuli could better reflect speech recognition ability. These results support the hypothesis that a mirror mechanism underlies visual-auditory interactions.
| S-EPMC8421565 | biostudies-literature
Project description:Purpose:There is a growing interest in speech intelligibility and auditory perception of deaf children. The aim of the present study was to compare speech intelligibility and auditory perception of pre-school children with Hearing Aid (HA), Cochlear Implant (CI), and Typical Hearing (TH). Methods:The research design was descriptive-analytic and comparative. The participants comprised 75 male pre-school children aged 4-6 years in the 2017-2018 from Tehran, Iran. The participants were divided into three groups, and each group consisted of 25 children. The first and second groups were respectively selected from pre-school children with HA and CI using the convenience sampling method, while the third group was selected from pre-school children with TH by random sampling method. All children completed Speech Intelligibility Rating and Categories of Auditory Performance Questionnaires. Results:The findings indicated that the mean scores of speech intelligibility and auditory perception of the group with TH were significantly higher than those of the other groups (P < 0.0001). The mean scores of speech intelligibility in the group with CI did not significantly differ from those of the group with HA (P < 0.38). Also, the mean scores of auditory perception in the group with CI were significantly higher than those of the group with HA (P < 0.002). Conclusion:The results showed that auditory perception in children with CI was significantly higher than children with HA. This finding highlights the importance of cochlear implantation at a younger age and its significant impact on auditory perception in deaf children.
| S-EPMC7231984 | biostudies-literature
Project description:We investigated whether visual speech fills in non-intact auditory speech (excised consonant onsets) in typically developing children from 4 to 14 years of age. Stimuli with the excised auditory onsets were presented in the audiovisual (AV) and auditory-only (AO) modes. A visual speech fill-in effect occurs when listeners experience hearing the same non-intact auditory stimulus (e.g., /-b/ag) as different depending on the presence/absence of visual speech such as hearing /bag/ in the AV mode but hearing /ag/ in the AO mode. We quantified the visual speech fill-in effect by the difference in the number of correct consonant onset responses between the modes. We found that easy visual speech cues /b/ provided greater filling in than difficult cues /g/. Only older children benefited from difficult visual speech cues, whereas all children benefited from easy visual speech cues, although 4- and 5-year-olds did not benefit as much as older children. To explore task demands, we compared results on our new task with those on the McGurk task. The influence of visual speech was uniquely associated with age and vocabulary abilities for the visual speech fill--in effect but was uniquely associated with speechreading skills for the McGurk effect. This dissociation implies that visual speech--as processed by children-is a complicated and multifaceted phenomenon underpinned by heterogeneous abilities. These results emphasize that children perceive a speaker's utterance rather than the auditory stimulus per se. In children, as in adults, there is more to speech perception than meets the ear.
| S-EPMC4106987 | biostudies-literature
Project description:BackgroundVisual cross-modal re-organization is a neurophysiological process that occurs in deafness. The intact sensory modality of vision recruits cortical areas from the deprived sensory modality of audition. Such compensatory plasticity is documented in deaf adults and animals, and is related to deficits in speech perception performance in cochlear-implanted adults. However, it is unclear whether visual cross-modal re-organization takes place in cochlear-implanted children and whether it may be a source of variability contributing to speech and language outcomes. Thus, the aim of this study was to determine if visual cross-modal re-organization occurs in cochlear-implanted children, and whether it is related to deficits in speech perception performance.MethodsVisual evoked potentials (VEPs) were recorded via high-density EEG in 41 normal hearing children and 14 cochlear-implanted children, aged 5-15 years, in response to apparent motion and form change. Comparisons of VEP amplitude and latency, as well as source localization results, were conducted between the groups in order to view evidence of visual cross-modal re-organization. Finally, speech perception in background noise performance was correlated to the visual response in the implanted children.ResultsDistinct VEP morphological patterns were observed in both the normal hearing and cochlear-implanted children. However, the cochlear-implanted children demonstrated larger VEP amplitudes and earlier latency, concurrent with activation of right temporal cortex including auditory regions, suggestive of visual cross-modal re-organization. The VEP N1 latency was negatively related to speech perception in background noise for children with cochlear implants.ConclusionOur results are among the first to describe cross modal re-organization of auditory cortex by the visual modality in deaf children fitted with cochlear implants. Our findings suggest that, as a group, children with cochlear implants show evidence of visual cross-modal recruitment, which may be a contributing source of variability in speech perception outcomes with their implant.
| S-EPMC4726603 | biostudies-literature
Project description:Research on asynchronous audiovisual speech perception manipulates experimental conditions to observe their effects on synchrony judgments. Probabilistic models establish a link between the sensory and decisional processes underlying such judgments and the observed data, via interpretable parameters that allow testing hypotheses and making inferences about how experimental manipulations affect such processes. Two models of this type have recently been proposed, one based on independent channels and the other using a Bayesian approach. Both models are fitted here to a common data set, with a subsequent analysis of the interpretation they provide about how experimental manipulations affected the processes underlying perceived synchrony. The data consist of synchrony judgments as a function of audiovisual offset in a speech stimulus, under four within-subjects manipulations of the quality of the visual component. The Bayesian model could not accommodate asymmetric data, was rejected by goodness-of-fit statistics for 8/16 observers, and was found to be nonidentifiable, which renders uninterpretable parameter estimates. The independent-channels model captured asymmetric data, was rejected for only 1/16 observers, and identified how sensory and decisional processes mediating asynchronous audiovisual speech perception are affected by manipulations that only alter the quality of the visual component of the speech signal.
| S-EPMC4975115 | biostudies-literature
Project description:In normal-hearing children the latency of the P1 component of the cortical evoked response to sound varies as a function of age and, thus, can be used as a biomarker for maturation of central auditory pathways. We assessed P1 latency in 245 congenitally deaf children fit with cochlear implants following various periods of auditory deprivation. If children experience less than 3.5 years of auditory deprivation before implantation, P1 latencies fall into the range of normal following 3-6 months of electrical stimulation. Children who experience greater than 7 years of deprivation, however, generally do not develop normal P1 latencies even after years of stimulation. Moreover, the waveforms for these patients can be markedly abnormal. Cortical reorganization stimulated by deprivation is likely to be a significant factor in both variation in the latency and morphology of the cortical evoked response to sound for children fit with a cochlear implant and variation in the development of oral speech and language function.The reader will be introduced to research using cortical evoked responses (CAEPs), positron emission tomography (PET) scans and in-depth recording from the auditory cortex of congenitally deaf cats that converges on the existence of a sensitive period for the development of central auditory pathways in children. The reader will also be provided with two case studies that illustrate the use of the P1 response as biomarker for development of central auditory pathways. Finally, suggestions for future research will be provided.
| S-EPMC2755241 | biostudies-literature
Project description:Visual information about speech content from the talker's mouth is often available before auditory information from the talker's voice. Here we examined perceptual and neural responses to words with and without this visual head start. For both types of words, perception was enhanced by viewing the talker's face, but the enhancement was significantly greater for words with a head start. Neural responses were measured from electrodes implanted over auditory association cortex in the posterior superior temporal gyrus (pSTG) of epileptic patients. The presence of visual speech suppressed responses to auditory speech, more so for words with a visual head start. We suggest that the head start inhibits representations of incompatible auditory phonemes, increasing perceptual accuracy and decreasing total neural responses. Together with previous work showing visual cortex modulation (Ozker et al., 2018b) these results from pSTG demonstrate that multisensory interactions are a powerful modulator of activity throughout the speech perception network.
| S-EPMC6687434 | biostudies-literature
Project description:Children with severe hearing loss most likely receive the greatest benefit from a cochlear implant (CI) when implanted at less than 2 years of age. Children with a hearing loss may also benefit greater from binaural sensory stimulation. Four children who received their first CI under 12 months of age were included in this study. Effects on auditory development were determined using the German LittlEARS Auditory Questionnaire, closed- and open-set monosyllabic word tests, aided free-field, the Mainzer and Göttinger speech discrimination tests, Monosyllabic-Trochee-Polysyllabic (MTP), and Listening Progress Profile (LiP). Speech production and grammar development were evaluated using a German language speech development test (SETK), reception of grammar test (TROG-D) and active vocabulary test (AWST-R). The data showed that children implanted under 12 months of age reached open-set monosyllabic word discrimination at an age of 24 months. LiP results improved over time, and children recognized 100% of words in the MTP test after 12 months. All children performed as well as or better than their hearing peers in speech production and grammar development. SETK showed that the speech development of these children was in general age appropriate. The data suggests that early hearing loss intervention benefits speech and language development and supports the trend towards early cochlear implantation. Furthermore, the data emphasizes the potential benefits associated with bilateral implantation.
| S-EPMC3590554 | biostudies-literature
Project description:Objective: This paper reviewed the literature on the development of and factors affecting speech perception of Mandarin-speaking children with cochlear implantation (CI). We also summarized speech outcome measures in standard Mandarin for evaluating auditory and speech perception of children with CI. Method: A comprehensive search of Google Scholar and PubMed was conducted from March to June 2021. Search terms used were speech perception/lexical tone recognition/auditory perception AND cochlear implant AND Mandarin/Chinese. Conclusion: Unilateral CI recipients demonstrated continuous improvements in auditory and speech perception for several years post-activation. Younger age at implantation and longer duration of CI use contribute to better speech perception. Having undergone a hearing aid trial before implantation and having caregivers whose educational level is higher may lead to better performance. While the findings that support the use of CI to improve speech perception continue to grow, much research is needed to validate the use of unilateral and bilateral implantation. Evidence to date, however, revealed bimodal benefits over CI-only conditions in lexical tone recognition and sentence perception in noise. Due to scarcity of research, conclusions on the benefits of bilateral CIs compared to unilateral CI or bimodal CI use cannot be drawn. Therefore, future research on bimodal and bilateral CIs is needed to guide evidence-based clinical practice.
| S-EPMC8712552 | biostudies-literature