Restoring speech intelligibility for hearing aid users with deep learning.
Ontology highlight
ABSTRACT:
SUBMITTER: Diehl PU
PROVIDER: S-EPMC9932078 | biostudies-literature | 2023 Feb
REPOSITORIES: biostudies-literature
Publications
Restoring speech intelligibility for hearing aid users with deep learning.
Diehl Peter Udo PU Singer Yosef Y Zilly Hannes H Schönfeld Uwe U Meyer-Rachner Paul P Berry Mark M Sprekeler Henning H Sprengel Elias E Pudszuhn Annett A Hofmann Veit M VM
Scientific reports 20230215 1
Almost half a billion people world-wide suffer from disabling hearing loss. While hearing aids can partially compensate for this, a large proportion of users struggle to understand speech in situations with background noise. Here, we present a deep learning-based algorithm that selectively suppresses noise while maintaining speech signals. The algorithm restores speech intelligibility for hearing aid users to the level of control subjects with normal hearing. It consists of a deep network that i ...[more]
Similar Datasets
Project description:PurposeThere is a growing interest in speech intelligibility and auditory perception of deaf children. The aim of the present study was to compare speech intelligibility and auditory perception of pre-school children with Hearing Aid (HA), Cochlear Implant (CI), and Typical Hearing (TH).MethodsThe research design was descriptive-analytic and comparative. The participants comprised 75 male pre-school children aged 4-6 years in the 2017-2018 from Tehran, Iran. The participants were divided into three groups, and each group consisted of 25 children. The first and second groups were respectively selected from pre-school children with HA and CI using the convenience sampling method, while the third group was selected from pre-school children with TH by random sampling method. All children completed Speech Intelligibility Rating and Categories of Auditory Performance Questionnaires.ResultsThe findings indicated that the mean scores of speech intelligibility and auditory perception of the group with TH were significantly higher than those of the other groups (P < 0.0001). The mean scores of speech intelligibility in the group with CI did not significantly differ from those of the group with HA (P < 0.38). Also, the mean scores of auditory perception in the group with CI were significantly higher than those of the group with HA (P < 0.002).ConclusionThe results showed that auditory perception in children with CI was significantly higher than children with HA. This finding highlights the importance of cochlear implantation at a younger age and its significant impact on auditory perception in deaf children.
| S-EPMC7231984 | biostudies-literature
Project description:ObjectivesThe objective was to determine self-adjusted output response and speech intelligibility index (SII) in individuals with mild to moderate hearing loss and to measure the effects of prior hearing aid experience.DesignThirteen hearing aid users and 13 nonusers, with similar group-mean pure-tone thresholds, listened to prerecorded and preprocessed sentences spoken by a man. Starting with a generic level and spectrum, participants adjusted (1) overall level, (2) high-frequency boost, and (3) low-frequency cut. Participants took a speech perception test after an initial adjustment before making a final adjustment. The three self-selected parameters, along with individual thresholds and real-ear-to-coupler differences, were used to compute output levels and SIIs for the starting and two self-adjusted conditions. The values were compared with an NAL second nonlinear threshold-based prescription (NAL-NL2) and, for the hearing aid users, performance of their existing hearing aids.ResultsAll participants were able to complete the self-adjustment process. The generic starting condition provided outputs (between 2 and 8 kHz) and SIIs that were significantly below those prescribed by NAL-NL2. Both groups increased SII to values that were not significantly different from prescription. The hearing aid users, but not the nonusers, increased high-frequency output and SII significantly after taking the speech perception test. Seventeen of the 26 participants (65%) met an SII criterion of 60% under the generic starting condition. The proportion increased to 23 out of 26 (88%) after the final self-adjustment. Of the 13 hearing aid users, 8 (62%) met the 60% criterion with their existing hearing aids. With the final self-adjustment, 12 out of 13 (92%) met this criterion.ConclusionsThe findings support the conclusion that user self-adjustment of basic amplification characteristics can be both feasible and effective with or without prior hearing aid experience.
| S-EPMC6289875 | biostudies-literature
Project description:Dissatisfaction with the sound of one's own voice is common among hearing-aid users. Little is known regarding how hearing impairment and hearing aids separately affect own-voice perception. This study examined own-voice perception and associated issues before and after a hearing-aid fitting for new hearing-aid users and refitting for experienced users to investigate whether it was possible to differentiate between the effect of (unaided) hearing impairment and hearing aids. Further aims were to investigate whether First-Time and Experienced users as well as users with dome and mold inserts differed in the severity of own-voice problems. The study had a cohort design with three groups: First-Time hearing-aid users going from unaided to aided hearing (n = 70), Experienced hearing-aid users replacing their old hearing aids (n = 70), and an unaided control group (n = 70). The control group was surveyed once and the hearing-aid users twice; once before hearing-aid fitting/refitting and once after. The results demonstrated that own-voice problems are common among both First-Time and Experienced hearing-aid users with either dome- or mold-type fittings, while people with near-normal hearing and not using hearing aids report few problems. Hearing aids increased ratings of own-voice problems among First-Time users, particularly those with mold inserts. The results suggest that altered auditory feedback through unaided hearing impairment or through hearing aids is likely both to change own-voice perception and complicate regulation of vocal intensity, but hearing aids are the primary reason for poor perceived sound quality of one's own voice.
| S-EPMC7887686 | biostudies-literature
Project description:ObjectivesComprehension of speech in adverse listening conditions is challenging for hearing-impaired (HI) individuals. Noise reduction (NR) schemes in hearing aids (HAs) have demonstrated the capability to help HI to overcome these challenges. The objective of this study was to investigate the effect of NR processing (inactive, where the NR feature was switched off, vs. active, where the NR feature was switched on) on correlates of listening effort across two different background noise levels [+3 dB signal-to-noise ratio (SNR) and +8 dB SNR] by using a phase synchrony analysis of electroencephalogram (EEG) signals.DesignThe EEG was recorded while 22 HI participants fitted with HAs performed a continuous speech in noise (SiN) task in the presence of background noise and a competing talker. The phase synchrony within eight regions of interest (ROIs) and four conventional EEG bands was computed by using a multivariate phase synchrony measure.ResultsThe results demonstrated that the activation of NR in HAs affects the EEG phase synchrony in the parietal ROI at low SNR differently than that at high SNR. The relationship between conditions of the listening task and phase synchrony in the parietal ROI was nonlinear.ConclusionWe showed that the activation of NR schemes in HAs can non-linearly reduce correlates of listening effort as estimated by EEG-based phase synchrony. We contend that investigation of the phase synchrony within ROIs can reflect the effects of HAs in HI individuals in ecological listening conditions.
| S-EPMC9396236 | biostudies-literature
Project description:ImportanceCochlear implants were approved for use in adults in the 1980s, but use remains low owing to a lack of awareness regarding cochlear implantation candidacy criteria and expected outcomes. There have been limited, small series examining the safety and effectiveness of cochlear implantation in adult hearing aid (HA) users with and without mild cognitive impairment (MCI).ObjectiveTo investigate the safety and effectiveness of a single-ear cochlear implant in a group of optimized adult HA users with and without MCI across a variety of domains.Design, setting, and participantsIn this nonrandomized controlled trial, a multicenter, prospective, repeated-measures investigation was conducted at 13 US institutions. The setting was academic and community-based cochlear implant programs. Eligible participants were 100 adults (aged >18 years) with postlinguistic onset of bilateral moderate sloping to profound or worse sensorineural hearing loss (≤20 years' duration). Fluent English speakers underwent an optimized bilateral HA trial for at least 30 days. Individuals with aided Consonant-Vowel Nucleus-Consonant (CNC) word score in quiet of 40% or less correct in the ear to be implanted and 50% or less correct in the contralateral ear were offered cochlear implants. The first participant was enrolled on February 20, 2017, and the last participant was enrolled on May 3, 2018. The final follow-up was on December 21, 2018.InterventionsParticipants received the same cochlear implant system and contralateral HA.Main outcomes and measuresThe primary outcome measure was speech understanding in quiet (CNC word score) using both the cochlear implant and opposite ear HA. Secondary outcome measures included the following: adverse events; speech understanding in noise (AzBio signal-to-noise ratio of +10 db [+10 SNR]) Health Utilities Index Mark 3 (HUI3); Speech, Spatial, and Qualities of Hearing Questionnaire 49 (SSQ49); and Montreal Cognitive Assessment (MoCA).ResultsThe median age at cochlear implantation of the 96 patients included in the trial was 71 years (range, 23-91 years), and 62 patients (65%) were male. Three serious adverse events requiring revision surgery occurred, and all resolved without sequelae. By 6 months after activation, the absolute marginal mean change in CNC word score and AzBio +10 SNR was 40.5% (95% CI, 35.9%-45.0%) and 24.1% (95% CI, 18.9%-29.4%), respectively. Ninety-one percent (87 of 96) of participants had a clinically important improvement (>15%) in the CNC word score in the implant ear. Mild cognitive impairment (MoCA total score ≤25) was observed in 48 of 81 study participants (59%) at baseline. Speech perception marginal mean improvements were similar between individuals with and without baseline MCI, with values of 40.9% (95% CI, 35.2%-46.6%) and 39.6% (95% CI, 31.8%-47.4%), respectively, for CNC word score and 27.5% (95% CI, 21.0%-33.9%) and 17.8% (95% CI, 9.0%-26.6%), respectively, for AzBio +10 SNR. Statistically significant and clinically important improvements in the HUI3 and SSQ49 were evident at 6 months.Conclusions and relevanceThe findings of this nonrandomized controlled trial seem to indicate that cochlear implants are safe and effective in restoring speech understanding in both quiet and noise and improve quality of life in individuals with and without MCI.Trial registrationClinicalTrials.gov Identifier: NCT03007472.
| S-EPMC7453346 | biostudies-literature
Project description:Purpose Although the speech intelligibility index (SII) has been widely applied in the field of audiology and other related areas, application of this metric to cochlear implants (CIs) has yet to be investigated. In this study, SIIs for CI users were calculated to investigate whether the SII could be an effective tool for predicting speech perception performance in a population with CI. Method Fifteen pre- and postlingually deafened adults with CI participated. Speech recognition scores were measured using the AzBio sentence lists. CI users also completed questionnaires and performed psychoacoustic (spectral and temporal resolution) and cognitive function (digit span) tests. Obtained SIIs were compared with predicted SIIs using a transfer function curve. Correlation and regression analyses were conducted on perceptual and demographic predictor variables to investigate the association between these factors and speech perception performance. Result Because of the considerably poor hearing and large individual variability in performance, the SII did not predict speech performance for this CI group using the traditional calculation. However, new SII models were developed incorporating predictive factors, which improved the accuracy of SII predictions in listeners with CI. Conclusion Conventional SII models are not appropriate for predicting speech perception scores for CI users. Demographic variables (aided audibility and duration of deafness) and perceptual-cognitive skills (gap detection and auditory digit span outcomes) are needed to improve the use of the SII for listeners with CI. Future studies are needed to improve our CI-corrected SII model by considering additional predictive factors. Supplemental Material https://doi.org/10.23641/asha.8057003.
| S-EPMC6808321 | biostudies-literature
Project description:Speech understanding in noisy environments is still one of the major challenges for cochlear implant (CI) users in everyday life. We evaluated a speech enhancement algorithm based on neural networks (NNSE) for improving speech intelligibility in noise for CI users. The algorithm decomposes the noisy speech signal into time-frequency units, extracts a set of auditory-inspired features and feeds them to the neural network to produce an estimation of which frequency channels contain more perceptually important information (higher signal-to-noise ratio, SNR). This estimate is used to attenuate noise-dominated and retain speech-dominated CI channels for electrical stimulation, as in traditional n-of-m CI coding strategies. The proposed algorithm was evaluated by measuring the speech-in-noise performance of 14 CI users using three types of background noise. Two NNSE algorithms were compared: a speaker-dependent algorithm, that was trained on the target speaker used for testing, and a speaker-independent algorithm, that was trained on different speakers. Significant improvements in the intelligibility of speech in stationary and fluctuating noises were found relative to the unprocessed condition for the speaker-dependent algorithm in all noise types and for the speaker-independent algorithm in 2 out of 3 noise types. The NNSE algorithms used noise-specific neural networks that generalized to novel segments of the same noise type and worked over a range of SNRs. The proposed algorithm has the potential to improve the intelligibility of speech in noise for CI users while meeting the requirements of low computational complexity and processing delay for application in CI devices.
| S-EPMC5256482 | biostudies-literature
Project description:Listeners vary in their ability to understand speech in noisy environments. Hearing sensitivity, as measured by pure-tone audiometry, can only partly explain these results, and cognition has emerged as another key concept. Although cognition relates to speech perception, the exact nature of the relationship remains to be fully understood. This study investigates how different aspects of cognition, particularly working memory and attention, relate to speech intelligibility for various tests. Perceptual accuracy of speech perception represents just one aspect of functioning in a listening environment. Activity and participation limits imposed by hearing loss, in addition to the demands of a listening environment, are also important and may be better captured by self-report questionnaires. Understanding how speech perception relates to self-reported aspects of listening forms the second focus of the study. Forty-four listeners aged between 50 and 74 years with mild sensorineural hearing loss were tested on speech perception tests differing in complexity from low (phoneme discrimination in quiet), to medium (digit triplet perception in speech-shaped noise) to high (sentence perception in modulated noise); cognitive tests of attention, memory, and non-verbal intelligence quotient; and self-report questionnaires of general health-related and hearing-specific quality of life. Hearing sensitivity and cognition related to intelligibility differently depending on the speech test: neither was important for phoneme discrimination, hearing sensitivity alone was important for digit triplet perception, and hearing and cognition together played a role in sentence perception. Self-reported aspects of auditory functioning were correlated with speech intelligibility to different degrees, with digit triplets in noise showing the richest pattern. The results suggest that intelligibility tests can vary in their auditory and cognitive demands and their sensitivity to the challenges that auditory environments pose on functioning.
| S-EPMC4468362 | biostudies-literature
Project description:Reverberation can have a strong detrimental effect on speech intelligibility in noise. Two main monaural effects were studied here: the temporal smearing of the target speech, which makes the speech less understandable, and the temporal smearing of the noise, which reduces the opportunity for listening in the masker dips. These phenomena have been shown to affect normal-hearing (NH) listeners. The aim of this study was to understand whether hearing-impaired (HI) listeners are more affected by reverberation, and if so to identify which of these two effects is responsible. They were investigated separately and in combination, by applying reverberation either on the target speech, on the noise masker, or on both sources. Binaural effects were not investigated here. Intelligibility scores in the presence of stationary and modulated noise were systematically compared for both NH and HI listeners in these situations. At the optimal signal-to-noise ratios (SNRs) (that is to say, the SNRs with the least amount of floor and ceiling effects), the temporal smearing of both the speech and the noise had a similar effect for the HI and NH listeners, so that reverberation was not more detrimental for the HI listeners. There was only a very limited dip listening benefit at this SNR for either group. Some differences across group appeared at the SNR maximizing dip listening, but they could not be directly related to an effect of reverberation, and were rather due to floor effects or to the reduced ability of the HI listeners to benefit from dip listening, even in the absence of reverberation.
| S-EPMC9428532 | biostudies-literature
Project description:OBJECTIVE:This study aimed to investigate the effect of hearing protection devices (HPDs) on speech intelligibility in Persian work environments. Three current earmuffs and three earplugs and one of the prototypes of molded earplug were tested on 15 male subjects which were randomly selected. The noise reduction of HPDs was measured based on the Real Ear Attenuation at Threshold (REAT) method. Speech intelligibility during using HPDs was determined based on the speech discrimination score (SDS) at two signal to noise (S/N) ratios (0 and?+?5). Data were analyzed using SPSS 22. RESULTS:The actual to nominal noise reduction rating values were from 47 to 84% for HPDs. At two S/N ratios, no significant differences were observed in speech intelligibility using HPDs (p?>?0.05). At S/N ratio?=?0, the speech intelligibility descriptively has been only improved by using common earmuffs up to 9.07%. There was a significant difference up to 21.27% in speech intelligibility for proposed molded earplugs at S/N ratio?=?0 (p?<?0.05). Increasing the HPDs' noise attenuation values led to an increase in speech interference (p?<?0.05). The HPDs with the minimum required noise attenuation while maintaining acceptable speech intelligibility should be worn by employees exposed to medium noise levels.
| S-EPMC7659119 | biostudies-literature