Convolutional Neural Network-based Speech Enhancement for Cochlear Implant Recipients.
Ontology highlight
ABSTRACT:
SUBMITTER: Mamun N
PROVIDER: S-EPMC8296973 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Speech understanding in noisy environments is still one of the major challenges for cochlear implant (CI) users in everyday life. We evaluated a speech enhancement algorithm based on neural networks (NNSE) for improving speech intelligibility in noise for CI users. The algorithm decomposes the noisy speech signal into time-frequency units, extracts a set of auditory-inspired features and feeds them to the neural network to produce an estimation of which frequency channels contain more perceptually important information (higher signal-to-noise ratio, SNR). This estimate is used to attenuate noise-dominated and retain speech-dominated CI channels for electrical stimulation, as in traditional n-of-m CI coding strategies. The proposed algorithm was evaluated by measuring the speech-in-noise performance of 14 CI users using three types of background noise. Two NNSE algorithms were compared: a speaker-dependent algorithm, that was trained on the target speaker used for testing, and a speaker-independent algorithm, that was trained on different speakers. Significant improvements in the intelligibility of speech in stationary and fluctuating noises were found relative to the unprocessed condition for the speaker-dependent algorithm in all noise types and for the speaker-independent algorithm in 2 out of 3 noise types. The NNSE algorithms used noise-specific neural networks that generalized to novel segments of the same noise type and worked over a range of SNRs. The proposed algorithm has the potential to improve the intelligibility of speech in noise for CI users while meeting the requirements of low computational complexity and processing delay for application in CI devices.
| S-EPMC5256482 | biostudies-literature
Project description:Although cochlear implantation enables some children to attain age-appropriate speech and language development, communicative delays persist in others, and outcomes are quite variable and difficult to predict, even for children implanted early in life. To understand the neurobiological basis of this variability, we used presurgical neural morphological data obtained from MRI of individual pediatric cochlear implant (CI) candidates implanted younger than 3.5 years to predict variability of their speech-perception improvement after surgery. We first compared neuroanatomical density and spatial pattern similarity of CI candidates to that of age-matched children with normal hearing, which allowed us to detail neuroanatomical networks that were either affected or unaffected by auditory deprivation. This information enables us to build machine-learning models to predict the individual children's speech development following CI. We found that regions of the brain that were unaffected by auditory deprivation, in particular the auditory association and cognitive brain regions, produced the highest accuracy, specificity, and sensitivity in patient classification and the most precise prediction results. These findings suggest that brain areas unaffected by auditory deprivation are critical to developing closer to typical speech outcomes. Moreover, the findings suggest that determination of the type of neural reorganization caused by auditory deprivation before implantation is valuable for predicting post-CI language outcomes for young children.
| S-EPMC5798370 | biostudies-literature
Project description:AimsPatients with the Pendred syndrome suffer very often from a hearing loss. They may be good candidates for a cochlear implantation, but unfortunately, due to the fluctuating character of the hearing loss, they may escape such indication. In the study, we compared speech production and speech acquisition in 2 groups of implanted patients: those with the Pendred syndrome, and standard non-syndromic patients.MethodsTen patients with Pendred syndrome were analyzed for speech perception and production. The control group consisted of 41 non-syndromic implanted patients. All implantees were scored according to speech perception, speech production, and the sum of both. The data were statistically analyzed.ResultsNo statistical difference was found in language acquisition and production in implantees with Pendred syndrome when compared to non-syndromic patients with cochlear implants. Nor there was any difference in speech production and acquisition between the 2 compared groups regarding surgical age, time elapsed after surgery, or age during the testing.ConclusionIn this study evaluating language and speech production and acquisition, patients with Pendred syndrome who underwent cochlear implants show comparable results to their implanted peers with deafness of a different etiology.
| S-EPMC8880977 | biostudies-literature
Project description:This study examined speech recognition abilities of cochlear implant (CI) recipients in the spectrally complex listening condition of 3 contrasting types of background music, and compared performance based upon listener groups: CI recipients using conventional long-electrode devices, Hybrid CI recipients (acoustic plus electric stimulation), and normal-hearing adults.We tested 154 long-electrode CI recipients using varied devices and strategies, 21 Hybrid CI recipients, and 49 normal-hearing adults on closed-set recognition of spondees presented in 3 contrasting forms of background music (piano solo, large symphony orchestra, vocal solo with small combo accompaniment) in an adaptive test.Signal-to-noise ratio thresholds for speech in music were examined in relation to measures of speech recognition in background noise and multitalker babble, pitch perception, and music experience.The signal-to-noise ratio thresholds for speech in music varied as a function of category of background music, group membership (long-electrode, Hybrid, normal-hearing), and age. The thresholds for speech in background music were significantly correlated with measures of pitch perception and thresholds for speech in background noise; auditory status was an important predictor.Evidence suggests that speech reception thresholds in background music change as a function of listener age (with more advanced age being detrimental), structural characteristics of different types of music, and hearing status (residual hearing). These findings have implications for everyday listening conditions such as communicating in social or commercial situations in which there is background music.
| S-EPMC3686524 | biostudies-literature
Project description:IntroductionDespite recent advancement in the prediction of cochlear implant outcome, the benefit of bilateral procedures compared to bimodal stimulation and how we predict speech perception outcomes of sequential bilateral cochlear implant based on bimodal auditory performance in children remain unclear.ObjectivesThis investigation was performed: (1) to determine the benefit of sequential bilateral cochlear implant and (2) to identify the associated factors for the outcome of sequential bilateral cochlear implant.MethodsObservational and retrospective study. We retrospectively analyzed 29 patients with sequential cochlear implant following bimodal-fitting condition. Audiological evaluations were performed; the categories of auditory performance scores, speech perception with monosyllable and disyllables words, and the Korean version of Ling. Audiological evaluations were performed before sequential cochlear implant with the bimodal fitting condition (CI1+HA) and one year after the sequential cochlear implant with bilateral cochlear implant condition (CI1+CI2). The good performance group (GP) was defined as follows; 90% or higher in monosyllable and bisyllable tests with auditory-only condition or 20% or higher improvement of the scores with CI1+CI2. Age at first implantation, inter-implant interval, categories of auditory performance score, and various comorbidities were analyzed by logistic regression analysis.ResultsCompared to the CI1+HA, CI1+CI2 provided significant benefit in categories of auditory performance, speech perception, and Korean version of Ling results. Preoperative categories of auditory performance scores were the only associated factor for being GP (odds ratio=4.38, 95% confidence interval - 95%=1.07-17.93, p=0.04).ConclusionsThe children with limited language development in bimodal condition should be considered as the sequential bilateral cochlear implant and preoperative categories of auditory performance score could be used as the predictor in speech perception after sequential cochlear implant.
| S-EPMC9443016 | biostudies-literature
Project description:The present study examined the effect of combined spectral and temporal enhancement on speech recognition by cochlear-implant (CI) users in quiet and in noise. The spectral enhancement was achieved by expanding the short-term Fourier amplitudes in the input signal. Additionally, a variation of the Transient Emphasis Spectral Maxima (TESM) strategy was applied to enhance the short-duration consonant cues that are otherwise suppressed when processed with spectral expansion. Nine CI users were tested on phoneme recognition tasks and ten CI users were tested on sentence recognition tasks both in quiet and in steady, speech-spectrum-shaped noise. Vowel and consonant recognition in noise were significantly improved with spectral expansion combined with TESM. Sentence recognition improved with both spectral expansion and spectral expansion combined with TESM. The amount of improvement varied with individual CI users. Overall the present results suggest that customized processing is needed to optimize performance according to not only individual users but also listening conditions.
| S-EPMC3248060 | biostudies-other
Project description:Many cochlear implant (CI) users achieve excellent speech understanding in acoustically quiet conditions but most perform poorly in the presence of background noise. An important contributor to this poor speech-in-noise performance is the limited transmission of low-frequency sound information through CIs. Recent work has suggested that tactile presentation of this low-frequency sound information could be used to improve speech-in-noise performance for CI users. Building on this work, we investigated whether vibro-tactile stimulation can improve speech intelligibility in multi-talker noise. The signal used for tactile stimulation was derived from the speech-in-noise using a computationally inexpensive algorithm. Eight normal-hearing participants listened to CI simulated speech-in-noise both with and without concurrent tactile stimulation of their fingertip. Participants' speech recognition performance was assessed before and after a training regime, which took place over 3 consecutive days and totaled around 30?min of exposure to CI-simulated speech-in-noise with concurrent tactile stimulation. Tactile stimulation was found to improve the intelligibility of speech in multi-talker noise, and this improvement was found to increase in size after training. Presentation of such tactile stimulation could be achieved by a compact, portable device and offer an inexpensive and noninvasive means for improving speech-in-noise performance in CI users.
| S-EPMC6144588 | biostudies-literature
Project description:Although significant progress has been made in understanding outcomes following cochlear implantation, predicting performance remains a challenge. Duration of hearing loss, age at implantation, and electrode positioning within the cochlea together explain ~ 25% of the variability in speech-perception scores in quiet using the cochlear implant (CI). Electrocochleography (ECochG) responses, prior to implantation, account for 47% of the variance in the same speech-perception measures. No study to date has explored CI performance in noise, a more realistic measure of natural listening. This study aimed to (1) validate ECochG total response (ECochG-TR) as a predictor of performance in quiet and (2) evaluate whether ECochG-TR explained variability in noise performance. Thirty-five adult CI recipients were enrolled with outcomes assessed at 3-months post-implantation. The results confirm previous studies showing a strong correlation of ECochG-TR with speech-perception in quiet (r = 0.77). ECochG-TR independently explained 34% of the variability in noise performance. Multivariate modeling using ECochG-TR and Montreal Cognitive Assessment (MoCA) scores explained 60% of the variability in speech-perception in noise. Thus, ECochG-TR, a measure of the cochlear substrate prior to implantation, is necessary but not sufficient for explaining performance in noise. Rather, a cognitive measure is also needed to improve prediction of noise performance.
| S-EPMC8866505 | biostudies-literature
Project description:ObjectivesThe spatial position of a cochlear implant (CI) electrode array affects the spectral cues provided to the recipient. Differences in cochlear size and array length lead to substantial variability in angular insertion depth (AID) across and within array types. For CI-alone users, the variability in AID results in varying degrees of frequency-to-place mismatch between the default electric frequency filters and cochlear place of stimulation. For electric-acoustic stimulation (EAS) users, default electric frequency filters also vary as a function of residual acoustic hearing in the implanted ear. The present study aimed to (1) investigate variability in AID associated with lateral wall arrays, (2) determine the subsequent frequency-to-place mismatch for CI-alone and EAS users mapped with default frequency filters, and (3) examine the relationship between early speech perception for CI-alone users and two aspects of electrode position: frequency-to-place mismatch and angular separation between neighboring contacts, a metric associated with spectral selectivity at the periphery.DesignOne hundred one adult CI recipients (111 ears) with MED-EL Flex24 (24 mm), Flex28 (28 mm), and FlexSOFT/Standard (31.5 mm) arrays underwent postoperative computed tomography to determine AID. A subsequent comparison was made between AID, predicted spiral ganglion place frequencies, and the default frequency filters for CI-alone (n = 84) and EAS users (n = 27). For CI-alone users with complete insertions who listened with maps fit with the default frequency filters (n = 48), frequency-to-place mismatch was quantified at 1500 Hz and angular separation between neighboring contacts was determined for electrodes in the 1 to 2 kHz region. Multiple linear regression was used to examine how frequency-to-place mismatch and angular separation of contacts influence consonant-nucleus-consonant (CNC) scores through 6 months postactivation.ResultsFor CI recipients with complete insertions (n = 106, 95.5%), the AID (mean ± standard deviation) of the most apical contact was 428° ± 34.3° for Flex24 (n = 11), 558° ± 65.4° for Flex28 (n = 48), and 636° ± 42.9° for FlexSOFT/Standard (n = 47) arrays. For CI-alone users, default frequency filters aligned closely with the spiral ganglion map for deeply inserted lateral wall arrays. For EAS users, default frequency filters produced a range of mismatches; absolute deviations of ≤ 6 semitones occurred in only 37% of cases. Participants with shallow insertions and minimal or no residual hearing experienced the greatest mismatch. For CI-alone users, both smaller frequency-to-place mismatch and greater angular separation between contacts were associated with better CNC scores during the initial 6 months of device use.ConclusionsThere is significant variability in frequency-to-place mismatch among CI-alone and EAS users with default frequency filters, even between individuals implanted with the same array. When using default frequency filters, mismatch can be minimized with longer lateral wall arrays and insertion depths that meet the edge frequency associated with residual hearing for CI-alone and EAS users, respectively. Smaller degrees of frequency-to-place mismatch and decreased peripheral masking due to more widely spaced contacts may independently support better speech perception with longer lateral wall arrays in CI-alone users.
| S-EPMC8407755 | biostudies-literature
Project description:Speech-perception testing is essential for monitoring outcomes with a hearing aid or cochlear implant (CI). However, clinical care is time-consuming and often challenging with an increasing number of clients. A potential approach to alleviating some clinical care and possibly making room for other outcome measures is to employ technologies that assess performance in the home environment. In this study, we investigate 3 different speech perception indices in the same 40 CI users: phoneme identification (vowels and consonants), digits in noise (DiN) and sentence recognition in noise (SiN). The first two tasks were implemented on a tablet and performed multiple times by each client in their home environment, while the sentence task was administered at the clinic. Speech perception outcomes in the same forty CI users showed that DiN assessed at home can serve as an alternative to SiN assessed at the clinic. DiN scores are in line with the SiN ones by 3-4 dB improvement and are useful to monitor performance at regular intervals and to detect changes in auditory performance. Phoneme identification in quiet also explains a significant part of speech perception in noise, and provides additional information on the detectability and discriminability of speech cues. The added benefit of the phoneme identification task, which also proved to be easy to administer at home, is the information transmission analysis in addition to the summary score. Performance changes for the different indices can be interpreted by comparing against measurement error and help to target personalized rehabilitation. Altogether, home-based speech testing is reliable and proves powerful to complement care in the clinic for CI users.
| S-EPMC8669965 | biostudies-literature