The contribution of obstruent consonants and acoustic landmarks to speech recognition in noise.
Ontology highlight
ABSTRACT:
SUBMITTER: Li N
PROVIDER: S-EPMC2676629 | biostudies-other | 2008 Dec
REPOSITORIES: biostudies-other
Similar Datasets
Project description:Cochlear implant (CI) users are unable to receive masking release and the reasons are unclear. The present study examines the hypothesis that when listening to speech in fluctuating maskers, CI users cannot fuse the pieces of the message over temporal gaps because they are not able to perceive reliably the information carried by obstruent consonants (e.g., stops). To test this hypothesis, CI users were presented with sentences containing clean obstruent segments, but corrupted sonorant segments (e.g., vowels). Results indicated that CI users received masking release at low signal-to-noise ratio levels. Experiment 2 assessed the contribution of acoustic landmarks alone by presenting to CI users noise-corrupted stimuli which had clearly marked vowel/consonant boundaries, but lacking clean obstruent consonant information. These stimuli were created using noise-corrupted envelopes processed using logarithmic compression during sonorant segments and a weakly-compressive mapping function during obstruent segments. Results indicated that the use of segment-dependent compression yielded significant improvements in intelligibility, but no masking release. The results from these experiments suggest that in order for CI users to receive masking release, it is necessary to perceive reliably not only the presence and location of acoustic landmarks (i.e., vowel/consonant boundaries) but also the information carried by obstruent consonants.
| S-EPMC2945752 | biostudies-other
Project description:In the real world, human speech recognition nearly always involves listening in background noise. The impact of such noise on speech signals and on intelligibility performance increases with the separation of the listener from the speaker. The present behavioral experiment provides an overview of the effects of such acoustic disturbances on speech perception in conditions approaching ecologically valid contexts. We analysed the intelligibility loss in spoken word lists with increasing listener-to-speaker distance in a typical low-level natural background noise. The noise was combined with the simple spherical amplitude attenuation due to distance, basically changing the signal-to-noise ratio (SNR). Therefore, our study draws attention to some of the most basic environmental constraints that have pervaded spoken communication throughout human history. We evaluated the ability of native French participants to recognize French monosyllabic words (spoken at 65.3 dB(A), reference at 1 meter) at distances between 11 to 33 meters, which corresponded to the SNRs most revealing of the progressive effect of the selected natural noise (-8.8 dB to -18.4 dB). Our results showed that in such conditions, identity of vowels is mostly preserved, with the striking peculiarity of the absence of confusion in vowels. The results also confirmed the functional role of consonants during lexical identification. The extensive analysis of recognition scores, confusion patterns and associated acoustic cues revealed that sonorant, sibilant and burst properties were the most important parameters influencing phoneme recognition. . Altogether these analyses allowed us to extract a resistance scale from consonant recognition scores. We also identified specific perceptual consonant confusion groups depending of the place in the words (onset vs. coda). Finally our data suggested that listeners may access some acoustic cues of the CV transition, opening interesting perspectives for future studies.
| S-EPMC3834087 | biostudies-literature
Project description:A growing body of research suggests that intrinsic neuronal slow (<10 Hz) oscillations in auditory cortex appear to track incoming speech and other spectro-temporally complex auditory signals. Within this framework, several recent studies have identified critical-band temporal envelopes as the specific acoustic feature being reflected by the phase of these oscillations. However, how this alignment between speech acoustics and neural oscillations might underpin intelligibility is unclear. Here we test the hypothesis that the 'sharpness' of temporal fluctuations in the critical band envelope acts as a temporal cue to speech syllabic rate, driving delta-theta rhythms to track the stimulus and facilitate intelligibility. We interpret our findings as evidence that sharp events in the stimulus cause cortical rhythms to re-align and parse the stimulus into syllable-sized chunks for further decoding. Using magnetoencephalographic recordings, we show that by removing temporal fluctuations that occur at the syllabic rate, envelope-tracking activity is reduced. By artificially reinstating these temporal fluctuations, envelope-tracking activity is regained. These changes in tracking correlate with intelligibility of the stimulus. Together, the results suggest that the sharpness of fluctuations in the stimulus, as reflected in the cochlear output, drive oscillatory activity to track and entrain to the stimulus, at its syllabic rate. This process likely facilitates parsing of the stimulus into meaningful chunks appropriate for subsequent decoding, enhancing perception and intelligibility.
| S-EPMC3839250 | biostudies-literature
Project description:IntroductionDuring speech comprehension, multiple sources of information are available to listeners, which are combined to guide the recognition process. Models of speech comprehension posit that when the acoustic speech signal is obscured, listeners rely more on information from other sources. However, these models take into account only word frequency information and local contexts (surrounding syllables), but not sentence-level information. To date, empirical studies investigating predictability effects in noise did not carefully control the tested speech sounds, while the literature investigating the effect of background noise on the recognition of speech sounds does not manipulate sentence predictability. Additionally, studies on the effect of background noise show conflicting results regarding which noise type affects speech comprehension most. We address this in the present experiment.MethodsWe investigate how listeners combine information from different sources when listening to sentences embedded in background noise. We manipulate top-down predictability, type of noise, and characteristics of the acoustic signal, thus creating conditions which differ in the extent to which a specific speech sound is masked in a way that is grounded in prior work on the confusability of speech sounds in noise. Participants complete an online word recognition experiment.Results and discussionThe results show that participants rely more on the provided sentence context when the acoustic signal is harder to process. This is the case even when interactions of the background noise and speech sounds lead to small differences in intelligibility. Listeners probabilistically combine top-down predictions based on context with noisy bottom-up information from the acoustic signal, leading to a trade-off between the different types of information that is dependent on the combination of a specific type of background noise and speech sound.
| S-EPMC9802670 | biostudies-literature
Project description:The GEMMA database consists of recordings of disyllabic words: vowel-consonant-vowel (VCV) for nongeminate cases and vowel-consonant-consonant-vowel (VCCV) for geminate cases. The consonants in the words are stops /b/, /d/, /g/, /p/, /t/, /k/, affricates /ts/, /dz/, /ʧ/, /ʤ/, fricatives /f/, /v/, /s/, /z/ (singleton only) and /ʃ/ (geminate only), nasals /m/, /n/ and /ɲ/ (geminate only), and liquids /l/, /r/ and / λ / (geminate only). The database also includes recordings for glides (/j/, /w/). The vowels in the words are /a, i, u/; words are symmetric with respect to vowel. Six native adult speakers of Standard Italian, raised and living in Rome, Italy, three female and three male, uttered the speech materials in three different recording sessions; three repetitions for each word per speaker were therefore collected. The dataset also includes the durations of vowel and consonant segments for all cases where the consonant can be singleton vs. geminate (see [1] and [2]).
| S-EPMC9256837 | biostudies-literature
Project description:Despite their remarkable clinical success, cochlear-implant listeners today still receive spectrally degraded information. Much research has examined normally hearing adult listeners' ability to interpret spectrally degraded signals, primarily using noise-vocoded speech to simulate cochlear implant processing. Far less research has explored infants' and toddlers' ability to interpret spectrally degraded signals, despite the fact that children in this age range are frequently implanted. This study examines 27-month-old typically developing toddlers' recognition of noise-vocoded speech in a language-guided looking study. Children saw two images on each trial and heard a voice instructing them to look at one item ("Find the cat!"). Full-spectrum sentences or their noise-vocoded versions were presented with varying numbers of spectral channels. Toddlers showed equivalent proportions of looking to the target object with full-speech and 24- or 8-channel noise-vocoded speech; they failed to look appropriately with 2-channel noise-vocoded speech and showed variable performance with 4-channel noise-vocoded speech. Despite accurate looking performance for speech with at least eight channels, children were slower to respond appropriately as the number of channels decreased. These results indicate that 2-yr-olds have developed the ability to interpret vocoded speech, even without practice, but that doing so requires additional processing. These findings have important implications for pediatric cochlear implantation.
| S-EPMC3548833 | biostudies-other
Project description:Cochlear implant users report difficulty understanding speech in both noisy and reverberant environments. Electric-acoustic stimulation (EAS) is known to improve speech intelligibility in noise. However, little is known about the potential benefits of EAS in reverberation, or about how such benefits relate to those observed in noise. The present study used EAS simulations to examine these questions. Sentences were convolved with impulse responses from a model of a room whose estimated reverberation times were varied from 0 to 1 sec. These reverberated stimuli were then vocoded to simulate electric stimulation, or presented as a combination of vocoder plus low-pass filtered speech to simulate EAS. Monaural sentence recognition scores were measured in two conditions: reverberated speech and speech in a reverberated noise. The long-term spectrum and amplitude modulations of the noise were equated to the reverberant energy, allowing a comparison of the effects of the interferer (speech vs noise). Results indicate that, at least in simulation, (1) EAS provides significant benefit in reverberation; (2) the benefits of EAS in reverberation may be underestimated by those in a comparable noise; and (3) the EAS benefit in reverberation likely arises from partially preserved cues in this background accessible via the low-frequency acoustic component.
| S-EPMC3283901 | biostudies-other
Project description:A fundamental task of the ascending auditory system is to produce representations that facilitate the recognition of complex sounds. This is particularly challenging in the context of acoustic variability, such as that between different talkers producing the same phoneme. These representations are transformed as information is propagated throughout the ascending auditory system from the inner ear to the auditory cortex (AI). Investigating these transformations and their role in speech recognition is key to understanding hearing impairment and the development of future clinical interventions. Here, we obtained neural responses to an extensive set of natural vowel-consonant-vowel phoneme sequences, each produced by multiple talkers, in three stages of the auditory processing pathway. Auditory nerve (AN) representations were simulated using a model of the peripheral auditory system and extracellular neuronal activity was recorded in the inferior colliculus (IC) and primary auditory cortex (AI) of anaesthetized guinea pigs. A classifier was developed to examine the efficacy of these representations for recognizing the speech sounds. Individual neurons convey progressively less information from AN to AI. Nonetheless, at the population level, representations are sufficiently rich to facilitate recognition of consonants with a high degree of accuracy at all stages indicating a progression from a dense, redundant representation to a sparse, distributed one. We examined the timescale of the neural code for consonant recognition and found that optimal timescales increase throughout the ascending auditory system from a few milliseconds in the periphery to several tens of milliseconds in the cortex. Despite these longer timescales, we found little evidence to suggest that representations up to the level of AI become increasingly invariant to across-talker differences. Instead, our results support the idea that the role of the subcortical auditory system is one of dimensionality expansion, which could provide a basis for flexible classification of arbitrary speech sounds.
| S-EPMC6194309 | biostudies-literature
Project description:Children with reading impairments have deficits in phonological awareness, phonemic categorization, speech-in-noise perception, and psychophysical tasks such as frequency and temporal discrimination. Many of these children also exhibit abnormal encoding of speech stimuli in the auditory brainstem, even though responses to click stimuli are normal. In typically developing children the auditory brainstem response reflects acoustic differences between contrastive stop consonants. The current study investigated whether this subcortical differentiation of stop consonants was related to reading ability and speech-in-noise performance. Across a group of children with a wide range of reading ability, the subcortical differentiation of 3 speech stimuli ([ba], [da], [ga]) was found to be correlated with phonological awareness, reading, and speech-in-noise perception, with better performers exhibiting greater differences among responses to the 3 syllables. When subjects were categorized into terciles based on phonological awareness and speech-in-noise performance, the top-performing third in each grouping had greater subcortical differentiation than the bottom third. These results are consistent with the view that the neural processes underlying phonological awareness and speech-in-noise perception depend on reciprocal interactions between cognitive and perceptual processes.
| S-EPMC2722305 | biostudies-other
Project description:Positron emission tomography (PET) has been successfully used to investigate central nervous processes, including the central auditory pathway. Unlike early water-cooled PET-scanners, novel PET/CT scanners employ air cooling and include a CT system, both of which result in higher background noise levels. In the present study, we describe the background noise generated by two state-of-the-art air-cooled PET/CT scanners. We measured speech recognition in background noise: recorded PET noise and a speech-shaped noise applied in clinical routine to subjects with normal hearing. Background noise produced by air-cooled PET/CT is considerable: 75.1 dB SPL (64.5 dB(A)) for the Philips Gemini TF64 and 76.9 dB SPL (68.4 dB(A)) for the Philips Vereos PET/CT (Philips Healthcare, The Netherlands). Subjects with normal hearing exhibited better speech recognition in recorded PET background noise compared with clinically applied speech-shaped noise. Speech recognition in both background noises correlated significantly. Background noise generated by PET/CT scanners should be considered when PET is used for the investigation of the central auditory pathway. Speech in PET noise is better than in speech-shaped noise because of the minor masking effect of the background noise of the PET/CT.
| S-EPMC8585948 | biostudies-literature