Dataset Information

The modulation transfer function for speech intelligibility.

ABSTRACT: We systematically determined which spectrotemporal modulations in speech are necessary for comprehension by human listeners. Speech comprehension has been shown to be robust to spectral and temporal degradations, but the specific relevance of particular degradations is arguable due to the complexity of the joint spectral and temporal information in the speech signal. We applied a novel modulation filtering technique to recorded sentences to restrict acoustic information quantitatively and to obtain a joint spectrotemporal modulation transfer function for speech comprehension, the speech MTF. For American English, the speech MTF showed the criticality of low modulation frequencies in both time and frequency. Comprehension was significantly impaired when temporal modulations <12 Hz or spectral modulations <4 cycles/kHz were removed. More specifically, the MTF was bandpass in temporal modulations and low-pass in spectral modulations: temporal modulations from 1 to 7 Hz and spectral modulations <1 cycles/kHz were the most important. We evaluated the importance of spectrotemporal modulations for vocal gender identification and found a different region of interest: removing spectral modulations between 3 and 7 cycles/kHz significantly increases gender misidentifications of female speakers. The determination of the speech MTF furnishes an additional method for producing speech signals with reduced bandwidth but high intelligibility. Such compression could be used for audio applications such as file compression or noise removal and for clinical applications such as signal processing for cochlear implants.

SUBMITTER: Elliott TM

PROVIDER: S-EPMC2639724 | biostudies-literature | 2009 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The modulation transfer function for speech intelligibility.

Elliott Taffeta M TM Theunissen Frédéric E FE

PLoS computational biology 20090306 3

We systematically determined which spectrotemporal modulations in speech are necessary for comprehension by human listeners. Speech comprehension has been shown to be robust to spectral and temporal degradations, but the specific relevance of particular degradations is arguable due to the complexity of the joint spectral and temporal information in the speech signal. We applied a novel modulation filtering technique to recorded sentences to restrict acoustic information quantitatively and to obt ...[more]

PMID: 19266016

Similar Datasets

Project description:Temporal synchrony between facial motion and acoustic modulations is a hallmark feature of audiovisual speech. The moving face and mouth during natural speech is known to be correlated with low-frequency acoustic envelope fluctuations (below 10 Hz), but the precise rates at which envelope information is synchronized with motion in different parts of the face are less clear. Here, we used regularized canonical correlation analysis (rCCA) to learn speech envelope filters whose outputs correlate with motion in different parts of the speakers face. We leveraged recent advances in video-based 3D facial landmark estimation allowing us to examine statistical envelope-face correlations across a large number of speakers (∼4000). Specifically, rCCA was used to learn modulation transfer functions (MTFs) for the speech envelope that significantly predict correlation with facial motion across different speakers. The AV analysis revealed bandpass speech envelope filters at distinct temporal scales. A first set of MTFs showed peaks around 3-4 Hz and were correlated with mouth movements. A second set of MTFs captured envelope fluctuations in the 1-2 Hz range correlated with more global face and head motion. These two distinctive timescales emerged only as a property of natural AV speech statistics across many speakers. A similar analysis of fewer speakers performing a controlled speech task highlighted only the well-known temporal modulations around 4 Hz correlated with orofacial motion. The different bandpass ranges of AV correlation align notably with the average rates at which syllables (3-4 Hz) and phrases (1-2 Hz) are produced in natural speech. Whereas periodicities at the syllable rate are evident in the envelope spectrum of the speech signal itself, slower 1-2 Hz regularities thus only become prominent when considering crossmodal signal statistics. This may indicate a motor origin of temporal regularities at the timescales of syllables and phrases in natural speech.

Project description:The goal of this research was to assess the support for motor speech disorders as explanatory constructs to guide research and treatment of reduced intelligibility in persons with Down syndrome (DS). Participants were the 45 adolescents with DS in the prior paper who were classified into five mutually-exclusive motor speech classifications using the Speech Disorders Classification System. An ordinal index classified participants' percentage of intelligible words in conversation as High (≥ 85%), Moderate (80% - 84.9%), or Low (< 80%). Statistical analyses tested for significant differences in intelligibility status associated with demographic, intelligence, and language variables, and intelligibility status associated with motor speech classifications and speech, prosody, and voice variables. For the 10 participants who met criteria for concurrent Childhood Dysarthria and Childhood Apraxia of Speech at assessment, 80% had reduced (Moderate or Low) intelligibility and 20% had High intelligibility (significant effect size: 0.644). Proportionally more of the 32 participants who met criteria for either dysarthria or apraxia had reduced intelligibility (significant effect size: 0.318). Low intelligibility was significantly associated with across-the-board reductions in phonemic and phonetic accuracy and with inappropriate prosody and voice. Findings are interpreted as support for motor speech disorders in adolescents with DS as explanatory constructs for their reduced intelligibility. Pending cross-validation of findings in diverse samples of persons with DS, studies are needed to assess the efficacy of motor speech classification status to guide selection of treatment methods and intelligibility targets. Abbreviations: CAS: Childhood Apraxia of Speech; CD: Childhood Dysarthria; DS: Down syndrome; II: Intelligibility Index; No MSD: No Motor Speech Disorder; OII: Ordinal Intelligibility Index; PSD: Persistent Speech Delay; SDCS: Speech Disorders Classification System; SMD: Speech Motor Delay.

Project description:PurposeThe purpose of this study was to investigate the association between perceived single-word speech severity and intelligibility in children with childhood apraxia of speech (CAS), with and without comorbid language impairment (LI), and to investigate the contribution of different CAS signs to perceived single-word speech severity and single-word intelligibility.MethodThirty children with CAS, 18 with comorbid LI, completed the Goldman-Fristoe Test of Articulation-Second Edition (GFTA-2). Trained judges coded children's responses for signs of CAS and percent phonemes correct. Nine listeners, blind to diagnoses, rated speech severity using a visual analog scale. Intelligibility was assessed by comparing listeners' orthographic transcriptions of children's responses to target responses.ResultsMeasures of speech severity (GFTA-2 standard score, number of unique CAS signs, total CAS signs, and mean severity rating) were significantly correlated with measures of intelligibility (GFTA-2 raw score, percent phonemes correct, and mean intelligibility score). Speech severity and intelligibility did not differ significantly between children with and without LI. Only consonant errors contributed significant variability to speech severity. Consonant errors and stress errors contributed significant variability to intelligibility.ConclusionsFindings suggest that visual analog scale ratings are a valid and convenient measure of single-word speech severity and that GFTA-2 raw score is an equally convenient measure of single-word intelligibility. The result that consonant errors were by far the major contributor to single-word speech severity and intelligibility in children with CAS, with stress errors also making a small contribution to intelligibility, suggests that consonant accuracy and appropriate lexical stress should be prime therapeutic targets for these children in the context of treatment addressing motor planning/programming, self-monitoring, and self-correcting.Supplemental materialhttps://doi.org/10.23641/asha.19119350.

Dataset Information

The modulation transfer function for speech intelligibility.

Publications

The modulation transfer function for speech intelligibility.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets