Dataset Information

Acoustic source characteristics, across-formant integration, and speech intelligibility under competitive conditions.

ABSTRACT: An important aspect of speech perception is the ability to group or select formants using cues in the acoustic source characteristics--for example, fundamental frequency (F0) differences between formants promote their segregation. This study explored the role of more radical differences in source characteristics. Three-formant (F1+F2+F3) synthetic speech analogues were derived from natural sentences. In Experiment 1, F1+F3 were generated by passing a harmonic glottal source (F0 = 140 Hz) through second-order resonators (H1+H3); in Experiment 2, F1+F3 were tonal (sine-wave) analogues (T1+T3). F2 could take either form (H2 or T2). In some conditions, the target formants were presented alone, either monaurally or dichotically (left ear = F1+F3; right ear = F2). In others, they were accompanied by a competitor for F2 (F1+F2C+F3; F2), which listeners must reject to optimize recognition. Competitors (H2C or T2C) were created using the time-reversed frequency and amplitude contours of F2. Dichotic presentation of F2 and F2C ensured that the impact of the competitor arose primarily through informational masking. In the absence of F2C, the effect of a source mismatch between F1+F3 and F2 was relatively modest. When F2C was present, intelligibility was lowest when F2 was tonal and F2C was harmonic, irrespective of which type matched F1+F3. This finding suggests that source type and context, rather than similarity, govern the phonetic contribution of a formant. It is proposed that wideband harmonic analogues are more effective informational maskers than narrowband tonal analogues, and so become dominant in across-frequency integration of phonetic information when placed in competition.

SUBMITTER: Roberts B

PROVIDER: S-EPMC4445382 | biostudies-literature | 2015 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Acoustic source characteristics, across-formant integration, and speech intelligibility under competitive conditions.

Roberts Brian B Summers Robert J RJ Bailey Peter J PJ

Journal of experimental psychology. Human perception and performance 20150309 3

An important aspect of speech perception is the ability to group or select formants using cues in the acoustic source characteristics--for example, fundamental frequency (F0) differences between formants promote their segregation. This study explored the role of more radical differences in source characteristics. Three-formant (F1+F2+F3) synthetic speech analogues were derived from natural sentences. In Experiment 1, F1+F3 were generated by passing a harmonic glottal source (F0 = 140 Hz) through ...[more]

PMID: 25751040

Similar Datasets

Project description:Background: There exists a cohort of children and adults who exhibit an inordinately high degree of discomfort when experiencing what would be considered moderate and manageable levels of sensory input. That is, they show over-responsivity in the face of entirely typical sound, light, touch, taste, or smell inputs, and this occurs to such an extent that it interferes with their daily functioning and reaches clinical levels of dysfunction. What marks these individuals apart is that this sensory processing disorder (SPD) is observed in the absence of other symptom clusters that would result in a diagnosis of Autism, ADHD, or other neurodevelopmental disorders more typically associated with sensory processing difficulties. One major theory forwarded to account for these SPDs posits a deficit in multisensory integration, such that the various sensory inputs are not appropriately integrated into the central nervous system, leading to an overwhelming sensory-perceptual environment, and in turn to the sensory-defensive phenotype observed in these individuals. Methods: We tested whether children (6-16 years) with an over-responsive SPD phenotype (N = 12) integrated multisensory speech differently from age-matched typically-developing controls (TD: N = 12). Participants identified monosyllabic words while background noise level and sensory modality (auditory-alone, visual-alone, audiovisual) were varied in pseudorandom order. Improved word identification when speech was both seen and heard compared to when it was simply heard served to index multisensory speech integration. Results: School-aged children with an SPD show a deficit in the ability to benefit from the combination of both seen and heard speech inputs under noisy environmental conditions, suggesting that these children do not benefit from multisensory integrative processing to the same extent as their typically developing peers. In contrast, auditory-alone performance did not differ between the groups, signifying that this multisensory deficit is not simply due to impaired processing of auditory speech. Conclusions: Children with an over-responsive SPD show a substantial reduction in their ability to benefit from complementary audiovisual speech, to enhance speech perception in a noisy environment. This has clear implications for performance in the classroom and other learning environments. Impaired multisensory integration may contribute to sensory over-reactivity that is the definitional of SPD.

Project description:The goal of this research was to assess the support for motor speech disorders as explanatory constructs to guide research and treatment of reduced intelligibility in persons with Down syndrome (DS). Participants were the 45 adolescents with DS in the prior paper who were classified into five mutually-exclusive motor speech classifications using the Speech Disorders Classification System. An ordinal index classified participants' percentage of intelligible words in conversation as High (≥ 85%), Moderate (80% - 84.9%), or Low (< 80%). Statistical analyses tested for significant differences in intelligibility status associated with demographic, intelligence, and language variables, and intelligibility status associated with motor speech classifications and speech, prosody, and voice variables. For the 10 participants who met criteria for concurrent Childhood Dysarthria and Childhood Apraxia of Speech at assessment, 80% had reduced (Moderate or Low) intelligibility and 20% had High intelligibility (significant effect size: 0.644). Proportionally more of the 32 participants who met criteria for either dysarthria or apraxia had reduced intelligibility (significant effect size: 0.318). Low intelligibility was significantly associated with across-the-board reductions in phonemic and phonetic accuracy and with inappropriate prosody and voice. Findings are interpreted as support for motor speech disorders in adolescents with DS as explanatory constructs for their reduced intelligibility. Pending cross-validation of findings in diverse samples of persons with DS, studies are needed to assess the efficacy of motor speech classification status to guide selection of treatment methods and intelligibility targets. Abbreviations: CAS: Childhood Apraxia of Speech; CD: Childhood Dysarthria; DS: Down syndrome; II: Intelligibility Index; No MSD: No Motor Speech Disorder; OII: Ordinal Intelligibility Index; PSD: Persistent Speech Delay; SDCS: Speech Disorders Classification System; SMD: Speech Motor Delay.

Project description:Background: Advances in machine learning (ML) technology have opened new avenues for detection and monitoring of cognitive decline. In this study, a multimodal approach to Alzheimer's dementia detection based on the patient's spontaneous speech is presented. This approach was tested on a standard, publicly available Alzheimer's speech dataset for comparability. The data comprise voice samples from 156 participants (1:1 ratio of Alzheimer's to control), matched by age and gender. Materials and Methods: A recently developed Active Data Representation (ADR) technique for voice processing was employed as a framework for fusion of acoustic and textual features at sentence and word level. Temporal aspects of textual features were investigated in conjunction with acoustic features in order to shed light on the temporal interplay between paralinguistic (acoustic) and linguistic (textual) aspects of Alzheimer's speech. Combinations between several configurations of ADR features and more traditional bag-of-n-grams approaches were used in an ensemble of classifiers built and evaluated on a standardised dataset containing recorded speech of scene descriptions and textual transcripts. Results: Employing only semantic bag-of-n-grams features, an accuracy of 89.58% was achieved in distinguishing between Alzheimer's patients and healthy controls. Adding temporal and structural information by combining bag-of-n-grams features with ADR audio/textual features, the accuracy could be improved to 91.67% on the test set. An accuracy of 93.75% was achieved through late fusion of the three best feature configurations, which corresponds to a 4.7% improvement over the best result reported in the literature for this dataset. Conclusion: The proposed combination of ADR audio and textual features is capable of successfully modelling temporal aspects of the data. The machine learning approach toward dementia detection achieves best performance when ADR features are combined with strong semantic bag-of-n-grams features. This combination leads to state-of-the-art performance on the AD classification task.

Dataset Information

Acoustic source characteristics, across-formant integration, and speech intelligibility under competitive conditions.

Publications

Acoustic source characteristics, across-formant integration, and speech intelligibility under competitive conditions.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets