Dataset Information

Correlating natural language processing and automated speech analysis with clinician assessment to quantify speech-language changes in mild cognitive impairment and Alzheimer's dementia.

ABSTRACT:

Background

Language impairment is an important marker of neurodegenerative disorders. Despite this, there is no universal system of terminology used to describe these impairments and large inter-rater variability can exist between clinicians assessing language. The use of natural language processing (NLP) and automated speech analysis (ASA) is emerging as a novel and potentially more objective method to assess language in individuals with mild cognitive impairment (MCI) and Alzheimer's dementia (AD). No studies have analyzed how variables extracted through NLP and ASA might also be correlated to language impairments identified by a clinician.

Methods

Audio recordings (n=30) from participants with AD, MCI, and controls were rated by clinicians for word-finding difficulty, incoherence, perseveration, and errors in speech. Speech recordings were also transcribed, and linguistic and acoustic variables were extracted through NLP and ASA. Correlations between clinician-rated speech characteristics and the variables were compared using Spearman's correlation. Exploratory factor analysis was applied to find common factors between variables for each speech characteristic.

Results

Clinician agreement was high in three of the four speech characteristics: word-finding difficulty (ICC = 0.92, p<0.001), incoherence (ICC = 0.91, p<0.001), and perseveration (ICC = 0.88, p<0.001). Word-finding difficulty and incoherence were useful constructs at distinguishing MCI and AD from controls, while perseveration and speech errors were less relevant. Word-finding difficulty as a construct was explained by three factors, including number and duration of pauses, word duration, and syntactic complexity. Incoherence was explained by two factors, including increased average word duration, use of past tense, and changes in age of acquisition, and more negative valence.

Conclusions

Variables extracted through automated acoustic and linguistic analysis of MCI and AD speech were significantly correlated with clinician ratings of speech and language characteristics. Our results suggest that correlating NLP and ASA with clinician observations is an objective and novel approach to measuring speech and language changes in neurodegenerative disorders.

SUBMITTER: Yeung A

PROVIDER: S-EPMC8178861 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundMild cognitive impairment and cognitive impairment, no dementia, are emerging terms that encompass the clinical state between normal cognition and dementia in elderly people. Controversy surrounds their characterization, definition and application in clinical practice. In this article, we provide physicians with practical guidance on the definition, diagnosis and treatment of mild cognitive impairment and cognitive impairment, no dementia, based on recommendations from the Third Canadian Consensus Conference on the Diagnosis and Treatment of Dementia, held in March 2006.MethodsWe developed evidence-based guidelines using systematic literature searches, with specific criteria for study selection and quality assessment, and a clear and transparent decision-making process. We selected studies published from January 1996 to December 2005 that had mild cognitive impairment or cognitive impairment, no dementia, as the outcome. Subsequent to the conference, we searched for additional articles published between January 2006 and January 2008. We graded the strength of evidence using the criteria of the Canadian Task Force on Preventive Health Care.ResultsWe identified 2483 articles, of which 314 were considered to be relevant and of good or fair quality. From a synthesis of the evidence in these studies, we made 16 recommendations. In brief, family physicians should be aware that most types of dementia are preceded by a recognizable phase of mild cognitive decline. They should be familiar with the concepts of mild cognitive impairment and of cognitive impairment, no dementia. Patients with these conditions should be closely monitored because of their increased risk for dementia. Leisure activities, cognitive stimulation and physical activity could be promoted as part of a healthy lifestyle in elderly people and those with mild cognitive impairment. Vascular risk factors should be treated optimally. No other specific therapies can yet be recommended.InterpretationPhysicians will increasingly see elderly patients with mild memory loss, and learning an approach to diagnosing states such as mild cognitive impairment is now warranted. Close monitoring for progression to dementia, promotion of a healthy lifestyle and treatment of vascular risk factors are recommended for the management of patients with mild cognitive impairment.