Dataset Information

A Virtual Supermarket Program for the Screening of Mild Cognitive Impairment in Older Adults: Diagnostic Accuracy Study.

ABSTRACT:

Background

Mild cognitive impairment (MCI) is often a precursor of dementia, and patients with MCI develop dementia at a higher rate than healthy older adults. Early detection of cognitive decline at the MCI stage supports better planning of care and interventions. At present, the use of virtual reality (VR) in screening for MCI in older adults is promising, but there is little evidence regarding the use of virtual supermarkets to screen for MCI.

Objective

The objectives of this study are to validate a VR game-based test, namely, the Virtual Supermarket Program (VSP), for differentiating patients with MCI and healthy controls and to identify cutoff scores for different age levels.

Methods

Subjects were recruited from several nursing homes and communities in Changchun, China. They were divided into a healthy control group (n=64) and an MCI group (n=62). All subjects were administered the VSP and a series of neuropsychological examinations. The study determined the optimal cutoff, discriminating validity, concurrent validity, and retest reliability of the VSP. We used the area under the receiver operating characteristic curve (AUC) to evaluate the discriminating validity and obtain the optimal cutoff values. Pearson correlation analysis and the intraclass correlation coefficient were used to evaluate the concurrent validity and retest reliability, respectively.

Results

A cutoff score of 46.4 was optimal for the entire sample, yielding a sensitivity of 85.9% and specificity of 79.0% for differentiating individuals with MCI and healthy controls, and the AUC was 0.870 (95% CI 0.799-0.924). The median index of VSP score was 51.1 (range 42.6-60.0). There was a moderate positive correlation between the VSP total score and Mini-Mental State Examination score (r=0.429, P<.001). There was a strong positive correlation between VSP total score and Montreal Cognitive Assessment score (r=0.645, P<.001). The retest reliability of the VSP was feasible (r=0.588, P=.048).

Conclusions

The VSP is interesting and feasible for subjects. It shows high sensitivity and specificity for the identification of MCI in older adults, which makes it a promising screening method. The VSP may be generalized to older adults in other countries, although some cultural adaptation may be necessary.

Trial registration

Chinese Clinical Trial Registry ChiCTR2000040074; https://www.chictr.org.cn/showprojen.aspx?proj=64639.

SUBMITTER: Yan M

PROVIDER: S-EPMC8686451 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundEarly detection of cognitive impairment is among the top research priorities aimed at reducing the global burden of dementia. Currently used screening tools have high sensitivity but lack specificity at their original cut-off, while decreasing the cut-off was repeatedly shown to improve specificity, but at the cost of lower sensitivity. In 2012, a new screening tool was introduced that aims to overcome these limitations - the Quick mild cognitive impairment screen (Qmci). The original English Qmci has been rigorously validated and demonstrated high diagnostic accuracy with both good sensitivity and specificity. We aimed to determine the optimal cut-off value for the German Qmci, and evaluate its diagnostic accuracy, reliability (internal consistency) and construct validity.MethodsWe retrospectively analyzed data from healthy older adults (HOA; n = 43) and individuals who have a clinical diagnosis of 'mild neurocognitive disorder' (mNCD; n = 37) with a biomarker supported characterization of the etiology of mNCD of three studies of the 'Brain-IT' project. Using Youden's Index, we calculated the optimal cut-off score to distinguish between HOA and mNCD. Receiver operating characteristic (ROC) curve analysis was performed to evaluate diagnostic accuracy based on the area under the curve (AUC). Sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) were calculated. Reliability (internal consistency) was analyzed by calculating Cronbach's α. Construct validity was assessed by analyzing convergent validity between Qmci-G subdomain scores and reference assessments measuring the same neurocognitive domain.ResultsThe optimal cut-off score for the Qmci-G was ≤ 67 (AUC = 0.96). This provided a sensitivity of 91.9% and a specificity of 90.7%. The PPV and NPV were 89.5% and 92.9%, respectively. Cronbach's α of the Qmci-G was 0.71 (CI95% [0.65 to 0.78]). The Qmci-G demonstrated good construct validity for subtests measuring learning and memory. Subtests that measure executive functioning and/or visuo-spatial skills showed mixed findings and/or did not correlate as strongly as expected with reference assessments.ConclusionOur findings corroborate the existing evidence of the Qmci's good diagnostic accuracy, reliability, and construct validity. Additionally, the Qmci shows potential in resolving the limitations of commonly used screening tools, such as the Montreal Cognitive Assessment. To verify these findings for the Qmci-G, testing in clinical environments and/or primary health care and direct comparisons with standard screening tools utilized in these settings are warranted.

Project description:BackgroundThe development of diagnostic tools capable of accurately identifying the pathophysiology of mild cognitive impairment (MCI) has become a crucial target considering the claim that disease-modifying treatments should be administered as early as possible in the disease course. Transcranial magnetic stimulation (TMS) protocols have demonstrated analytical validity in discriminating different forms of dementia; however, its value in daily clinical practice in MCI subjects is still unknown.ObjectiveTo evaluate the clinical value of TMS compared to amyloid markers on diagnostic confidence and accuracy in MCI subjects, considering clinicians' expertise.MethodsOne hundred seven MCI subjects were included and classified as MCI-Alzheimer disease (MCI-AD), MCI-frontotemporal dementia (MCI-FTD), MCI-dementia with Lewy bodies (MCI-DLB), or MCI-other in a three-step process based on (i) demographic, clinical, and neuropsychological evaluation (clinical work-up); (ii) clinical work-up PLUS amyloidosis markers or clinical work-up PLUS TMS measures; and (iii) clinical work-up PLUS both markers. Two blinded neurologists with different clinical expertise were asked to express a diagnostic confidence for each MCI subgroup, and ROC curve analyses were performed at each step.ResultsThe addition of TMS markers to clinical work-up significantly increased the diagnostic confidence for MCI-AD (p?=?0.003), MCI-FTD (p?=?0.044), and MCI-DLB (p?=?0.033) compared to clinical work-up alone, but not for MCI-other (p?>?0.05). No significant differences between the add-on effect of TMS and the add-on effect of amyloid markers to clinical work-up were observed (p?>?0.732), while the diagnostic confidence further increased when both markers were available. The greater the clinical expertise, the greater the flexibility in considering alternative diagnosis, and the greater the ability to modify diagnostic confidence with TMS and amyloid markers.ConclusionsTMS in addition to routine clinical assessment in MCI subjects has a significant effect on diagnostic accuracy and confidence, comparable to well-established biomarkers of amyloidosis.

Project description:IntroductionAs the population ages, Alzheimer's disease and other subtypes of dementia are becoming increasingly prevalent. However, in recent years, diagnosis has often been delayed or not made at all. Thus, improving the rate of diagnosis has become an integral part of national dementia strategies. Although screening for dementia remains controversial, the case is strong for screening for dementia and other forms of cognitive impairment in hospital inpatients. For this reason, the objective of this systematic review was to provide clinicians, who wish to implement screening, an up-to-date choice of cognitive tests with the most extensive evidence base for the use in elective hospital inpatients.MethodsFor this systematic review, PubMed, PsycINFO and Cochrane Library were searched by using a multi-concept search strategy. The databases were accessed on April 10, 2019. All cross-sectional studies that utilized brief, multi-domain cognitive tests as index test and a reference standard diagnosis of dementia or mild cognitive impairment as comparator were included. Only studies conducted in the hospital setting, sampling from unselected, elective inpatients older than 64 were considered.ResultsSix studies met the inclusion criteria, with a total of 2112 participants. Diagnostic accuracy data for the Six-Item Cognitive Impairment Test, Cognitive Performance Scale, Clock-Drawing Test, Mini-Mental Status Examination, and Time & Change test were extracted and descriptively analyzed. Clinical and methodological heterogeneity between the studies precluded performing a meta-analysis.DiscussionThis review found only a small number of instruments and was not able to recommend a single best instrument for use in a hospital setting. Although it was not possible to estimate the pooled operating characteristics, the included description of instrument characteristics, the descriptive analysis of performance measures, and the critical evaluation of the reporting studies may contribute to clinician's choice of the screening instrument that fits best their purpose.

Project description:BackgroundThe National Institutes of Health Obesity-Related Behavioral Intervention Trials model for intervention development was used to establish the feasibility and proof of concept of a motivational ketogenic nutrition adherence program for older adults with mild cognitive impairment.MethodsThis was a single-arm, single-center feasibility trial. A comprehensive assessment protocol, including a clinical interview, neuropsychological testing, and genetic sequencing was used as an initial screening. Nine participants (aged 64-75) with possible amnestic mild cognitive impairment were consented for the intervention. Participants completed pre- and post-intervention neuropsychological assessments using the updated Repeatable Battery for Assessment of Neuropsychological Status. Participants tracked their macronutrient consumption using food diaries and ketone levels using urinalysis test strips daily. Mood and other psychosocial variables were collected through surveys, and qualitative exit interviews were completed.Results100% of participants who began the trial completed the 6-week ketogenic nutrition adherence program, including completion of the pre- and post-assessments. Eight participants achieved measurable levels of ketones during the program. The average self-rated adherence across the program was 8.7 out of 10. A Wilcoxon Signed-Rank test demonstrated significant improvement in cognitive performance from baseline (median = 88) to follow up (median = 96, Z = - 2.26, p = .024). The average difference in cognitive performance from baseline to follow-up was - 7.33 (95% CI - 12.85, - 1.82).ConclusionsResults supported the feasibility for moving to the next phase and demonstrated proof of concept for the intervention. The next step is a randomized pilot trial to test clinical signals of effect compared to a control condition.Trial registrationThis trial was retrospectively registered with clinicaltrials.gov on July 13, 2021. The trial number is NCT04968041.