Development and validation of language and visuospatial composite scores in ADNI.
Ontology highlight
ABSTRACT: Introduction
Composite scores may be useful to summarize overall language or visuospatial functioning in studies of older adults.Methods
We used item response theory to derive composite measures for language (ADNI-Lan) and visuospatial functioning (ADNI-VS) from the cognitive battery administered in the Alzheimer's Disease Neuroimaging Initiative (ADNI). We evaluated the scores among groups of people with normal cognition, mild cognitive impairment (MCI), and Alzheimer's disease (AD) in terms of responsiveness to change, association with imaging findings, and ability to differentiate between MCI participants who progressed to AD dementia and those who did not progress.Results
ADNI-Lan and ADNI-VS were able to detect change over time and predict conversion from MCI to AD. They were associated with most of the pre-specified magnetic resonance imaging measures. ADNI-Lan had strong associations with a cerebrospinal fluid biomarker pattern.Discussion
ADNI-Lan and ADNI-VS may be useful composites for language and visuospatial functioning in ADNI.
SUBMITTER: Choi SE
PROVIDER: S-EPMC7718716 | biostudies-literature | 2020
REPOSITORIES: biostudies-literature
Publications
Development and validation of language and visuospatial composite scores in ADNI.
Choi Seo-Eun SE Mukherjee Shubhabrata S Gibbons Laura E LE Sanders R Elizabeth RE Jones Richard N RN Tommet Douglas D Mez Jesse J Trittschuh Emily H EH Saykin Andrew A Lamar Melissa M Rabin Laura L Foldi Nancy S NS Sikkes Sietske S Jutten Roos J RJ Grandoit Evan E Mac Donald Christine C Risacher Shannon S Groot Colin C Ossenkoppele Rik R Crane Paul K PK
Alzheimer's & dementia (New York, N. Y.) 20201205 1
<h4>Introduction</h4>Composite scores may be useful to summarize overall language or visuospatial functioning in studies of older adults.<h4>Methods</h4>We used item response theory to derive composite measures for language (ADNI-Lan) and visuospatial functioning (ADNI-VS) from the cognitive battery administered in the Alzheimer's Disease Neuroimaging Initiative (ADNI). We evaluated the scores among groups of people with normal cognition, mild cognitive impairment (MCI), and Alzheimer's disease ...[more]
Similar Datasets
Project description:We sought to develop and evaluate a composite memory score from the neuropsychological battery used in the Alzheimer's Disease (AD) Neuroimaging Initiative (ADNI). We used modern psychometric approaches to analyze longitudinal Rey Auditory Verbal Learning Test (RAVLT, 2 versions), AD Assessment Schedule - Cognition (ADAS-Cog, 3 versions), Mini-Mental State Examination (MMSE), and Logical Memory data to develop ADNI-Mem, a composite memory score. We compared RAVLT and ADAS-Cog versions, and compared ADNI-Mem to RAVLT recall sum scores, four ADAS-Cog-derived scores, the MMSE, and the Clinical Dementia Rating Sum of Boxes. We evaluated rates of decline in normal cognition, mild cognitive impairment (MCI), and AD, ability to predict conversion from MCI to AD, strength of association with selected imaging parameters, and ability to differentiate rates of decline between participants with and without AD cerebrospinal fluid (CSF) signatures. The second version of the RAVLT was harder than the first. The ADAS-Cog versions were of similar difficulty. ADNI-Mem was slightly better at detecting change than total RAVLT recall scores. It was as good as or better than all of the other scores at predicting conversion from MCI to AD. It was associated with all our selected imaging parameters for people with MCI and AD. Participants with MCI with an AD CSF signature had somewhat more rapid decline than did those without. This paper illustrates appropriate methods for addressing the different versions of word lists, and demonstrates the additional power to be gleaned with a psychometrically sound composite memory score.
| S-EPMC3806057 | biostudies-literature
Project description:BackgroundThe Composite Autonomic Symptom Score 31 (COMPASS 31) is a validated, 31-item self-assessment questionnaire assessing autonomic symptoms in six domains, orthostatic intolerance, vasomotor, secretomotor, gastrointestinal, bladder, and pupillomotor function. So far, there is no validated German COMPASS 31 version. This study aimed at developing and validating a German COMPASS 31.MethodsTwo autonomic experts with command of German and English independently translated the English COMPASS 31 into German. One agreed-upon German version was translated back into English to assure conformity with the original version. Twenty patients with possible autonomic symptoms and 20 age- and gender-matched healthy persons completed the English and German COMPASS 31 in a randomized order with a 4-week interval. To evaluate reliability of the German COMPASS 31, total scores and sub-scores of the domains assessed with the German version were correlated with corresponding scores of the English version using Pearson's or Spearman's test. The Cronbach alpha-coefficient evaluated the internal consistency of the questions. Total- and sub-scores of both COMPASS 31 versions were compared between patients and controls by analysis of variance with post-hoc analysis (significance: p < 0.05).ResultsTotal scores and sub-scores of the German and English COMPASS 31 correlated significantly (p < 0.001) and closely (correlation coefficients: 0.757-0.934). Cronbach alpha-coefficients were above 0.7 in all domains except for the secretomotor domain. In the German and English COMPASS 31, total scores were significantly higher in patients than controls.ConclusionsThe German COMPASS 31 is reliable, internally consistent, and valid to detect and quantify autonomic symptoms in patients with neurological disorders.
| S-EPMC8724156 | biostudies-literature
Project description:BackgroundVisuospatial memory impairment is a common symptom of Alzheimer's disease; however, conventional visuospatial memory tests are insufficient to fully reflect visuospatial memory impairment in daily life.MethodsTo address patients' difficulties in locating and recalling misplaced objects, we introduced a novel visuospatial memory test, the Hidden Objects Test (HOT), conducted in a virtual environment. We categorized HOT scores into prospective memory, item free-recall, place free-recall, item recognition, and place-item matching scores. To validate the VR memory test, we compared HOT scores among individuals with Alzheimer's disease (AD), amnestic mild cognitive impairment (aMCI), and normal controls (NC), and also compared these scores with those of conventional neuropsychological tests. We tracked the participants' movement paths in the virtual environment and assessed basic features, such as total distance, duration, and speed. Additionally, we performed walking trajectory pattern mining such as outlier and stay-point detection.ResultsWe designed and implemented the HOT to simulate a house's living room and assess participants' ability to locate hidden objects. Our preliminary results showed that the total HOT score differed among 17 patients with AD, 14 with aMCI, and 15 NC (p < 0.001). The total HOT score correlated positively with conventional memory test scores (p < 0.001). Walking trajectories showed that patients with AD and aMCI wandered rather than going straight to the hidden objects. In terms of basic features, the total duration was significantly greater in AD than in NC (p = 0.008). In terms of trajectory pattern mining, the number of outliers, which were over 95% of the estimated trajectory, was significantly higher in AD than in NC (p = 0.002). The number of stay points, an index in which participants stayed in the same position for more than 2 s, was significantly higher in patients with AD and aMCI compared with NC (AD vs. NC: p = 0.003, aMCI vs. NC: p = 0.019).ConclusionThe HOT simulating real life showed potential as an ecologically valid test for assessing visuospatial memory function in daily life. Walking trajectory analysis suggested that patients with AD and aMCI wandered rather than going straight toward the hidden objects.
| S-EPMC10701378 | biostudies-literature
Project description:BackgroundChronically higher inflammation, which may partly result from diet and lifestyle, is implicated in risk for multiple chronic diseases. The dietary inflammatory index (DII) and empirical dietary inflammatory pattern (EDIP), developed to characterize dietary contributions to systemic inflammation, have several limitations. There are no scores to characterize contributions of lifestyle to inflammation.ObjectivesTo reflect dietary/lifestyle contributions to inflammation, we developed novel, inflammation biomarker panel-weighted, dietary (DIS) and lifestyle (LIS) inflammation scores in a subset (n = 639) of the Reasons for Geographic and Racial Differences in Stroke Study (REGARDS) cohort.MethodsWe selected a priori 19 food groups and 4 lifestyle characteristics to comprise the DIS and LIS, respectively. We calculated the components' weights based on their strengths of association with an inflammation biomarker score [comprising high-sensitivity C-reactive protein (hsCRP), IL-6, IL-8, and IL-10] using multivariable linear regression. The sums of the weighted components constitute the scores, such that higher scores reflect, on balance, more proinflammatory exposures. We calculated the DIS, LIS, DII, and EDIP with cross-sectional data from the remaining REGARDS cohort ( n = 14,210 with hsCRP measurements) and 2 other study populations with hsCRP and/or an 8-component inflammation biomarker panel, and investigated their associations with circulating inflammation biomarker concentrations using multivariable logistic regression.ResultsIn REGARDS, those in the highest relative to the lowest DIS, LIS, DII, and EDIP quintiles had statistically significant 1.66-, 4.29-, 1.56-, and 1.32-fold higher odds of a high hsCRP concentration (>3 mg/dL), respectively (all P-trend < 0.001). Those in the highest relative to the lowest joint DIS/LIS quintile had a statistically significant 7.26-fold higher odds of a high hsCRP concentration. Similar findings were noted in the other 2 validation populations.ConclusionOur results support that dietary and lifestyle exposures collectively contribute substantially to systemic inflammation, and support the use of our novel DIS and LIS.
| S-EPMC6887697 | biostudies-literature
Project description:BackgroundNatural language processing (NLP) offers significantly faster variable extraction compared to traditional human extraction but cannot interpret complicated notes as well as humans can. Thus, we hypothesized that an "NLP-assisted" extraction system, which uses humans for complicated notes and NLP for uncomplicated notes, could produce faster extraction without compromising accuracy.ObjectiveThe aim of this study was to develop and pilot an NLP-assisted extraction system to leverage the strengths of both human and NLP extraction of prostate cancer Gleason scores.MethodsWe collected all available clinical and pathology notes for prostate cancer patients in an unselected academic biobank cohort. We developed an NLP system to extract prostate cancer Gleason scores from both clinical and pathology notes. Next, we designed and implemented the NLP-assisted extraction system algorithm to categorize notes into "uncomplicated" and "complicated" notes. Uncomplicated notes were assigned to NLP extraction and complicated notes were assigned to human extraction. We randomly reviewed 200 patients to assess the accuracy and speed of our NLP-assisted extraction system and compared it to NLP extraction alone and human extraction alone.ResultsOf the 2051 patients in our cohort, the NLP system extracted a prostate surgery Gleason score from 1147 (55.92%) patients and a prostate biopsy Gleason score from 1624 (79.18%) patients. Our NLP-assisted extraction system had an overall accuracy rate of 98.7%, which was similar to the accuracy of human extraction alone (97.5%; P=.17) and significantly higher than the accuracy of NLP extraction alone (95.3%; P<.001). Moreover, our NLP-assisted extraction system reduced the workload of human extractors by approximately 95%, resulting in an average extraction time of 12.7 seconds per patient (vs 256.1 seconds per patient for human extraction alone).ConclusionsWe demonstrated that an NLP-assisted extraction system was able to achieve much faster Gleason score extraction compared to traditional human extraction without sacrificing accuracy.
| S-EPMC8285739 | biostudies-literature
Project description:The lack of psychometrically sound outcome measures has been a barrier to evaluating the efficacy of treatments proposed for core symptoms of intellectual disability (ID). Research on Expressive Language Sampling (ELS) procedures suggest it is a promising approach to measuring treatment efficacy. ELS entails collecting samples of a participant's talk in interactions with an examiner that are naturalistic but sufficiently structured to ensure consistency and limit examiner effects on the language produced. In this study, we extended previous research on ELS by analyzing an existing dataset to determine whether psychometrically adequate composite scores reflecting multiple dimensions of language can be derived from ELS procedures administered to 6- to 23-year-olds with fragile X syndrome (n = 80) or Down syndrome (n = 78). Data came from ELS conversation and narration procedures administered twice in a 4-week test-retest interval. We found that several composites emerged from variables indexing syntax, vocabulary, planning processes, speech articulation, and talkativeness, although there were some differences in the composites for the two syndromes. Evidence of strong test-retest reliability and construct validity of two of three composites were obtained for each syndrome. Situations in which the composite scores would be useful in evaluating treatment efficacy are outlined.
| S-EPMC10247708 | biostudies-literature
Project description:At the group level, children exposed to certain health and demographic risk factors, and who have delayed language in early childhood are, more likely to have language problems later in childhood. However, it is unclear whether we can use these risk factors to predict whether an individual child is likely to develop problems with language (e.g., be diagnosed with a developmental language disorder). We tested this in a sample of 146 children who took part in the UK-CDI norming project. When the children were 15-18 months old, 1,210 British parents completed: (a) the UK-CDI (a detailed assessment of vocabulary and gesture use) and (b) the Family Questionnaire (questions about health and demographic risk factors). When the children were between 4 and 6 years, 146 of the same parents completed a short questionnaire that assessed (a) whether children had been diagnosed with a disability that was likely to affect language proficiency (e.g., developmental disability, language disorder, hearing impairment), but (b) also yielded a broader measure: whether the child's language had raised any concern, either by a parent or professional. Discriminant function analyses were used to assess whether we could use different combinations of 10 risk factors, together with early vocabulary and gesture scores, to identify children (a) who had developed a language-related disability by the age of 4-6 years (20 children, 13.70% of the sample) or (b) for whom concern about language had been expressed (49 children; 33.56%). The overall accuracy of the models, and the specificity scores were high, indicating that the measures correctly identified those children without a language-related disability and whose language was not of concern. However, sensitivity scores were low, indicating that the models could not identify those children who were diagnosed with a language-related disability or whose language was of concern. Several exploratory analyses were carried out to analyse these results further. Overall, the results suggest that it is difficult to use parent reports of early risk factors and language in the first 2 years of life to predict which children are likely to be diagnosed with a language-related disability. Possible reasons for this are discussed.
| S-EPMC10313203 | biostudies-literature
Project description:Disease-onset time (DOT) and disease trajectory concepts were applied to derive an Alzheimer's disease (AD) progression population model using the clinical dementia rating scale-sum of boxes (CDR-SOB) from the AD neuroimaging initiative (ADNI) database. The model enabled the estimation of a DOT and a disease trajectory for each patient. The model also allowed distinguishing fast and slow-progressing subpopulations according to the functional assessment questionnaire, normalized hippocampal volume, and CDR-SOB score at study entry. On the basis of these prognostic factors, 81% of the mild cognitive impairment (MCI) subjects could correctly be assigned to slow or fast progressers, and 77% of MCI to AD conversions could be predicted whereas the model described correctly 84% of the conversions. Finally, synchronization of the biomarker-time profiles on estimated individual DOT virtually expanded the population observation period from 3 to 8 years. DOT-disease trajectory model is a powerful approach that could be applied to many progressive diseases.CPT: Pharmacometrics & Systems Pharmacology (2013) 2, e78; doi:10.1038/psp.2013.54; advance online publication 2 October 2013.
| S-EPMC3817374 | biostudies-other
Project description:OBJECTIVE:To create a high-quality electronic health record (EHR)-derived mortality dataset for retrospective and prospective real-world evidence generation. DATA SOURCES/STUDY SETTING:Oncology EHR data, supplemented with external commercial and US Social Security Death Index data, benchmarked to the National Death Index (NDI). STUDY DESIGN:We developed a recent, linkable, high-quality mortality variable amalgamated from multiple data sources to supplement EHR data, benchmarked against the highest completeness U.S. mortality data, the NDI. Data quality of the mortality variable version 2.0 is reported here. PRINCIPAL FINDINGS:For advanced non-small-cell lung cancer, sensitivity of mortality information improved from 66 percent in EHR structured data to 91 percent in the composite dataset, with high date agreement compared to the NDI. For advanced melanoma, metastatic colorectal cancer, and metastatic breast cancer, sensitivity of the final variable was 85 to 88 percent. Kaplan-Meier survival analyses showed that improving mortality data completeness minimized overestimation of survival relative to NDI-based estimates. CONCLUSIONS:For EHR-derived data to yield reliable real-world evidence, it needs to be of known and sufficiently high quality. Considering the impact of mortality data completeness on survival endpoints, we highlight the importance of data quality assessment and advocate benchmarking to the NDI.
| S-EPMC6232402 | biostudies-literature
Project description:BackgroundWe developed and validated a new and simple metric, the Programmatic Compliance Score (PCS), based on the IAS-USA antiretroviral therapy management guidelines for HIV-infected adults, as a predictor of all-cause mortality, at a program-wide level. We hypothesized that non-compliance would be associated with the highest probability of mortality.Methods and findings3543 antiretroviral-naive HIV-infected patients aged ?19 years who initiated antiretroviral therapy between January 1, 2000 and August 31, 2009 in British Columbia (BC), Canada, were followed until August 31, 2010. The PCS is composed by six non-performance indicators based on the IAS-USA guidelines: (1) having <3 CD4 count tests in the first year after starting antiretroviral therapy; (2) having <3 plasma viral load tests in the first year after starting antiretroviral therapy; (3) not having drug resistance testing done prior to starting antiretroviral therapy; (4) starting on a non-recommended antiretroviral therapy regimen; (5) starting therapy with CD4 <200 cells/mm(3); and (6) not achieving viral suppression within 6 months since antiretroviral therapy initiation. The sum of these six indicators was used to develop the PCS score - higher score indicates poorer performance. The main outcome was all-cause mortality. Each PCS component was independently associated with mortality. In the mortality analysis, the odds ratio (OR) for PCS ?4 versus 0 was 22.37 (95% CI 10.46-47.84).ConclusionsPCS was strongly associated with all-cause mortality. These results lend independent validation to the IAS-USA treatment guidelines for HIV-infected adults. Further efforts are warranted to enhance the PCS as a means to further improve clinical outcomes. These should be specifically evaluated and targeted at healthcare providers and patients.
| S-EPMC3501505 | biostudies-literature