Dataset Information

Generalizability of cognitive results from clinical trial participants to an older adult population: Addressing external validity.

ABSTRACT:

Introduction

Study inclusion criteria and recruitment practices limit the generalizability of randomized-controlled trial (RCT) results. Statistical modeling could enhance generalizability of outcomes. To illustrate this, the cognition-depression relationship was assessed with and without adjustment relative to the target population of older women.

Methods

Randomized participants from four RCTs and non-randomized participants from two cohorts were included in this study. Prediction models estimated probability of being randomized into trials from target populations. These probabilities were used for inverse odds weighting relative to target populations. Weighted linear regression was used to assess the depression-cognition relationship.

Results

There was no depression-cognition relationship in the combined randomized sample. After applying weights relative to a representative cohort, negative relationships were observed. After applying weights relative to a non-representative cohort, bias of estimates increased.

Discussion

Quantitative approaches to transportability using representative samples may explain the absence of a-priori established relationships in RCTs.

SUBMITTER: Aslanyan V

PROVIDER: S-EPMC10113884 | biostudies-literature | 2023 Apr-Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Generalizability of cognitive results from clinical trial participants to an older adult population: Addressing external validity.

Aslanyan Vahan V Pa Judy J Hodis Howard N HN St John Jan J Kono Naoko N Henderson Victor W VW Mack Wendy J WJ

Alzheimer's & dementia (Amsterdam, Netherlands) 20230419 2

<h4>Introduction</h4>Study inclusion criteria and recruitment practices limit the generalizability of randomized-controlled trial (RCT) results. Statistical modeling could enhance generalizability of outcomes. To illustrate this, the cognition-depression relationship was assessed with and without adjustment relative to the target population of older women.<h4>Methods</h4>Randomized participants from four RCTs and non-randomized participants from two cohorts were included in this study. Predictio ...[more]

PMID: 37091311

Similar Datasets

Project description:BackgroundIn SPRINT (Systolic Blood Pressure Intervention Trial), a systolic blood pressure (SBP) goal of <120 mm Hg resulted in lower cardiovascular disease (CVD) risk compared with an SBP goal of <140 mm Hg.ObjectivesThe purpose of this study was to estimate the prevalence, number, and characteristics of U.S. adults meeting SPRINT eligibility criteria and determine the broader population to whom SPRINT could be generalized.MethodsWe conducted a cross-sectional, population-based study using data from the National Health and Nutrition Examination Survey, 2007 to 2012. The SPRINT inclusion criteria were age ≥50 years, SBP 130 to 180 mm Hg depending on the number of antihypertensive medication classes being taken, and high CVD risk (history of coronary heart disease, estimated glomerular filtration rate of 20 to 59 ml/min/1.73 m(2), 10-year CVD risk ≥15%, or age ≥75 years). Exclusion criteria were diabetes, history of stroke, >1 g in 24 h of proteinuria daily, heart failure, estimated glomerular filtration rate <20 ml/min/1.73 m(2), or receiving dialysis. Treated hypertension was defined by self-reported use of medication to lower blood pressure with ≥1 class of antihypertensive medication identified through a pill bottle review.ResultsOverall, 7.6% (95% confidence interval [CI]: 7.0% to 8.3%) or 16.8 million (95% CI: 15.7 to 17.8 million) U.S. adults, and 16.7% (95% CI: 15.2% to 18.3%) or 8.2 million (95% CI: 7.6 to 8.8 million) adults with treated hypertension met the SPRINT eligibility criteria. Among both the overall U.S. population and adults with treated hypertension, the percentage meeting SPRINT eligibility criteria increased with older age, was higher among males than females, and was higher among non-Hispanic whites compared with non-Hispanic blacks or Hispanics. Of U.S. adults eligible for SPRINT, 51.0% (95% CI: 47.8% to 54.1%) or 8.6 million (95% CI: 8.0 to 9.1 million) were not treated for hypertension.ConclusionsA substantial percentage of U.S. adults meet the eligibility criteria for SPRINT.

Project description:ObjectiveTo compare the discriminant validity of three different single-question assessments of subjective cognitive complaints (SCC) for dementia in a community-based older adult population in Singapore.MethodsEligible older adults aged ≥60 were recruited into phase I for identifying those who require further assessment using the Abbreviated Mental Test (AMT) and progressive forgetfulness question (PFQ). Participants who failed either tests entered phase II and were administered various single-question assessments of SCC, such as the 8th question on the patient Ascertain Dementia 8 (AD8-8pt), informant AD8 (AD8-8info), and the 10th item on the Geriatric Depression Scale (GDS-10), followed by the Montreal Cognitive Assessment (MoCA) and a formal neuropsychological battery to identify the participant's cognitive status by a research diagnosis and DSM-IV criteria. Differences in characteristics among diagnostic groups were compared. All discriminatory indices (sensitivity, specificity, positive, and negative predictive values, overall accuracy) for these single-question assessments and their combinations with the MoCA were calculated and reported to confirm their discriminant validity in identifying the existence of subjective complaints and objective impairment.ResultsA total of 3,780 participants were assessed at phase I, of which 957 entered and completed phase II. Of whom, 911 were dementia-free and 46 had dementia. The MoCA (13/14) displayed good sensitivity (95.6%), specificity (81.5%), and overall accuracy (82.1%) for dementia detection. The GDS-10 and AD8-8pt showed poor discriminant validity, while the AD8-8info had the highest specificity (83.2%) and the greatest overall accuracy (82.5%) for dementia. Compensatory combination of the AD8-8info with MoCA, the sensitivity and positive predictive values were optimized (100%), while the conjunctive combination of two tools achieved excellent specificity (96.3%) and overall accuracy (94.8%) in discriminating dementia patients.Conclusion and implicationsCombining a reliable single-question SCC assessment with an objective tool can efficiently discriminate dementia patients from healthy older adults in the community.

Project description:It is critical to intervene early in the mild cognitive impairment (MCI) stage of the Alzheimer's disease trajectory, but traditional cognitive testing methods are costly, burdensome, and difficult to access. We examined adherence and validity data to a 30-day self-administered ecological momentary cognitive testing protocol among a sample of older adults with MCI and cognitively normal controls to evaluate feasibility, tolerability, and initial validity in comparison to standard neuropsychological tests. Participants included 48 participants with MCI (Mean age = 72 years, SD = 7 years) and 46 demographically-matched cognitively normal (NC) control participants (Mean age = 70 years, SD = 7 years). Participants completed traditional neuropsychological testing to determine MCI status, followed by 30 days of remote ecological momentary cognitive testing. Ecological momentary assessment (EMA) surveys were administered 3 times per day for 30 days (possible total = 90), and mobile cognitive tests were administered every other day (for a total of 15 administrations). Mobile cognitive tests included the Variable Difficulty List Memory Test (VLMT; measure of learning and memory), Memory Matrix (measure of visual working memory), and the Color Trick Test (measure of executive function). EMA and mobile cognitive test adherence, fatigue effects, mobile cognitive test performance and group differences, and psychometrics (reliability, convergent validity, ceiling effects, and practice effects) were examined. Overall mean-level adherence to the mobile cognitive tests was 85% and did not differ by MCI status. The reliability of stable between-person individual differences for the VLMT and Memory Matrix were very high. Moreover, although the reliability of within-person change for Memory Matrix was adequate, the corresponding reliability for VLMT was somewhat low. Averaged performance on the mobile cognitive tests was correlated with lab-based tests measuring the same construct. Participants with MCI performed worse than NCs on the VLMT and Color Trick Test, and there was no evidence of fatigue effects for these two tests. These findings support the feasibility and potential for ecological momentary cognitive testing to support clinical trials and for measuring cognitive changes over time in persons with increased risk for Alzheimer's disease such as those with MCI.

Dataset Information

Generalizability of cognitive results from clinical trial participants to an older adult population: Addressing external validity.

Introduction

Methods

Results

Discussion

Publications

Generalizability of cognitive results from clinical trial participants to an older adult population: Addressing external validity.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets