Dataset Information

Reproducibility of cognitive endpoints in clinical trials: lessons from neurofibromatosis type 1.

ABSTRACT: OBJECTIVE:Rapid developments in understanding the molecular mechanisms underlying cognitive deficits in neurodevelopmental disorders have increased expectations for targeted, mechanism-based treatments. However, translation from preclinical models to human clinical trials has proven challenging. Poor reproducibility of cognitive endpoints may provide one explanation for this finding. We examined the suitability of cognitive outcomes for clinical trials in children with neurofibromatosis type 1 (NF1) by examining test-retest reliability of the measures and the application of data reduction techniques to improve reproducibility. METHODS:Data were analyzed from the STARS clinical trial (n = 146), a multi-center double-blind placebo-controlled phase II trial of lovastatin, conducted by the NF Clinical Trials Consortium. Intra-class correlation coefficients were generated between pre- and post-performances (16-week interval) on neuropsychological endpoints in the placebo group to determine test-retest reliabilities. Confirmatory factor analysis was used to reduce data into cognitive domains and account for measurement error. RESULTS:Test-retest reliabilities were highly variable, with most endpoints demonstrating unacceptably low reproducibility. Data reduction confirmed four distinct neuropsychological domains: executive functioning/attention, visuospatial ability, memory, and behavior. Test-retest reliabilities of latent factors improved to acceptable levels for clinical trials. Applicability and utility of our model was demonstrated by homogeneous effect sizes in the reanalyzed efficacy data. INTERPRETATION:These data demonstrate that single observed endpoints are not appropriate to determine efficacy, partly accounting for the poor test-retest reliability of cognitive outcomes in clinical trials in neurodevelopmental disorders. Recommendations to improve reproducibility are outlined to guide future trial design.

SUBMITTER: Payne JM

PROVIDER: S-EPMC6917317 | biostudies-literature | 2019 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Frontotemporal dementia refers to a group of progressive neurodegenerative syndromes usually caused by the accumulation of pathological tau or TDP-43 proteins. The effects of these proteins in the brain are complex, and each can present with several different clinical syndromes. Clinical efficacy trials of drugs targeting these proteins must use endpoints that are meaningful to all participants despite the variability in symptoms across patients. There are many candidate clinical measures, including neuropsychological scores and functional measures. Brain imaging is another potentially attractive outcome that can be precisely quantified and provides evidence of disease modification. Most imaging studies in frontotemporal dementia have been cross-sectional, and few have compared longitudinal changes in cortical volume with changes in other measures such as perfusion and white matter integrity. The current study characterized longitudinal changes in 161 patients with three frontotemporal dementia syndromes: behavioural variant frontotemporal dementia (n = 77) and the semantic (n = 45) and non-fluent (n = 39) variants of primary progressive aphasia. Visits included comprehensive neuropsychological and functional assessment, structural MRI (3 T), diffusion tensor imaging, and arterial spin labelled perfusion imaging. The goal was to identify measures that are appropriate as clinical trial outcomes for each group, as well as those that might be appropriate for trials that would include more than one of these groups. Linear mixed effects models were used to estimate changes in each measure, and to examine the correlation between imaging and clinical changes. Sample sizes were estimated based on the observed effects for theoretical clinical trials using bootstrapping techniques to provide 95% confidence intervals for these estimates. Declines in functional and neuropsychological measures, as well as frontal and temporal cortical volumes and white matter microstructure were detected in all groups. Imaging changes were statistically significantly correlated with, and explained a substantial portion of variance in, the change in most clinical measures. Perfusion and diffusion tensor imaging accounted for variation in clinical decline beyond volume alone. Sample size estimates for atrophy and diffusion imaging were comparable to clinical measures. Corpus callosal fractional anisotropy led to the lowest sample size estimates for all three syndromes. These findings provide further guidance on selection of trial endpoints for studies in frontotemporal dementia and support the use of neuroimaging, particularly structural and diffusion weighted imaging, as biomarkers. Diffusion and perfusion imaging appear to offer additional utility for explaining clinical change beyond the variance explained by volume alone, arguing for considering multimodal imaging in treatment trials.

Project description:In cancer cachexia trials, measures of physical function are commonly used as endpoints. For drug trials to obtain regulatory approval, efficacy in physical function endpoints may be needed alongside other measures. However, it is not clear which physical function endpoints should be used. The aim of this systematic review was to assess the frequency and diversity of physical function endpoints in cancer cachexia trials. Following a comprehensive electronic literature search of MEDLINE, Embase and Cochrane (1990-2021), records were retrieved. Eligible trials met the following criteria: adults (≥18 years), controlled design, more than 40 participants, use of a cachexia intervention for more than 14 days and use of a physical function endpoint. Physical function measures were classified as an objective measure (hand grip strength [HGS], stair climb power [SCP], timed up and go [TUG] test, 6-min walking test [6MWT] and short physical performance battery [SPPB]), clinician assessment of function (Karnofsky Performance Status [KPS] or Eastern Cooperative Oncology Group-Performance Status [ECOG-PS]) or patient-reported outcomes (physical function subscale of the European Organisation for the Research and Treatment of Cancer Quality of Life Questionnaires [EORTC QLQ-C30 or C15]). Data extraction was performed using Covidence and followed PRISMA guidance (PROSPERO registration: CRD42022276710). A total of 5975 potential studies were examined and 71 were eligible. Pharmacological interventions were assessed in 38 trials (54%). Of these, 11 (29%, n = 1184) examined megestrol and 5 (13%, n = 1928) examined anamorelin; nutritional interventions were assessed in 21 trials (30%); and exercise-based interventions were assessed in 6 trials (8%). The remaining six trials (8%) assessed multimodal interventions. Among the objective measures of physical function (assessed as primary or secondary endpoints), HGS was most commonly examined (33 trials, n = 5081) and demonstrated a statistically significant finding in 12 (36%) trials (n = 2091). The 6MWT was assessed in 12 trials (n = 1074) and was statistically significant in 4 (33%) trials (n = 403), whereas SCP, TUG and SPPB were each assessed in 3 trials. KPS was more commonly assessed than the newer ECOG-PS (16 vs. 9 trials), and patient-reported EORTC QLQ-C30 physical function was reported in 25 trials. HGS is the most commonly used physical function endpoint in cancer cachexia clinical trials. However, heterogeneity in study design, populations, intervention and endpoint selection make it difficult to comment on the optimal endpoint and how to measure this. We offer several recommendations/considerations to improve the design of future clinical trials in cancer cachexia.

Project description:BackgroundClinical trials in severe falciparum malaria require a large sample size to detect clinically meaningful differences in mortality. This means few interventions can be evaluated at any time. Using a validated surrogate endpoint for mortality would provide a useful alternative allowing a smaller sample size. Here we evaluate changes in coma score and plasma lactate as surrogate endpoints for mortality in severe falciparum malaria.MethodsThree datasets of clinical studies in severe malaria were re-evaluated: studies from Chittagong, Bangladesh (adults), the African 'AQUAMAT' trial comparing artesunate and quinine (children), and the Vietnamese 'AQ' study (adults) comparing artemether with quinine. The absolute change, relative change, slope of the normalization over time, and time to normalization were derived from sequential measurements of plasma lactate and coma score, and validated for their use as surrogate endpoint, including the proportion of treatment effect on mortality explained (PTE) by these surrogate measures.ResultsImprovements in lactate concentration or coma scores over the first 24 hours of admission, were strongly prognostic for survival in all datasets. In hyperlactataemic patients in the AQ study (n = 173), lower mortality with artemether compared to quinine closely correlated with faster reduction in plasma lactate concentration, with a high PTE of the relative change in plasma lactate at 8 and 12 hours of 0.81 and 0.75, respectively. In paediatric patients enrolled in the 'AQUAMAT' study with cerebral malaria (n = 785), mortality was lower with artesunate compared to quinine, but this was not associated with faster coma recovery.ConclusionsThe relative changes in plasma lactate concentration assessed at 8 or 12 hours after admission are valid surrogate endpoints for severe malaria studies on antimalarial drugs or adjuvant treatments aiming at improving the microcirculation. Measures of coma recovery are not valid surrogate endpoints for mortality.

Dataset Information

Reproducibility of cognitive endpoints in clinical trials: lessons from neurofibromatosis type 1.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets