Dataset Information

Using multiple imputation to deal with missing data and attrition in longitudinal studies with repeated measures of patient-reported outcomes.

ABSTRACT:

Objective

Missing data is a ubiquitous problem in studies using patient-reported measures, decreasing sample sizes and causing possible bias. In longitudinal studies, special problems relate to attrition and death during follow-up. We describe a methodological approach for the use of multiple imputation (MI) to meet these challenges.

Methods

In a cohort of patients treated with percutaneous coronary intervention followed with use of repetitive questionnaires and information from national registers over 3 years, only 417 out of 1,726 patients had complete data on all measure points and covariates. We suggest strategies for use of MI and different methods for dealing with death along with sensitivity analysis of deviations from the assumption of missing at random, all with the use of standard statistical software. The Mental Component Summary from Short Form 12-item survey was used as an example.

Conclusion

Ignoring missing data may cause bias of unknown size and direction in longitudinal studies. We have illustrated that MI is a feasible method to try to deal with bias due to missing data in longitudinal studies, including attrition and nonresponse, and should be considered in combination with analysis of sensitivity in longitudinal studies. How to handle dropout due to death is still open for debate.

SUBMITTER: Biering K

PROVIDER: S-EPMC4303367 | biostudies-literature | 2015

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Using multiple imputation to deal with missing data and attrition in longitudinal studies with repeated measures of patient-reported outcomes.

Biering Karin K Hjollund Niels Henrik NH Frydenberg Morten M

Clinical epidemiology 20150116

<h4>Objective</h4>Missing data is a ubiquitous problem in studies using patient-reported measures, decreasing sample sizes and causing possible bias. In longitudinal studies, special problems relate to attrition and death during follow-up. We describe a methodological approach for the use of multiple imputation (MI) to meet these challenges.<h4>Methods</h4>In a cohort of patients treated with percutaneous coronary intervention followed with use of repetitive questionnaires and information from n ...[more]

PMID: 25653557

Similar Datasets

Project description:BackgroundElectronic health records (EHRs) provide rich data on many domains not routinely available in other data, as such, they are a promising source to study changes in health outcomes using longitudinal study designs (eg, cohort studies, natural experiments, etc.). Yet, patient attrition rates in these data are unknown.ObjectiveThe objective of this study was to estimate overall and among adults with diabetes or hypertension: (1) patient attrition over a 3-year period at community health centers; and (2) the likelihood that patients with Medicaid permanently switched their source of primary care.Research designA retrospective cohort study of 2012-2017 data from the Accelerating Data Value Across a National Community Health Center Network (ADVANCE) Clinical Data Research Network of community health centers were used to assess EHR data attrition. Oregon Medicaid enrollment and claims data were used to estimate the likelihood of changing the source of primary care.SubjectsA total of 827,657 patients aged 19-64 with ≥1 ambulatory visit from 76 community health center systems across 20 states. In all, 232,891 Oregon Medicaid enrollees (aged 19-64) with a gap of ≥6 months following a claim for a visit billed to a primary care source.MeasuresPercentage of patients not returning within 3 years of their qualifying visit (attrition). The probability that a patient with Medicaid permanently changed their primary care source.ResultsAttrition over the 3 years averaged 33.5%; attrition rates were lower (<25%) among patients with diabetes and/or hypertension. Among Medicaid enrollees, the percentage of provider change after a 6-month gap between visits was 12% for community health center patients compared with 39% for single-provider practice patients. Over 3 years, the likelihood of a patient changing to a new provider increased with length of time since their last visit but remained lowest among community health center patients.ConclusionThis study demonstrates the use of the EHR dataset is a reliable source of data to support longitudinal studies while highlighting variability in attrition by primary care source and chronic conditions.

Project description:BackgroundWith the rise of digital health technologies and telemedicine, the need for evidence-based evaluation is growing. Patient-reported outcome measures (PROMs) and patient-reported experience measures (PREMs) are recommended as an essential part of the evaluation of telemedicine. For the first time, a systematic review has been conducted to investigate the use of PROMs and PREMs in the evaluation studies of telemedicine covering all application types and medical purposes.ObjectiveThis study investigates the following research questions: in which scenarios are PROMs and PREMs collected for evaluation purposes, which PROM and PREM outcome domains have been covered and how often, which outcome measurement instruments have been used and how often, does the selection and quantity of PROMs and PREMs differ between study types and application types, and has the use of PROMs and PREMs changed over time.MethodsWe conducted a systematic literature search of the MEDLINE and Embase databases and included studies published from inception until April 2, 2020. We included studies evaluating telemedicine with patients as the main users; these studies reported PROMs and PREMs within randomized controlled trials, controlled trials, noncontrolled trials, and feasibility trials in English and German.ResultsOf the identified 2671 studies, 303 (11.34%) were included; of the 303 studies, 67 (22.1%) were feasibility studies, 70 (23.1%) were noncontrolled trials, 20 (6.6%) were controlled trials, and 146 (48.2%) were randomized controlled trials. Health-related quality of life (n=310; mean 1.02, SD 1.05), emotional function (n=244; mean 0.81, SD 1.18), and adherence (n=103; mean 0.34, SD 0.53) were the most frequently assessed outcome domains. Self-developed PROMs were used in 21.4% (65/303) of the studies, and self-developed PREMs were used in 22.3% (68/303). PROMs (n=884) were assessed more frequently than PREMs (n=234). As the evidence level of the studies increased, the number of PROMs also increased (τ=-0.45), and the number of PREMs decreased (τ=0.35). Since 2000, not only has the number of studies using PROMs and PREMs increased, but the level of evidence and the number of outcome measurement instruments used have also increased, with the number of PREMs permanently remaining at a lower level.ConclusionsThere have been increasingly more studies, particularly high-evidence studies, which use PROMs and PREMs to evaluate telemedicine. PROMs have been used more frequently than PREMs. With the increasing maturity stage of telemedicine applications and higher evidence level, the use of PROMs increased in line with the recommendations of evaluation guidelines. Health-related quality of life and emotional function were measured in almost all the studies. Simultaneously, health literacy as a precondition for using the application adequately, alongside proper training and guidance, has rarely been reported. Further efforts should be pursued to standardize PROM and PREM collection in evaluation studies of telemedicine.

Project description:Longitudinal intervention studies with repeated measurements over time are an important type of experimental design in biomedical research. Due to the advent of “omics”-sciences (genomics, transcriptomics, proteomics, metabolomics), longitudinal studies generate increasingly multivariate outcome data. Analysis of such data must take both the longitudinal intervention structure and multivariate nature of the data into account. The ASCA+-framework combines general linear models with principal component analysis and can be used to separate and visualize the multivariate effect of different experimental factors. However, this methodology has not yet been developed for the more complex designs often found in longitudinal intervention studies, which may be unbalanced, involve randomized interventions, and have substantial missing data. Here we describe a new methodology, repeated measures ASCA+ (RM-ASCA+), and show how it can be used to model metabolic changes over time, and compare metabolic changes between groups, in both randomized and non-randomized intervention studies. Tools for both visualization and model validation are discussed. This approach can facilitate easier interpretation of data from longitudinal clinical trials with multivariate outcomes. Author summary Clinical trials are increasingly generating large amounts of complex biological data. Examples can include measuring metabolism or gene expression in tissue or blood sampled repeatedly over the course of a treatment. In such cases, one might wish to compare changes in not one, but hundreds, or thousands of variables simultaneously. In order to effectively analyze such data, both the study design and the multivariate nature of the data should be considered during data analysis. ANOVA simultaneous component analysis+ (ASCA+) is a statistical method which combines general linear models with principal component analysis, and provides a way to separate and visualize the effects of different factors on complex biological data. In this work, we describe how repeated measures linear mixed models, a class of models commonly used when analyzing changes over time and treatment effects in longitudinal studies, can be used together with ASCA+ for analyzing clinical trials in a novel method called repeated measures-ASCA+ (RM-ASCA+).

Project description:BACKGROUND:The prospect of assessing cognition longitudinally and remotely is attractive to researchers, health practitioners, and pharmaceutical companies alike. However, such repeated testing regimes place a considerable burden on participants, and with cognitive tasks typically being regarded as effortful and unengaging, these studies may experience high levels of participant attrition. One potential solution is to gamify these tasks to make them more engaging: increasing participant willingness to take part and reducing attrition. However, such an approach must balance task validity with the introduction of entertaining gamelike elements. OBJECTIVE:This study aims to investigate the effects of gamelike features on participant attrition using a between-subjects, longitudinal Web-based testing study. METHODS:We used three variants of a common cognitive task, the Stop Signal Task (SST), with a single gamelike feature in each: one variant where points were rewarded for performing optimally; another where the task was given a graphical theme; and a third variant, which was a standard SST and served as a control condition. Participants completed four compulsory test sessions over 4 consecutive days before entering a 6-day voluntary testing period where they faced a daily decision to either drop out or continue taking part. Participants were paid for each session they completed. RESULTS:A total of 482 participants signed up to take part in the study, with 265 completing the requisite four consecutive test sessions. No evidence of an effect of gamification on attrition was observed. A log-rank test showed no evidence of a difference in dropout rates between task variants (?22=3.0, P=.22), and a one-way analysis of variance of the mean number of sessions completed per participant in each variant also showed no evidence of a difference (F2,262=1.534, P=.21, partial ?2=0.012). CONCLUSIONS:Our findings raise doubts about the ability of gamification to reduce attrition from longitudinal cognitive testing studies.

Project description:BackgroundRetaining participants in cohort studies with multiple follow-up waves is difficult. Commonly, researchers are faced with the problem of missing data, which may introduce biased results as well as a loss of statistical power and precision. The STROBE guidelines von Elm et al. (Lancet, 370:1453-1457, 2007); Vandenbroucke et al. (PLoS Med, 4:e297, 2007) and the guidelines proposed by Sterne et al. (BMJ, 338:b2393, 2009) recommend that cohort studies report on the amount of missing data, the reasons for non-participation and non-response, and the method used to handle missing data in the analyses. We have conducted a review of publications from cohort studies in order to document the reporting of missing data for exposure measures and to describe the statistical methods used to account for the missing data.MethodsA systematic search of English language papers published from January 2000 to December 2009 was carried out in PubMed. Prospective cohort studies with a sample size greater than 1,000 that analysed data using repeated measures of exposure were included.ResultsAmong the 82 papers meeting the inclusion criteria, only 35 (43%) reported the amount of missing data according to the suggested guidelines. Sixty-eight papers (83%) described how they dealt with missing data in the analysis. Most of the papers excluded participants with missing data and performed a complete-case analysis (n=54, 66%). Other papers used more sophisticated methods including multiple imputation (n=5) or fully Bayesian modeling (n=1). Methods known to produce biased results were also used, for example, Last Observation Carried Forward (n=7), the missing indicator method (n=1), and mean value substitution (n=3). For the remaining 14 papers, the method used to handle missing data in the analysis was not stated.ConclusionsThis review highlights the inconsistent reporting of missing data in cohort studies and the continuing use of inappropriate methods to handle missing data in the analysis. Epidemiological journals should invoke the STROBE guidelines as a framework for authors so that the amount of missing data and how this was accounted for in the analysis is transparent in the reporting of cohort studies.

Dataset Information

Using multiple imputation to deal with missing data and attrition in longitudinal studies with repeated measures of patient-reported outcomes.

Objective

Methods

Conclusion

Publications

Using multiple imputation to deal with missing data and attrition in longitudinal studies with repeated measures of patient-reported outcomes.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure