Dataset Information

Comprehensive review of statistical methods for analysing patient-reported outcomes (PROs) used as primary outcomes in randomised controlled trials (RCTs) published by the UK's Health Technology Assessment (HTA) journal (1997-2020).

ABSTRACT:

Objectives

To identify how frequently patient-reported outcomes (PROs) are used as primary and/or secondary outcomes in randomised controlled trials (RCTs) and to summarise what statistical methods are used for the analysis of PROs.

Design

Comprehensive review.

Setting

RCTs funded and published by the United Kingdom's (UK) National Institute for Health Research (NIHR) Health Technology Assessment (HTA) Programme.

Data sources and eligibility

HTA reports of RCTs published between January 1997 and December 2020 were reviewed.

Data extraction

Information relating to PRO use and analysis methods was extracted.

Primary and secondary outcome measures

The frequency of using PROs as primary and/or secondary outcomes; statistical methods that were used for the analysis of PROs as primary outcomes.

Results

In this review, 37.6% (114/303) of trials used PROs as primary outcomes, and 82.8% (251/303) of trials used PROs as secondary outcomes from 303 NIHR HTA reports of RCTs. In the 114 RCTs where the PRO was the primary outcome, the most used PRO was the Short-Form 36 (8/114); the most popular methods for multivariable analysis were linear mixed model (45/114), linear regression (29/114) and analysis of covariance (13/114); logistic regression was applied for binary and ordinal outcomes in 14/114 trials; and the repeated measures analysis was used in 39/114 trials.

Conclusion

The majority of trials used PROs as primary and/or secondary outcomes. Conventional methods such as linear regression are widely used, despite the potential violation of their assumptions. In recent years, there is an increasing trend of using complex models (eg, with mixed effects). Statistical methods developed to address these violations when analysing PROs, such as beta-binomial regression, are not routinely used in practice. Future research will focus on evaluating available statistical methods for the analysis of PROs.

SUBMITTER: Qian Y

PROVIDER: S-EPMC8422492 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundAs production of rapid reviews (RRs) increases in healthcare, knowing how to efficiently convey RR evidence to various end-users is important given they are often intended to directly inform decision-making. Little is known about how often RRs are produced in the published or unpublished domains, and what and how information is structured.ObjectivesTo compare and contrast report format and content features of journal-published (JP) and non-journal published (NJP) RRs.MethodsJP RRs were identified from key databases, and NJP RRs were identified from a grey literature search of 148 RR producing organizations and were sampled proportionate to cluster size by organization and product type to match the JP RR group. We extracted and formally compared 'how' (i.e., visual arrangement) and 'what' information was presented.ResultsWe identified 103 RRs (52 JP and 51 NJP) from 2016. A higher percentage of certain features were observed in JP RRs compared to NJP RRs (e.g., reporting authors; use of a traditional journal article structure; section headers including abstract, methods, discussion, conclusions, acknowledgments, conflict of interests, and author contributions; and use of figures (e.g., Study Flow Diagram) in the main document). For NJP RRs, a higher percentage of features were observed (e.g., use non-traditional report structures; bannering of executive summary sections and appendices; use of typographic cues; and including outcome tables). NJP RRs were more than double in length versus JP RRs. Including key messages was uncommon in both groups.ConclusionsThis comparative study highlights differences between JP and NJP RRs. Both groups may benefit from better use of plain language, and more clear and concise design. Alternative innovative formats and end-user preferences for content and layout should be studied further with thought given to other considerations to ensure better packaging of RR results to facilitate uptake into policy and practice.Study registrationThe full protocol is available at: https://osf.io/29xvk/.

Project description:BACKGROUND:In individually randomised trials we might expect interventions delivered in groups or by care providers to result in clustering of outcomes for participants treated in the same group or by the same care provider. In partially nested randomised controlled trials (pnRCTs) this clustering only occurs in one trial arm, commonly the intervention arm. It is important to measure and account for between-cluster variability in trial design and analysis. We compare analysis approaches for pnRCTs with continuous outcomes, investigating the impact on statistical inference of cluster sizes, coding of the non-clustered arm, intracluster correlation coefficient (ICCs), and differential variance between intervention and control arm, and provide recommendations for analysis. METHODS:We performed a simulation study assessing the performance of six analysis approaches for a two-arm pnRCT with a continuous outcome. These include: linear regression model; fully clustered mixed-effects model with singleton clusters in control arm; fully clustered mixed-effects model with one large cluster in control arm; fully clustered mixed-effects model with pseudo clusters in control arm; partially nested homoscedastic mixed effects model, and partially nested heteroscedastic mixed effects model. We varied the cluster size, number of clusters, ICC, and individual variance between the two trial arms. RESULTS:All models provided unbiased intervention effect estimates. In the partially nested mixed-effects models, methods for classifying the non-clustered control arm had negligible impact. Failure to account for even small ICCs resulted in inflated Type I error rates and over-coverage of confidence intervals. Fully clustered mixed effects models provided poor control of the Type I error rates and biased ICC estimates. The heteroscedastic partially nested mixed-effects model maintained relatively good control of Type I error rates, unbiased ICC estimation, and did not noticeably reduce power even with homoscedastic individual variances across arms. CONCLUSIONS:In general, we recommend the use of a heteroscedastic partially nested mixed-effects model, which models the clustering in only one arm, for continuous outcomes similar to those generated under the scenarios of our simulations study. However, with few clusters (3-6), small cluster sizes (5-10), and small ICC (?0.05) this model underestimates Type I error rates and there is no optimal model.

Project description:BackgroundThe Introduction of mobile health (mHealth) devices to health intervention studies challenges us as researchers to adapt how we analyse the impact of these technologies. For interventions involving chronic illness self-management, we must consider changes in behaviour in addition to changes in health. Fortunately, these mHealth technologies can record participants' interactions via usage-logs during research interventions.ObjectiveThe objective of this paper is to demonstrate the potential of analysing mHealth usage-logs by presenting an in-depth analysis as a preliminary study for using behavioural theories to contextualize the user-recorded results of mHealth intervention studies. We use the logs collected by persons with type 2 diabetes during a randomized controlled trial (RCT) as a use-case.MethodsThe Few Touch Application was tested in a year-long intervention, which allowed participants to register and review their blood glucose, diet and physical activity, goals, and access general disease information. Usage-logs, i.e. logged interactions with the mHealth devices, were collected from participants (n = 101) in the intervention groups. HbA1c was collected (baseline, 4- and 12-months). Usage logs were categorized into registrations or navigations.ResultsThere were n = 29 non-mHealth users, n = 11 short-term users and n = 61 long-term users. Non-mHealth users increased (+0.33%) while Long-term users reduced their HbA1c (-0.86%), which was significantly different (P = .021). Long-term users significantly decreased their usage over the year (P < .001). K-means clustering revealed two clusters: one dominated by diet/exercise interactions (n = 16), and one dominated by BG interactions and navigations in general (n = 40). The only significant difference between these two clusters was that the first cluster spent more time on the goals functionalities than the second (P < .001).ConclusionBy comparing participants based upon their usage-logs, we were able to discern differences in HbA1c as well as usage patterns. This approach demonstrates the potential of analysing usage-logs to better understand how participants engage during mHealth intervention studies.

Project description:BackgroundThe burden of pneumonia continues to be substantial, particularly among the poorest in global society. We describe here the trends for UK pneumonia R&D investment and published outputs, and correlate with 2013 global mortality.MethodsData related to awards to UK institutions for pneumonia research from 1997 to 2013 were systematically sourced and categorised by disease area and type of science. Investment was compared to mortality figures in 2010 and 2013 for pneumonia, tuberculosis and influenza. Investment was also compared to publication data.ResultsOf all infectious disease research between 2011 and 2013 (£917.0 million), £28.8 million (3.1%) was for pneumonia. This was an absolute and proportionate increase from previous time periods. Translational pneumonia research (33.3%) received increased funding compared with 1997-2010 where funding was almost entirely preclinical (87.5%, here 30.9%), but high-burden areas such as paediatrics, elderly care and antimicrobial resistance received little investment. Annual investment remains volatile; publication temporal trends show a consistent increase. When comparing investment to global burden with a novel 'investment by mortality observed' metric, tuberculosis (£48.36) and influenza (£484.21) receive relatively more funding than pneumonia (£43.08), despite investment for pneumonia greatly increasing in 2013 compared to 2010 (£7.39). Limitations include a lack of private sector data and the need for careful interpretation of the comparisons with burden, plus categorisation is subjective.ConclusionsThere has been a welcome increase for pneumonia funding awarded to UK institutions in 2011-2013 compared with 1997-2010, along with increases for more translational research. Published outputs relating to pneumonia rose steadily from 1997 to 2013. Investment relative to mortality for pneumonia has increased, but it remains low compared to other respiratory infections and clear inequities remain. Analyses that measure investments in pneumonia can provide an insight into funding trends and research gaps.Research in contextPneumonia continues to be a high-burden illness around the globe. This paper shows that although research funding is increasing in the UK (between 1997 and 2013), it remains poorly funded compared to other important respiratory infectious diseases such as tuberculosis and influenza. Publications about pneumonia have been steadily increasing over time, indicating continuing academic and clinical interest in the topic. Though global mortality of pneumonia is declining, it should still be an area of high priority for funders, policymakers and researchers.