Dataset Information

Reporting Treatment Fidelity in Behavioral Tobacco Treatment Clinical Trials: Scoping Review and Measurement Recommendations.

ABSTRACT:

Introduction

Adoption of rigorous standards for reporting treatment fidelity is essential for advancing discovery, validation, and implementation of behavioral treatments. Whereas the NIH Behavior Change Consortium (BCC) developed an assessment tool to assess the quality of reporting and monitoring of treatment fidelity across health behavior change interventions, it has not yet been applied specifically to treatment fidelity in behavioral tobacco treatment trials.

Aims and methods

We conducted a scoping review of peer-reviewed, clinical trials of behavioral adult tobacco treatment interventions published in English between 2006 and 2018. Using the BCC treatment fidelity checklist, articles were coded for the presence or absence of various treatment fidelity strategies within each of 5 domains: Design, Training, Delivery, Receipt, and Enactment. Eligible articles (N = 755) were coded by two independent coders.

Results

The proportion of reporting strategies varied within the fidelity domains, ranging from 5.2% to 96.3% in Design, 1.9% to 24.9% in Training, 2.6% to 32.3% in Delivery, 5.2% to 44.3% in Receipt, and 6.7% to 43.2% in Enactment. The mean proportion of adherence to treatment fidelity strategies within each domain was: Design (68%), Training (14%), Delivery (15%), Receipt (16%), and Enactment (25%). Only 11 studies achieved ≥80% reporting across >1 fidelity domain. There was no evidence for improvement in fidelity reporting across the 13-year time frame from the initial BCC publication to the present.

Conclusions

These findings illustrate the lack of consistency in fidelity reporting in tobacco treatment trials and underscore the challenges faced in evaluating rigor and reproducibility, as well as interpretation and dissemination of findings. Recommendations are made for improving fidelity reporting in tobacco treatment trials.

Implications

The SRNT Treatment Research Network sponsored a scoping review to summarize the current state of reporting treatment fidelity and make recommendations for best practices in reporting fidelity in tobacco treatment trials. The review identified a lack of consistency in fidelity reporting, illustrating the challenges faced in evaluating rigor, and reproducibility, as well as interpretation and dissemination of findings.

SUBMITTER: Salloum RG

PROVIDER: S-EPMC9013002 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundClinicians, patients, and policy-makers rely on published evidence from clinical trials to help inform decision-making. A lack of complete and transparent reporting of the investigated trial outcomes limits reproducibility of results and knowledge synthesis efforts, and contributes to outcome switching and other reporting biases. Outcome-specific extensions for the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT-Outcomes) and Consolidated Standards of Reporting Trials (CONSORT-Outcomes) reporting guidelines are under development to facilitate harmonized reporting of outcomes in trial protocols and reports. The aim of this review was to identify and synthesize existing guidance for trial outcome reporting to inform extension development.MethodsWe searched for documents published in the last 10 years that provided guidance on trial outcome reporting using: an electronic bibliographic database search (MEDLINE and the Cochrane Methodology Register); a grey literature search; and solicitation of colleagues using a snowballing approach. Two reviewers completed title and abstract screening, full-text screening, and data charting after training. Extracted trial outcome reporting guidance was compared with candidate reporting items to support, refute, or refine the items and to assess the need for the development of additional items.ResultsIn total, 1758 trial outcome reporting recommendations were identified within 244 eligible documents. The majority of documents were published by academic journals (72%). Comparison of each recommendation with the initial list of 70 candidate items led to the development of an additional 62 items, producing 132 candidate items. The items encompassed outcome selection, definition, measurement, analysis, interpretation, and reporting of modifications between trial documents. The total number of documents supporting each candidate item ranged widely (median 5, range 0-84 documents per item), illustrating heterogeneity in the recommendations currently available for outcome reporting across a large and diverse sample of sources.ConclusionsOutcome reporting guidance for clinical trial protocols and reports lacks consistency and is spread across a large number of sources that may be challenging to access and implement in practice. Evidence and consensus-based guidance, currently in development (SPIRIT-Outcomes and CONSORT-Outcomes), may help authors adequately describe trial outcomes in protocols and reports transparently and completely to help reduce avoidable research waste.

Project description:IntroductionFlavored electronic nicotine delivery systems (ENDS) and tobacco products are associated with the initiation and progression of tobacco use. With recent restrictions around flavored products, it is critical to measure both the product and the flavor being used. The Tobacco Centers of Regulatory Science (TCORS) Flavored Tobacco Products Measurement Subcommittee (FTPMS) was established to develop core measures to assess flavored tobacco and ENDS product usage, facilitate data harmonization, replicability, and comparisons across studies.Aims and methodsThe FTPMS used a mixed-method approach to inform the development of recommended measures (first use, current use, reasons for use) to assess tobacco and ENDS product flavors. This included reviewing existing surveys, identifying priority areas, developing new measures, cognitive testing, and finalization of recommended measures.ResultsRecommended measures were selected from national surveys (e.g. PATH study) and survey items used in TCORS studies to evaluate first use, current use, and reasons for use of tobacco and ENDS products. Response options were expanded for questions about specific flavors and adapted to allow for assessments relevant to recent federal policies. Supplemental measures were developed for researchers conducting more in-depth research around flavored products.ConclusionsUsing an expert consensus process supplemented with cognitive testing, the FTPMS developed recommendations for core and supplemental measures for flavored tobacco and ENDS products. Harmonizing data on these factors for flavored tobacco and ENDS products are critical for researchers and may provide actionable evidence to federal, state, and local regulators and policymakers, as well as support evaluations of policies restricting flavors in these products.ImplicationsThe development of core measures to assess first use, current use, and reasons for use of flavored tobacco and ENDS products will facilitate data harmonization, replicability, and comparisons across studies conducted in different samples or across communities with varying levels of regulation for these products. Use of these standardized measures will allow for a greater understanding of the role of flavors and helps to build a more robust evidence base to inform regulatory decisions to reduce tobacco and ENDS use at the population level.