Dataset Information

Evaluating implementation of the Transparency and Openness Promotion (TOP) guidelines: the TRUST process for rating journal policies, procedures, and practices.

ABSTRACT:

Background

The Transparency and Openness Promotion (TOP) Guidelines describe modular standards that journals can adopt to promote open science. The TOP Factor is a metric to describe the extent to which journals have adopted the TOP Guidelines in their policies. Systematic methods and rating instruments are needed to calculate the TOP Factor. Moreover, implementation of these open science policies depends on journal procedures and practices, for which TOP provides no standards or rating instruments.

Methods

We describe a process for assessing journal policies, procedures, and practices according to the TOP Guidelines. We developed this process as part of the Transparency of Research Underpinning Social Intervention Tiers (TRUST) Initiative to advance open science in the social intervention research ecosystem. We also provide new instruments for rating journal instructions to authors (policies), manuscript submission systems (procedures), and published articles (practices) according to standards in the TOP Guidelines. In addition, we describe how to determine the TOP Factor score for a journal, calculate reliability of journal ratings, and assess coherence among a journal's policies, procedures, and practices. As a demonstration of this process, we describe a protocol for studying approximately 345 influential journals that have published research used to inform evidence-based policy.

Discussion

The TRUST Process includes systematic methods and rating instruments for assessing and facilitating implementation of the TOP Guidelines by journals across disciplines. Our study of journals publishing influential social intervention research will provide a comprehensive account of whether these journals have policies, procedures, and practices that are consistent with standards for open science and thereby facilitate the publication of trustworthy findings to inform evidence-based policy. Through this demonstration, we expect to identify ways to refine the TOP Guidelines and the TOP Factor. Refinements could include: improving templates for adoption in journal instructions to authors, manuscript submission systems, and published articles; revising explanatory guidance intended to enhance the use, understanding, and dissemination of the TOP Guidelines; and clarifying the distinctions among different levels of implementation. Research materials are available on the Open Science Framework: https://osf.io/txyr3/ .

SUBMITTER: Mayo-Wilson E

PROVIDER: S-EPMC8173977 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BACKGROUND:In the context of exchange technologies, such as health information exchange (HIE), existing technology acceptance theories should be expanded to consider not only the cognitive beliefs resulting in adoption behavior but also the affect provoked by the sharing nature of the technology. OBJECTIVE:We aimed to study HIE adoption using a trust-centered model. Based on the Theory of Reasoned Action, the technology adoption literature, and the trust transfer mechanism, we theoretically explained and empirically tested the impacts of the perceived transparency of privacy policy and trust in health care providers on cognitive and emotional trust in an HIE. Moreover, we analyzed the effects of cognitive and emotional trust on the intention to opt in to the HIE and willingness to disclose health information. METHODS:A Web-based survey was conducted using data from a sample of 493 individuals who were aware of the HIE through experiences with a (or multiple) provider(s) participating in an HIE network. RESULTS:Structural Equation Modeling analysis results provided empirical support for the proposed model. Our findings indicated that when patients trust in health care providers, and they are aware of HIE security measures, HIE sharing procedures, and privacy terms, they feel more in control, more assured, and less at risk. Moreover, trust in providers has a significant moderating effect on building trust in HIE efforts (P<.05). Results also showed that patient trust in HIE may take the forms of opt-in intentions to HIE and patients' willingness to disclose health information that are exchanged through the HIE (P<.001). CONCLUSIONS:The results of this research should be of interest to both academics and practitioners. The findings provide an in-depth dimension of the HIE privacy policy that should be addressed by the health care organizations to exchange personal health information in a secure and private manner. This study can contribute to trust transfer theory and enrich the literature on HIE efforts. Primary and secondary care providers can also identify how to leverage the benefit of patients' trust and trust transfer process to promote HIE initiatives nationwide.

Project description:INTRODUCTION:There has been a growing awareness of the need for rigorously and transparent reported health research, to ensure the reproducibility of studies by future researchers. Health economic evaluations, the comparative analysis of alternative interventions in terms of their costs and consequences, have been promoted as an important tool to inform decision-making. The objective of this study will be to investigate the extent to which articles of economic evaluations of healthcare interventions indexed in MEDLINE incorporate research practices that promote transparency, openness and reproducibility. METHODS AND ANALYSIS:This is the study protocol for a cross-sectional comparative analysis. We registered the study protocol within the Open Science Framework (osf.io/gzaxr). We will evaluate a random sample of 600 cost-effectiveness analysis publications, a specific form of health economic evaluations, indexed in MEDLINE during 2012 (n=200), 2019 (n=200) and 2022 (n=200). We will include published papers written in English reporting an incremental cost-effectiveness ratio in terms of costs per life years gained, quality-adjusted life years and/or disability-adjusted life years. Screening and selection of articles will be conducted by at least two researchers. Reproducible research practices, openness and transparency in each article will be extracted using a standardised data extraction form by multiple researchers, with a 33% random sample (n=200) extracted in duplicate. Information on general, methodological and reproducibility items will be reported, stratified by year, citation of the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement and journal. Risk ratios with 95% CIs will be calculated to represent changes in reporting between 2012-2019 and 2019-2022. ETHICS AND DISSEMINATION:Due to the nature of the proposed study, no ethical approval will be required. All data will be deposited in a cross-disciplinary public repository. It is anticipated the study findings could be relevant to a variety of audiences. Study findings will be disseminated at scientific conferences and published in peer-reviewed journals.