Dataset Information

A descriptive analysis of the data availability statements accompanying medRxiv preprints and a comparison with their published counterparts.

ABSTRACT:

Objective

To determine whether medRxiv data availability statements describe open or closed data-that is, whether the data used in the study is openly available without restriction-and to examine if this changes on publication based on journal data-sharing policy. Additionally, to examine whether data availability statements are sufficient to capture code availability declarations.

Design

Observational study, following a pre-registered protocol, of preprints posted on the medRxiv repository between 25th June 2019 and 1st May 2020 and their published counterparts.

Main outcome measures

Distribution of preprinted data availability statements across nine categories, determined by a prespecified classification system. Change in the percentage of data availability statements describing open data between the preprinted and published versions of the same record, stratified by journal sharing policy. Number of code availability declarations reported in the full-text preprint which were not captured in the corresponding data availability statement.

Results

3938 medRxiv preprints with an applicable data availability statement were included in our sample, of which 911 (23.1%) were categorized as describing open data. 379 (9.6%) preprints were subsequently published, and of these published articles, only 155 contained an applicable data availability statement. Similar to the preprint stage, a minority (59 (38.1%)) of these published data availability statements described open data. Of the 151 records eligible for the comparison between preprinted and published stages, 57 (37.7%) were published in journals which mandated open data sharing. Data availability statements more frequently described open data on publication when the journal mandated data sharing (open at preprint: 33.3%, open at publication: 61.4%) compared to when the journal did not mandate data sharing (open at preprint: 20.2%, open at publication: 22.3%).

Conclusion

Requiring that authors submit a data availability statement is a good first step, but is insufficient to ensure data availability. Strict editorial policies that mandate data sharing (where appropriate) as a condition of publication appear to be effective in making research data available. We would strongly encourage all journal editors to examine whether their data availability policies are sufficiently stringent and consistently enforced.

SUBMITTER: McGuinness LA

PROVIDER: S-EPMC8118451 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BACKGROUND:Consumers, clinicians, policymakers and researchers require high quality evidence to guide decision-making in child health. Though Cochrane systematic reviews (SRs) are a well-established source of evidence, little is known about the characteristics of non-Cochrane child-relevant SRs. To complement published descriptions of Cochrane SRs, we aimed to characterize the epidemiologic, methodological, and reporting qualities of non-Cochrane child-relevant SRs published in 2014. METHODS:English-language child-relevant SRs of quantitative primary research published outside the Cochrane Library in 2014 were eligible for this descriptive analysis. A research librarian searched MEDLINE, CINAHL, Web of Science, and PubMed in August 2015. A single reviewer screened articles for inclusion; a second verified the excluded studies. Reviewers extracted: general characteristics of the review; included study characteristics; methodological approaches. We performed univariate analyses and presented the findings narratively. RESULTS:We identified 1598 child-relevant SRs containing a median (IQR) 19 (11, 33) studies. These originated primarily from high-income countries (n?=?1247, 78.0%) and spanned 47 of the 53 Cochrane Review Groups. Most synthesized therapeutic (n?=?753, 47.1%) or epidemiologic (n?=?701, 43.8%) evidence. Though 39.3% (n?=?628) of SRs included evidence related to children only, few were published in pediatric-specific journals (n?=?283, 17.7%). Reporting quality seemed poor based on the items we assessed; few reviews mentioned an a-priori protocol (n?=?246, 15.4%) or registration (n?=?111, 6.9%), and only 23.4% (n?=?374) specified a primary outcome. Many SRs relied solely on evidence from non-RCTs (n?=?796, 49.8%). Less than two-thirds (n?=?953, 59.6%) appraised the quality of included studies and assessments of the certainty of the body of evidence were rare (n?=?102, 6.4%). CONCLUSIONS:Child-relevant Cochrane SRs are a known source of high quality evidence in pediatrics. There exists, however, an abundance of evidence from non-Cochrane SRs that may be complementary. Our findings show that high-quality non-Cochrane SRs may not be practical nor easy for knowledge users to find. Improvements are needed to ensure that evidence syntheses published outside of the Cochrane Library adhere to the high standard of conduct and reporting characteristic of Cochrane SRs.

Project description:BackgroundOverviews of systematic reviews compile data from multiple systematic reviews (SRs) and are a new method of evidence synthesis.ObjectivesTo describe the methodological approaches in overviews of interventions.DesignDescriptive study.MethodsWe searched 4 databases from 2000 to July 2011; we handsearched Evidence-based Child Health: A Cochrane Review Journal. We defined an overview as a study that: stated a clear objective; examined an intervention; used explicit methods to identify SRs; collected and synthesized outcome data from the SRs; and intended to include only SRs. We did not restrict inclusion by population characteristics (e.g., adult or children only). Two researchers independently screened studies and applied eligibility criteria. One researcher extracted data with verification by a second. We conducted a descriptive analysis.ResultsFrom 2,245 citations, 75 overviews were included. The number of overviews increased from 1 in 2000 to 14 in 2010. The interventions were pharmacological (n?=?20, 26.7%), non-pharmacological (n?=?26, 34.7%), or both (n?=?29, 38.7%). Inclusion criteria were clearly stated in 65 overviews. Thirty-three (44%) overviews searched at least 2 databases. The majority reported the years and databases searched (n?=?46, 61%), and provided key words (n?=?58, 77%). Thirty-nine (52%) overviews included Cochrane SRs only. Two reviewers independently screened and completed full text review in 29 overviews (39%). Methods of data extraction were reported in 45 (60%). Information on quality of individual studies was extracted from the original SRs in 27 (36%) overviews. Quality assessment of the SRs was performed in 28 (37%) overviews; at least 9 different tools were used. Quality of the body of evidence was assessed in 13 (17%) overviews. Most overviews provided a narrative or descriptive analysis of the included SRs. One overview conducted indirect analyses and the other conducted mixed treatment comparisons. Publication bias was discussed in 18 (24%) overviews.ConclusionsThis study shows considerable variation in the methods used for overviews. There is a need for methodological rigor and consistency in overviews, as well as empirical evidence to support the methods employed.

Project description:OBJECTIVES: To identify all systematic reviews (SRs) published in the domain of oral health research and describe them in terms of their epidemiological and descriptive characteristics. DESIGN: Cross sectional, descriptive study. METHODS: An electronic search of seven databases was performed from inception through May 2012; bibliographies of relevant publications were also reviewed. Studies were considered for inclusion if they were oral health SRs defined as therapeutic or non-therapeutic investigations that studied a topic or an intervention related to dental, oral or craniofacial diseases/disorders. Data were extracted from all the SRs based on a number of epidemiological and descriptive characteristics. Data were analysed descriptively for all the SRs, within each of the nine dental specialities, and for Cochrane and non-Cochrane SRs separately. RESULTS: 1,188 oral health (126 Cochrane and 1062 non-Cochrane) SRs published from 1991 through May 2012 were identified, encompassing the nine dental specialties. Over half (n?=?676; 56.9%) of the SRs were published in specialty oral health journals, with almost all (n?=?1,178; 99.2%) of the SRs published in English and almost none of the non-Cochrane SRs (n?=?11; 0.9%) consisting of updates of previously published SRs. 75.3% of the SRs were categorized as therapeutic, with 64.5% examining non-drug interventions, while approximately half (n?=?150/294; 51%) of the non-therapeutic SRs were classified as epidemiological SRs. The SRs included a median of 15 studies, with a meta-analysis conducted in 43.6%, in which a median of 9 studies/1 randomized trial were included in the largest meta-analysis conducted. Funding was received for 25.1% of the SRs, including nearly three-quarters (n?=?96; 76.2%) of the Cochrane SRs. CONCLUSION: Epidemiological and descriptive characteristics of the 1,188 oral health SRs varied across the nine dental specialties and by SR category (Cochrane vs. non-Cochrane). There is a clear need for more updates of SRs in all the dental specialties.

Project description:BackgroundThree major US tobacco companies were recently ordered to publish corrective statements intended to prevent and restrain further fraud about the health effects of smoking. The court-ordered statements began appearing in newspapers and on television (TV) in late 2017.ObjectiveThe objective of this study was to examine the social media dissemination of the tobacco corrective statements during the first 6 months of the implementation of the statements.MethodsWe conducted a descriptive content analysis of Twitter posts using an iterative search strategy through Crimson Hexagon and randomly selected 19.74% (456/2309) of original posts occurring between November 1, 2017, and March 27, 2018, for coding and analysis. We assessed post volume over time, source or author, valence, linked content, and reference to the industry (eg, big tobacco, tobacco industry, and Philip Morris) and media outlet (TV or newspaper). Retweeted content was coded for source/author and prevalence.ResultsMost posts were published in November 2017, surrounding the initial release of the corrective statements. Content was generally neutral (58.7%, 268/456) or positive (33.3%, 152/456) in valence, included links to additional information about the statements (94.9%, 433/456), referred to the industry (87.7%, 400/456), and did not mention a specific media channel on which the statements were aired or published (15%). The majority of original posts were created by individual users (55.2%, 252/456), whereas the majority of retweeted posts were posted by public health organizations (51%). Differences by source are reported, for example, organization posts are more likely to include a link to additional information compared with individual users (P=.03).ConclusionsConversations about the court-ordered corrective statements are taking place on Twitter and are generally neutral or positive in nature. Public health organizations may be increasing the prevalence of these conversations through social media engagement.