Unknown

Dataset Information

0

Assessing data availability and research reproducibility in hydrology and water resources.


ABSTRACT: There is broad interest to improve the reproducibility of published research. We developed a survey tool to assess the availability of digital research artifacts published alongside peer-reviewed journal articles (e.g. data, models, code, directions for use) and reproducibility of article results. We used the tool to assess 360 of the 1,989 articles published by six hydrology and water resources journals in 2017. Like studies from other fields, we reproduced results for only a small fraction of articles (1.6% of tested articles) using their available artifacts. We estimated, with 95% confidence, that results might be reproduced for only 0.6% to 6.8% of all 1,989 articles. Unlike prior studies, the survey tool identified key bottlenecks to making work more reproducible. Bottlenecks include: only some digital artifacts available (44% of articles), no directions (89%), or all artifacts available but results not reproducible (5%). The tool (or extensions) can help authors, journals, funders, and institutions to self-assess manuscripts, provide feedback to improve reproducibility, and recognize and reward reproducible articles as examples for others.

SUBMITTER: Stagge JH 

PROVIDER: S-EPMC6390703 | biostudies-literature | 2019 Feb

REPOSITORIES: biostudies-literature

altmetric image

Publications

Assessing data availability and research reproducibility in hydrology and water resources.

Stagge James H JH   Rosenberg David E DE   Abdallah Adel M AM   Akbar Hadia H   Attallah Nour A NA   James Ryan R  

Scientific data 20190226


There is broad interest to improve the reproducibility of published research. We developed a survey tool to assess the availability of digital research artifacts published alongside peer-reviewed journal articles (e.g. data, models, code, directions for use) and reproducibility of article results. We used the tool to assess 360 of the 1,989 articles published by six hydrology and water resources journals in 2017. Like studies from other fields, we reproduced results for only a small fraction of  ...[more]

Similar Datasets

2006-12-06 | GSE6412 | GEO
| S-EPMC3771067 | biostudies-literature
| S-EPMC8041889 | biostudies-literature
| S-EPMC3165456 | biostudies-other
| PRJNA99653 | ENA
| S-EPMC2695495 | biostudies-literature
| S-EPMC9039958 | biostudies-literature
| S-EPMC4757565 | biostudies-literature
| S-EPMC3168487 | biostudies-literature
| S-EPMC5608904 | biostudies-other