Dataset Information

The REPRISE project: protocol for an evaluation of REProducibility and Replicability In Syntheses of Evidence.

ABSTRACT:

Background

Investigations of transparency, reproducibility and replicability in science have been directed largely at individual studies. It is just as critical to explore these issues in syntheses of studies, such as systematic reviews, given their influence on decision-making and future research. We aim to explore various aspects relating to the transparency, reproducibility and replicability of several components of systematic reviews with meta-analysis of the effects of health, social, behavioural and educational interventions.

Methods

The REPRISE (REProducibility and Replicability In Syntheses of Evidence) project consists of four studies. We will evaluate the completeness of reporting and sharing of review data, analytic code and other materials in a random sample of 300 systematic reviews of interventions published in 2020 (Study 1). We will survey authors of systematic reviews to explore their views on sharing review data, analytic code and other materials and their understanding of and opinions about replication of systematic reviews (Study 2). We will then evaluate the extent of variation in results when we (a) independently reproduce meta-analyses using the same computational steps and analytic code (if available) as used in the original review (Study 3), and (b) crowdsource teams of systematic reviewers to independently replicate a subset of methods (searches for studies, selection of studies for inclusion, collection of outcome data, and synthesis of results) in a sample of the original reviews; 30 reviews will be replicated by 1 team each and 2 reviews will be replicated by 15 teams (Study 4).

Discussion

The REPRISE project takes a systematic approach to determine how reliable systematic reviews of interventions are. We anticipate that results of the REPRISE project will inform strategies to improve the conduct and reporting of future systematic reviews.

SUBMITTER: Page MJ

PROVIDER: S-EPMC8052676 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThe onset of puberty and menarche is a specifically vulnerable time for girls, during which they begin to show interest in the opposite sex, while becoming exposed to a myriad of external pressures, including sexual coercion or harassment from boys and men, expectations to marry from their families, and the need to perform well in primary school in order to qualify for secondary school. According to several qualitative studies in Africa, such pressures are exacerbated by girls' lack of knowledge of their bodies, their rights, and the implications of their decisions, and by their inability to manage puberty and adolescence safely and comfortably with appropriate menstrual health and hygiene management (MHM) products. The evaluation of the Nia Project is one of the first to analyze the individual and combined contributions of sanitary pads and provision of comprehensive reproductive health education on girls' education and reproductive health outcomes.MethodsThe design for the evaluation of the Nia Project is a longitudinal, cluster-randomized controlled trial consisting of a baseline survey with a cohort of Class 7 girls, a school quality survey, qualitative data collection, school attendance tracking, and an endline survey at the completion of the 18-month intervention period with the same cohort. The study involves 140 public primary schools in three rural sub-counties (Magarini, Kaloleni and Ganze) of Kilifi County in the Coastal area of Kenya. The research sample includes 3489 girls, with about 25 girls per school on average. Before program implementation, the schools were stratified by sub-county and randomized to one of four study arms (35 schools per arm): 1) control, 2) disposable sanitary pads distribution, 2) reproductive health education, and 4) sanitary pad distribution and reproductive health education.DiscussionThe evidence provided will inform program investment and design, and contribute to the literature on the effect of menstrual health-based interventions on girls' agency, safety and life outcomes.Trial registrationISRCTN10894523 . Trial Registration Date: August 22, 2017.