Dataset Information

Planned missing data in early literacy interventions: A replication study with an additional gold standard.

ABSTRACT:

Introduction

In a digital early literacy intervention RCT, children born late preterm fell behind peers when in a control condition, but outperformed them when assigned to the intervention. Results did however not replicate previous findings. Replication is often complicated by resource quality. Gold Standard measures are generally time-intensive and costly, while they closely align with, and are more sensitive to changes in, early literacy and language performance. A planned missing data approach, leaving these gold standard measures incomplete, might aid in addressing the origin(s) of non-replication.

Methods

Participants after consent were 695 p Dutch primary school pupils of normal and late preterm birth. The high-quality measures, in additional to simpler but complete measures, were intentionally administered to a random subsample of children. Five definitions of gold standard alignment were evaluated.

Results

Two out of five gold standard levels improved precision compared to the original results. The lowest gold standard level did not lead to improvement: precision was actually diminished. In two gold standard definitions, an alphabetical factor and a writing-only factor the model estimates were comparable to the original results. Only the most precise definition of the gold standard level replicated the original results.

Conclusion

Gold standard measures could only be used to improve model efficiency in RCT-designs under sufficiently high convergent validity.

SUBMITTER: Rippe RCA

PROVIDER: S-EPMC8007029 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:OBJECTIVES:To present the primary outcomes from a baseline study on attitudes towards female genital cutting (FGC) after migration. DESIGN:Baseline data from a planned cluster randomised, controlled trial. Face-to-face interviews were used to collect questionnaire data in 2015. Based on our hypothesis that established Somalis could be used as facilitators of change among those newly arrived, data were stratified into years of residency in Sweden. SETTING:Sweden. PARTICIPANTS:372 Somali men and women, 206 newly arrived (0-4 years), 166 established (>4 years). PRIMARY OUTCOME MEASURES:Whether FGC is acceptable, preferred for daughter and should continue, specified on anatomical extent. RESULTS:The support for anatomical change of girls and women's genitals ranged from 0% to 2% among established and from 4% to 8% among newly arrived. Among those supporting no anatomical change, 75%-83% among established and 53%-67% among newly arrived opposed all forms of FGC, with the remaining supporting pricking of the skin with no removal of tissue. Among newly arrived, 37% stated that pricking was acceptable, 39% said they wanted their daughter to be pricked and 26% reported they wanted pricking to continue being practised. Those who had lived in Sweden ? 2?years had highest odds of supporting FGC; thereafter, the opposition towards FGC increased over time after migration. CONCLUSION:A majority of Somali immigrants, including those newly arrived, opposed all forms of FGC with increased opposition over time after migration. The majority of proponents of FGC supported pricking. We argue that it would have been unethical to proceed with the intervention as it, with this baseline, would have been difficult to detect a change in attitudes given that a majority opposed all forms of FGC together with the evidence that a strong attitude change is already happening. Therefore, we decided not to implement the planned intervention. TRIAL REGISTRATION NUMBER:Trial registration number NCT02335697;Pre-results.

Project description:Ecological and evolutionary research questions are increasingly requiring the integration of research fields along with larger data sets to address fundamental local- and global-scale problems. Unfortunately, these agendas are often in conflict with limited funding and a need to balance animal welfare concerns. Planned missing data design (PMDD), where data are randomly and deliberately missed during data collection, combined with missing data procedures, can be useful tools when working under greater research constraints. Here, we review how PMDD can be incorporated into existing experimental designs by discussing alternative design approaches and demonstrate with simulated data sets how missing data procedures work with incomplete data. PMDDs can provide researchers with a unique toolkit that can be applied during the experimental design stage. Planning and thinking about missing data early can (1) reduce research costs by allowing for the collection of less expensive measurement variables; (2) provide opportunities to distinguish predictions from alternative hypotheses by allowing more measurement variables to be collected; and (3) minimize distress caused by experimentation by reducing the reliance on invasive procedures or allowing data to be collected on fewer subjects (or less often on a given subject). PMDDs and missing data methods can even provide statistical benefits under certain situations by improving statistical power relative to a complete case design. The impacts of unplanned missing data, which can cause biases in parameter estimates and their uncertainty, can also be ameliorated using missing data procedures. PMDDs are still in their infancy. We discuss some of the difficulties in their implementation and provide tentative solutions. While PMDDs may not always be the best option, missing data procedures are becoming more sophisticated and more easily implemented and it is likely that PMDDs will be effective tools for a wide range of experimental designs, data types and problems in ecology and evolution.