Unknown

Dataset Information

0

We need to talk about reliability: making better use of test-retest studies for study design and interpretation.


ABSTRACT: Neuroimaging, in addition to many other fields of clinical research, is both time-consuming and expensive, and recruitable patients can be scarce. These constraints limit the possibility of large-sample experimental designs, and often lead to statistically underpowered studies. This problem is exacerbated by the use of outcome measures whose accuracy is sometimes insufficient to answer the scientific questions posed. Reliability is usually assessed in validation studies using healthy participants, however these results are often not easily applicable to clinical studies examining different populations. I present a new method and tools for using summary statistics from previously published test-retest studies to approximate the reliability of outcomes in new samples. In this way, the feasibility of a new study can be assessed during planning stages, and before collecting any new data. An R package called relfeas also accompanies this article for performing these calculations. In summary, these methods and tools will allow researchers to avoid performing costly studies which are, by virtue of their design, unlikely to yield informative conclusions.

SUBMITTER: Matheson GJ 

PROVIDER: S-EPMC6536112 | biostudies-other | 2019

REPOSITORIES: biostudies-other

altmetric image

Publications

We need to talk about reliability: making better use of test-retest studies for study design and interpretation.

Matheson Granville J GJ  

PeerJ 20190524


Neuroimaging, in addition to many other fields of clinical research, is both time-consuming and expensive, and recruitable patients can be scarce. These constraints limit the possibility of large-sample experimental designs, and often lead to statistically underpowered studies. This problem is exacerbated by the use of outcome measures whose accuracy is sometimes insufficient to answer the scientific questions posed. Reliability is usually assessed in validation studies using healthy participant  ...[more]

Similar Datasets

| S-EPMC7846028 | biostudies-literature
| S-EPMC3376244 | biostudies-literature
| S-EPMC5889766 | biostudies-literature
| S-EPMC8090786 | biostudies-literature
| S-EPMC2078147 | biostudies-literature
| S-EPMC4788471 | biostudies-other
| S-EPMC6118382 | biostudies-literature
| S-EPMC4547115 | biostudies-literature
| S-EPMC5568997 | biostudies-literature
| S-EPMC3827856 | biostudies-literature