Dataset Information

Reproducibility in Cognitive Hearing Research: Theoretical Considerations and Their Practical Application in Multi-Lab Studies.

ABSTRACT: In this article, we consider the issue of reproducibility within the field of cognitive hearing science. First, we examine how retest reliability can provide useful information for the generality of results and intervention effectiveness. Second, we provide an overview of retest reliability coefficients within three areas of cognitive hearing science (cognition, speech perception, and self-reported measures of communication) and show how the reporting of these coefficients differs between fields. We argue that practices surrounding the provision of retest coefficients are currently most rigorous in clinical assessment and that basic science research would benefit from adopting similar standards. Finally, based on a distinction between direct replications (which aim to keep materials as close to the original study as possible) and conceptual replications (which test the same purported mechanism using different materials), we discuss new initiatives which address the need for both. Using the example of the auditory Stroop task, we provide practical illustrations of how these theoretical issues can be addressed within the context of a multi-lab replication study. By illustrating how theoretical concepts can be put into practice in empirical research, we hope to encourage others to set up and participate in a wide variety of reproducibility-related studies.

SUBMITTER: Heinrich A

PROVIDER: S-EPMC7378399 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Reproducibility in Cognitive Hearing Research: Theoretical Considerations and Their Practical Application in Multi-Lab Studies.

Heinrich Antje A Knight Sarah S

Frontiers in psychology 20200716

In this article, we consider the issue of reproducibility within the field of cognitive hearing science. First, we examine how retest reliability can provide useful information for the generality of results and intervention effectiveness. Second, we provide an overview of retest reliability coefficients within three areas of cognitive hearing science (cognition, speech perception, and self-reported measures of communication) and show how the reporting of these coefficients differs between fields ...[more]

PMID: 32765364

Similar Datasets

Project description:BACKGROUND: HIV vaccine development must address the genetic diversity and plasticity of the virus that permits the presentation of diverse genetic forms to the immune system and subsequent escape from immune pressure. Assessment of potential HIV strain coverage by candidate T cell-based vaccines (whether natural sequence or computationally optimized products) is now a critical component in interpreting candidate vaccine suitability. METHODS: We have utilized an N-mer identity algorithm to represent T cell epitopes and explore potential coverage of the global HIV pandemic using natural sequences derived from candidate HIV vaccines. Breadth (the number of T cell epitopes generated) and depth (the variant coverage within a T cell epitope) analyses have been incorporated into the model to explore vaccine coverage requirements in terms of the number of discrete T cell epitopes generated. RESULTS: We show that when multiple epitope generation by a vaccine product is considered a far more nuanced appraisal of the potential HIV strain coverage of the vaccine product emerges. By considering epitope breadth and depth several important observations were made: (1) epitope breadth requirements to reach particular levels of vaccine coverage, even for natural sequence-based vaccine products is not necessarily an intractable problem for the immune system; (2) increasing the valency (number of T cell epitope variants present) of vaccine products dramatically decreases the epitope requirements to reach particular coverage levels for any epidemic; (3) considering multiple-hit models (more than one exact epitope match with an incoming HIV strain) places a significantly higher requirement upon epitope breadth in order to reach a given level of coverage, to the point where low valency natural sequence based products would not practically be able to generate sufficient epitopes. CONCLUSIONS: When HIV vaccine sequences are compared against datasets of potential incoming viruses important metrics such as the minimum epitope count required to reach a desired level of coverage can be easily calculated. We propose that such analyses can be applied early in the planning stages and during the execution phase of a vaccine trial to explore theoretical and empirical suitability of a vaccine product to a particular epidemic setting.

Dataset Information

Reproducibility in Cognitive Hearing Research: Theoretical Considerations and Their Practical Application in Multi-Lab Studies.

Publications

Reproducibility in Cognitive Hearing Research: Theoretical Considerations and Their Practical Application in Multi-Lab Studies.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets