Dataset Information

Why we habitually engage in null-hypothesis significance testing: A qualitative study

ABSTRACT:

Background

Null Hypothesis Significance Testing (NHST) is the most familiar statistical procedure for making inferences about population effects. Important problems associated with this method have been addressed and various alternatives that overcome these problems have been developed. Despite its many well-documented drawbacks, NHST remains the prevailing method for drawing conclusions from data. Reasons for this have been insufficiently investigated. Therefore, the aim of our study was to explore the perceived barriers and facilitators related to the use of NHST and alternative statistical procedures among relevant stakeholders in the scientific system.

Methods

Individual semi-structured interviews and focus groups were conducted with junior and senior researchers, lecturers in statistics, editors of scientific journals and program leaders of funding agencies. During the focus groups, important themes that emerged from the interviews were discussed. Data analysis was performed using the constant comparison method, allowing emerging (sub)themes to be fully explored. A theory substantiating the prevailing use of NHST was developed based on the main themes and subthemes we identified.

Results

Twenty-nine interviews and six focus groups were conducted. Several interrelated facilitators and barriers associated with the use of NHST and alternative statistical procedures were identified. These factors were subsumed under three main themes: the scientific climate, scientific duty, and reactivity. As a result of the factors, most participants feel dependent in their actions upon others, have become reactive, and await action and initiatives from others. This may explain why NHST is still the standard and ubiquitously used by almost everyone involved.

Conclusion

Our findings demonstrate how perceived barriers to shift away from NHST set a high threshold for actual behavioral change and create a circle of interdependency between stakeholders. By taking small steps it should be possible to decrease the scientific community’s strong dependence on NHST and p-values.

SUBMITTER: Stunt J

PROVIDER: S-EPMC8519469 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ObjectiveTo assess factors related to use and non-use of a sophisticated interactive preventive health record (IPHR) designed to promote uptake of 18 recommended clinical preventive services; little is known about how patients want to use or be engaged by such advanced information tools.DesignDescriptive and interpretive qualitative analysis of transcripts and field notes from focus groups of the IPHR users and of patients who were invited but did not use the IPHR (non-users). Grounded theory techniques were then applied via an editing approach for key emergent themes.SettingPrimary care patients in eight practices of the Virginia Ambulatory Care Outcomes Research Network (ACORN).ParticipantsThree focus groups involved a total of 14 IPHR users and two groups of non-users totalled 14 participants.Outcomes/resultsFor themes identified (relevance, trust and functionality) participants indicated that endorsement and use of the IPHR by their personal clinician was vital. In particular, participants' comments linked the IPHR use to: (1) integrating the IPHR into current care, (2) promoting effective patient-clinician encounters and communication and (3) their confidence in the accuracy, security and privacy of the information.ConclusionsIn addition to patients' stated desires for advanced functionality and information accuracy and privacy, successful adoption of the IPHRs by primary care patients depends on such technology's relevance, and on its promotion via integration with primary care practices' processes and the patient-clinician relationship. Accordingly, models of technological success and adoption, when applied to primary care, may need to include the patient-clinician relationship and practice workflow. These findings are important for healthcare providers, the information technology industry and policymakers who share an interest in encouraging patients to use personal health records.Trial registrationClinicaltrials.gov identifier: NCT00589173.