Dataset Information

Why we habitually engage in null-hypothesis significance testing: A qualitative study

ABSTRACT:

Background

Null Hypothesis Significance Testing (NHST) is the most familiar statistical procedure for making inferences about population effects. Important problems associated with this method have been addressed and various alternatives that overcome these problems have been developed. Despite its many well-documented drawbacks, NHST remains the prevailing method for drawing conclusions from data. Reasons for this have been insufficiently investigated. Therefore, the aim of our study was to explore the perceived barriers and facilitators related to the use of NHST and alternative statistical procedures among relevant stakeholders in the scientific system.

Methods

Individual semi-structured interviews and focus groups were conducted with junior and senior researchers, lecturers in statistics, editors of scientific journals and program leaders of funding agencies. During the focus groups, important themes that emerged from the interviews were discussed. Data analysis was performed using the constant comparison method, allowing emerging (sub)themes to be fully explored. A theory substantiating the prevailing use of NHST was developed based on the main themes and subthemes we identified.

Results

Twenty-nine interviews and six focus groups were conducted. Several interrelated facilitators and barriers associated with the use of NHST and alternative statistical procedures were identified. These factors were subsumed under three main themes: the scientific climate, scientific duty, and reactivity. As a result of the factors, most participants feel dependent in their actions upon others, have become reactive, and await action and initiatives from others. This may explain why NHST is still the standard and ubiquitously used by almost everyone involved.

Conclusion

Our findings demonstrate how perceived barriers to shift away from NHST set a high threshold for actual behavioral change and create a circle of interdependency between stakeholders. By taking small steps it should be possible to decrease the scientific community’s strong dependence on NHST and p-values.

SUBMITTER: Stunt J

PROVIDER: S-EPMC8519469 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ObjectiveTo assess factors related to use and non-use of a sophisticated interactive preventive health record (IPHR) designed to promote uptake of 18 recommended clinical preventive services; little is known about how patients want to use or be engaged by such advanced information tools.DesignDescriptive and interpretive qualitative analysis of transcripts and field notes from focus groups of the IPHR users and of patients who were invited but did not use the IPHR (non-users). Grounded theory techniques were then applied via an editing approach for key emergent themes.SettingPrimary care patients in eight practices of the Virginia Ambulatory Care Outcomes Research Network (ACORN).ParticipantsThree focus groups involved a total of 14 IPHR users and two groups of non-users totalled 14 participants.Outcomes/resultsFor themes identified (relevance, trust and functionality) participants indicated that endorsement and use of the IPHR by their personal clinician was vital. In particular, participants' comments linked the IPHR use to: (1) integrating the IPHR into current care, (2) promoting effective patient-clinician encounters and communication and (3) their confidence in the accuracy, security and privacy of the information.ConclusionsIn addition to patients' stated desires for advanced functionality and information accuracy and privacy, successful adoption of the IPHRs by primary care patients depends on such technology's relevance, and on its promotion via integration with primary care practices' processes and the patient-clinician relationship. Accordingly, models of technological success and adoption, when applied to primary care, may need to include the patient-clinician relationship and practice workflow. These findings are important for healthcare providers, the information technology industry and policymakers who share an interest in encouraging patients to use personal health records.Trial registrationClinicaltrials.gov identifier: NCT00589173.

Project description:Background Pre-exposure prophylaxis (PrEP) is highly effective for HIV prevention, but uptake remains low, especially among adolescent girls and young women (AGYW) in Kenya. A model in which trained AGYW using PrEP deliver HIV self-tests to their close friends and refer them to PrEP may help increase PrEP uptake in this population. To understand AGYW's potential willingness to engage in such a model, we conducted a qualitative formative study in Kenya. Method We conducted semi-structured in-depth interviews (IDIs) with AGYW (16 to 24 years) in Kiambu County who were determined at risk of HIV acquisition. We purposively recruited “PrEP-naïve” (no prior PrEP use) and “PrEP-experienced” AGYW who used PrEP for at least 1 month within the previous year. We solicited perspectives on initiating/engaging in conversations about HIV risk and PrEP, distributing/receiving HIV self-test kits, and referring/following through on a referral to clinic-based HIV services. We analyzed verbatim transcripts using rapid qualitative analysis and a combination of inductive and deductive approaches, with the latter informed by the Integrated Behavior Model (IBM). Results From August to December 2020, we conducted 30 IDIs: 15 with PrEP-experienced and 15 with PrEP-naïve AGYW. Participants' median age was 20 [interquartile range (IQR): 20–22]. Overall, most participants anticipated that they would be willing to engage in this model. PrEP-experienced AGYW emphasized the salience of their concerns about friends' HIV risk behaviors, with several noting that they are already in the habit of discussing PrEP with friends. Many additionally expressed positive attitudes toward the proposed target behaviors, perceived these to be normative among AGYW, and expressed confidence in their ability to carry out the behaviors with proper support. Although few participants had HIVST experience, nearly all anticipated they would be able to use an HIV self-test kit correctly if provided instruction. Conclusion The Kenyan AGYW who participated in this study generally anticipated that they would be willing to engage in a formal peer PrEP referral model enhanced with peer-delivered HIV self-tests. Future research is needed to pilot test this model to determine its acceptability, feasibility, and effect on HIVST and PrEP uptake within this population.