Dataset Information

Perceived Statistical Knowledge Level and Self-Reported Statistical Practice Among Academic Psychologists.

ABSTRACT: Introduction: Publications arguing against the null hypothesis significance testing (NHST) procedure and in favor of good statistical practices have increased. The most frequently mentioned alternatives to NHST are effect size statistics (ES), confidence intervals (CIs), and meta-analyses. A recent survey conducted in Spain found that academic psychologists have poor knowledge about effect size statistics, confidence intervals, and graphic displays for meta-analyses, which might lead to a misinterpretation of the results. In addition, it also found that, although the use of ES is becoming generalized, the same thing is not true for CIs. Finally, academics with greater knowledge about ES statistics presented a profile closer to good statistical practice and research design. Our main purpose was to analyze the extension of these results to a different geographical area through a replication study. Methods: For this purpose, we elaborated an on-line survey that included the same items as the original research, and we asked academic psychologists to indicate their level of knowledge about ES, their CIs, and meta-analyses, and how they use them. The sample consisted of 159 Italian academic psychologists (54.09% women, mean age of 47.65 years). The mean number of years in the position of professor was 12.90 (SD = 10.21). Results: As in the original research, the results showed that, although the use of effect size estimates is becoming generalized, an under-reporting of CIs for ES persists. The most frequent ES statistics mentioned were Cohen's d and R2/?2, which can have outliers or show non-normality or violate statistical assumptions. In addition, academics showed poor knowledge about meta-analytic displays (e.g., forest plot and funnel plot) and quality checklists for studies. Finally, academics with higher-level knowledge about ES statistics seem to have a profile closer to good statistical practices. Conclusions: Changing statistical practice is not easy.This change requires statistical training programs for academics, both graduate and undergraduate.

SUBMITTER: Badenes-Ribera L

PROVIDER: S-EPMC6024681 | biostudies-literature | 2018

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Perceived Statistical Knowledge Level and Self-Reported Statistical Practice Among Academic Psychologists.

Badenes-Ribera Laura L Frias-Navarro Dolores D Iotti Nathalie O NO Bonilla-Campos Amparo A Longobardi Claudio C

Frontiers in psychology 20180622

<b>Introduction:</b> Publications arguing against the null hypothesis significance testing (NHST) procedure and in favor of good statistical practices have increased. The most frequently mentioned alternatives to NHST are effect size statistics (ES), confidence intervals (CIs), and meta-analyses. A recent survey conducted in Spain found that academic psychologists have poor knowledge about effect size statistics, confidence intervals, and graphic displays for meta-analyses, which might lead to a ...[more]

PMID: 29988476

Similar Datasets

Project description:Background Lumbar puncture (LP) remains an essential diagnostic procedure for neurological and infectious diseases. However, it remains a source of anxiety to patients and families. This research aimed to assess the impact of a newly developed educational simplified video about LP, in the parents’ native language, that is tailored to their social background and beliefs and to assess whether it can facilitate their consent for the procedure. Methods This prospective, interventional study was conducted at the outpatient pediatric clinics at a teaching hospital. The conventional arm used verbal explanation about LP. The second method utilized a standardized video, having the same information as the conventional arm, with streaming of graphic depictions. Parents’ knowledge and perceived LP risks were measured before and after the intervention. Results Two hundred and one parents were enrolled, with no significant differences in the socio-demographic and baseline characteristics. Both verbal and video-based counseling were found to provide a statistically significant increase in knowledge scores, and a Wilcoxon signed-rank test showed that knowledge gains for both groups were statistically significant (Verbal Explanation: W = 2693, n = 83, P < .001 and Video: W = 5538, n = 117, P < .001). However, the conventional verbal counseling resulted in more consistent gain of knowledge (SD = 14.5) as compared to the video group (SD = 18.94). The video group reported higher perceived risk (Mean 8.2, SD 3.59) than the verbal explanation group (Mean 7.12, SD 2.51). The less educated parents perceived LP procedure to be of significantly higher risk after watching the video (P < .001). It was found that 73.6% of persons with perceived intention to refuse LP changed their opinion after either of the counseling interventions, with significant opinion difference pre- and post-counseling intervention (P value .002). Conclusions Video education in parents’ native language about LP is as effective as conventional verbal education for informed consent, with the additional advantage of reproducibility and more illustrations to give parents better insight. However, this video should be followed by direct interaction with parents to ensure their full understanding and address any further concerns.

Project description:ObjectiveTo assess Australian physiotherapists' knowledge about, attitudes towards, and self-reported use of shared decision making, as well as perceived barriers to its implementation in practice.MethodsPhysiotherapists registered for a national Australian physiotherapy conference were invited via email and the conference app to complete a self-administered online questionnaire about shared decision making, including: a) knowledge, b) attitude to and reported approach in practice, c) behaviours used, d) barriers, e) previous training and future training interest. Responses were analysed descriptively and open-ended questions synthesised narratively.Results372 physiotherapists (71% female, mean age 45 years, mean experience 23 years) completed the survey. Respondents had a good level of knowledge on most questions, with correct responses ranging from 39.5% to 98.5% of participants, and a generally positive attitude towards shared decision making, believing it useful to most practice areas. Sixty percent indicated they make decisions with their patients and there was general agreement between how decisions should be made and how they are actually made. The behaviour with the lowest reported occurrence was explaining the relevant research evidence about the benefits and harms of the options. The main perceived barriers were patient knowledge and confidence, consequent fewer physiotherapy sessions, and time constraints. Most (79%) were keen to learn more about shared decision making.ConclusionsShared decision making is of growing importance to all health professions and rarely studied in physical therapy. This sample of Australian physiotherapists had a generally positive attitude to shared decision making and learning more about it. Opportunities for providing such skills training at the undergraduate level and in continuing professional development should be explored. This training should ensure that the communicating evidence component of shared decision making is addressed as well as debunking myths about perceived barriers to its implementation.

Project description:BackgroundThe aim of this study was to determine the knowledge, attitude and practice (KAP) regarding the COVID-19 among frontline healthcare workers (F-HCWs) working at different hospitals in Nepal and to identify the factors significantly associated with KAP.MethodsWe used a web-based survey, and a convenience sampling method was adopted to collect data from 603 F-HCWs working at different hospitals in Nepal during the first week of June 2020. A self-administered questionnaire was utilized to assess the KAP perceived by the F-HCWs. It was divided into 4-parts consisting of 30-items, demographic characteristics (10-items), knowledge (10-items), attitude (5-items), and practice (5-items). It consisted of both multiple-choice questions and Likert scale items questionnaire.ResultsAmong the participants, 76% reported adequate knowledge, 54.7% reported positive attitude, and 78.9% reported appropriate practice. Statistically significant differences regarding the perceived level of knowledge among F-HCWs were observed among independent variables, including age, gender, level of education, marital status, profession, work experience, source of information, infection prevention and control (IPC) training, and online course(p < 0.05). Similarly, statistically significant differences regarding the attitude among F-HCWs were observed among independent variables, including age, gender, level of education, profession, and online course(p < 0.05). Moreover, only 2-independent variables, including the profession and online course, showed statistically significant differences with practice(p < 0.05). Pearson correlation analysis showed a significant association between knowledge, attitude and practice at the level of p = 0.01. The factors significantly associated with adequate knowledge were male gender, nurse and doctor, websites and IPC training. Similarly, factors significantly associated with positive attitude were online course related to COVID-19 only. Moreover, factors significantly associated with appropriate practice were master's degree or above and online course related to COVID-19.ConclusionsF-HCWs reported adequate overall knowledge with a positive attitude and adopted the appropriate practice. The experienced F-HCWs with higher education and who received IPC training and online course regarding COVID-19 had better KAP. So, the stakeholders must arrange the educational programs and training for F-HCWs for better preparedness tackling with COVID-19.

Project description:BackgroundSelf-reported scales and objective measurement tools are used to evaluate self-perceived and objective knowledge of evidence-based practice (EBP). Agreement between self-perceived and objective knowledge of EBP terminology has not been widely investigated among healthcare students.AimThe aim of this study was to examine agreement between self-reported and objectively assessed knowledge of EBP terminology among healthcare students. A secondary objective was to explore this agreement between students with different levels of EBP exposure.MethodsStudents in various healthcare disciplines and at different academic levels from Norway (n = 336) and Canada (n = 154) were invited to answer the Terminology domain items of the Evidence-Based Practice Profile (EBP2) questionnaire (self-reported), an additional item of 'evidence based practice' and six random open-ended questions (objective). The open-ended questions were scored on a five-level scoring rubric. Interrater agreement between self-reported and objective items was investigated with weighted kappa (Kw). Intraclass correlation coefficient (ICC) was used to estimate overall agreement.ResultsMean self-reported scores varied across items from 1.99 ('forest plot') to 4.33 ('evidence-based practice'). Mean assessed open-ended answers varied from 1.23 ('publication bias') to 2.74 ('evidence-based practice'). For all items, mean self-reported knowledge was higher than that assessed from open-ended answers (p<0.001). Interrater agreement between self-reported and assessed open-ended items varied (Kw = 0.04-0.69). The overall agreement for the EBP2 Terminology domain was poor (ICC = 0.29). The self-reported EBP2 Terminology domain discriminated between levels of EBP exposure.ConclusionAn overall low agreement was found between healthcare students' self-reported and objectively assessed knowledge of EBP terminology. As a measurement tool, the EBP2 Terminology scale may be useful to differentiate between levels of EBP exposure. When using the scale as a discriminatory tool, for the purpose of academic promotion or clinical certification, users should be aware that self-ratings would be higher than objectively assessed knowledge.

Project description:ImportanceTransgender, gender nonbinary, and genderqueer people are at increased risk for negative health outcomes, and medical school education is currently lacking on inclusion of these topics. However, there is little evidence of an association of clinician knowledge with the health of transgender people.ObjectiveTo evaluate the associations of patients' perceptions of clinician knowledge with self-rated health and severe psychological distress among transgender people.Design, setting, and participantsIn this cross-sectional study, a secondary data analysis of the 2015 US Transgender Survey (a survey of transgender, gender nonbinary, and genderqueer adults conducted across 50 states) Washington, DC, US territories, and US military bases in 2015 was performed. Data were analyzed from February to November 2022.ExposuresPatients' perception of their clinician's knowledge about transgender health care.Main outcomes and measuresSelf-rated health, dichotomized as poor or fair vs excellent, very good, or good, and severe psychological distress (scoring a validated threshold of ≥13 on the Kessler Psychological Distress Scale).ResultsThe sample included a total of 27 715 respondents (9238 transgender women [33.3%; 55.1% weighted; 95% CI, 53.4%-56.7%], 22 658 non-Hispanic White individuals [81.8%; 65.6% weighted; 95% CI, 63.7%-67.5%], and 4085 individuals aged 45-64 years [14.7%; 33.8% weighted; 95% CI, 32.0%-35.5%]). Of 23 318 individuals who answered questions regarding their perceptions of their clinicians' level of knowledge, 5732 (24.6%) reported their clinician knows almost everything about transgender care, 4083 (17.5%) reported their clinician knows most things, 3446 (14.8%) reported their clinician knows some things, 2680 (11.5%) reported their clinician knows almost nothing, and 7337 (31.5%) reported they were unsure. Nearly 1 in 4 transgender adults (5612 of 23 557 individuals [23.8%]) reported having to teach their clinician about transgender people. In total, 3955 respondents (19.4%; 20.8% weighted; 95% CI, 19.2%-22.6%) reported fair or poor self-rated health and 7392 (36.9%; 28.4% weighted, 95% CI, 26.9%-30.1%) met the criteria for severe psychological distress. After adjusting for covariates, compared with individuals who reported their clinician knows almost everything about transgender care, exposure to clinicians with lower perceived levels of knowledge about transgender care was associated with significantly higher odds of fair or poor self-rated health (adjusted odds ratio [aOR] for knowing almost nothing, 2.63; 95% CI, 1.76-3.94; aOR for unsure, 1.81; 95% CI, 1.28-2.56) and severe psychological distress (aOR for knowing almost nothing, 2.33; 95% CI, 1.61-3.37; aOR for unsure, 1.37; 95% CI, 1.05-1.79). Respondents who had to teach a clinician about transgender people had higher odds of reporting fair or poor self-rated health (aOR, 1.67; 95% CI, 1.31-2.13) and severe psychological distress (aOR, 1.49; 95% CI, 1.21-1.83) compared with those who did not.Conclusion and relevanceThe findings of this cross-sectional study suggest that there is an association between perceived clinician knowledge about transgender people and self-rated health and psychological distress among transgender people. These results highlight the importance of integration and enhancement of transgender health in medical education curriculum as a necessary intervention to improve the health of transgender people.

Dataset Information

Perceived Statistical Knowledge Level and Self-Reported Statistical Practice Among Academic Psychologists.

Publications

Perceived Statistical Knowledge Level and Self-Reported Statistical Practice Among Academic Psychologists.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets