Dataset Information

Validity evidence for a novel instrument assessing medical student attitudes toward instruction in implicit bias recognition and management.

ABSTRACT:

Background

Implicit bias instruction is becoming more prevalent in health professions education, with calls for skills-based curricula moving from awareness and recognition to management of implicit bias. Evidence suggests that health professionals and students learning about implicit bias ("learners") have varying attitudes about instruction in implicit bias, including the concept of implicit bias itself. Assessing learner attitudes could inform curriculum development and enable instructional designs that optimize learner engagement. To date, there are no instruments with evidence for construct validity that assess learner attitudes about implicit bias instruction and its relevance to clinical care.

Methods

The authors developed a novel instrument, the Attitude Towards Implicit Bias Instrument (ATIBI) and gathered evidence for three types of construct validity- content, internal consistency, and relationship to other variables.

Results

Authors utilized a modified Delphi technique with an interprofessional team of experts, as well as cognitive interviews with medical students leading to item refinement to improve content validity. Seven cohorts of medical students, N = 1072 completed the ATIBI. Psychometric analysis demonstrated high internal consistency (α = 0.90). Exploratory factor analysis resulted in five factors. Analysis of a subset of 100 medical students demonstrated a moderate correlation with similar instruments, the Integrative Medicine Attitude Questionnaire (r = 0.63, 95% CI: [0.59, 0.66]) and the Internal Motivation to Respond Without Prejudice Scale (r = 0.36, 95% CI: [0.32, 0.40]), providing evidence for convergent validity. Scores on our instrument had low correlation to the External Motivation to Respond Without Prejudice Scale (r = 0.15, 95% CI: [0.09, 0.19]) and the Groningen Reflection Ability Scale (r = 0.12, 95% CI: [0.06, 0.17]) providing evidence for discriminant validity. Analysis resulted in eighteen items in the final instrument; it is easy to administer, both on paper form and online.

Conclusion

The Attitudes Toward Implicit Bias Instrument is a novel instrument that produces reliable and valid scores and may be used to measure medical student attitudes related to implicit bias recognition and management, including attitudes toward acceptance of bias in oneself, implicit bias instruction, and its relevance to clinical care.

SUBMITTER: Gonzalez CM

PROVIDER: S-EPMC8040240 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundFor at least the past two decades, medical educators have worked to improve patient communication and health care delivery to diverse patient populations; despite efforts, patients continue to report prejudice and bias during their clinical encounters. Targeted instruction in implicit bias recognition and management may promote the delivery of equitable care, but students at times resist this instruction. Little guidance exists to overcome this resistance and to engage students in implicit bias instruction; instruction over time could lead to eventual skill development that is necessary to mitigate the influence of implicit bias on clinical practice behaviors.ObjectiveTo explore student perceptions of challenges and opportunities when participating in implicit bias instruction.ApproachWe conducted a qualitative study that involved 11 focus groups with medical students across each of the four class years to explore their perceptions of challenges and opportunities related to participating in such instruction. We analyzed transcripts for themes.Key resultsOur analysis suggests a range of attitudes toward implicit bias instruction and identifies contextual factors that may influence these attitudes. The themes were (1) resistance; (2) shame; (3) the negative role of the hidden curriculum; and (4) structural barriers to student engagement. Students expressed resistance to implicit bias instruction; some of these attitudes are fueled from concerns of anticipated shame within the learning environment. Participants also indicated that student engagement in implicit bias instruction was influenced by the hidden curriculum and structural barriers.ConclusionsThese insights can inform future curriculum development efforts. Considerations related to instructional design and programmatic decision-making are highlighted. These considerations for implicit bias instruction may provide useful frameworks for educators looking for opportunities to minimize student resistance and maximize engagement in multi-session instruction in implicit bias recognition and management.

Project description:BackgroundStudents evaluations of their learning experiences can provide a useful source of information about clerkship effectiveness in undergraduate medical education. However, low response rates in clerkship evaluation surveys remain an important limitation. This study examined the impact of increasing response rates using a compulsory approach on validity evidence.MethodsData included 192 responses obtained voluntarily from 49 third-year students in 2014-2015, and 171 responses obtained compulsorily from 49 students in the first six months of the consecutive year at one medical school in Lebanon. Evidence supporting internal structure and response process validity was compared between the two administration modalities. The authors also tested for potential bias introduced by the use of the compulsory approach by examining students' responses to a sham item that was added to the last survey administration.ResultsResponse rates increased from 56% in the voluntary group to 100% in the compulsory group (P < 0.001). Students in both groups provided comparable clerkship rating except for one clerkship that received higher rating in the voluntary group (P = 0.02). Respondents in the voluntary group had higher academic performance compared to the compulsory group but this difference diminished when whole class grades were compared. Reliability of ratings was adequately high and comparable between the two consecutive years. Testing for non-response bias in the voluntary group showed that females were more frequent responders in two clerkships. Testing for authority-induced bias revealed that students might complete the evaluation randomly without attention to content.ConclusionsWhile increasing response rates is often a policy requirement aimed to improve the credibility of ratings, using authority to enforce responses may not increase reliability and can raise concerns over the meaningfulness of the evaluation. Administrators are urged to consider not only response rates, but also representativeness and quality of responses in administering evaluation surveys.