Browse
Submit Data
Databases
API
Help

Dataset Information

26 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Formal faculty observation and assessment of bedside skills for 3rd-year neurology clerks.

ABSTRACT:

Objective

To evaluate the feasibility and utility of instituting a formalized bedside skills evaluation (BSE) for 3rd-year medical students on the neurology clerkship.

Methods

A neurologic BSE was developed for 3rd^-year neurology clerks at the University of Rochester for the 2012-2014 academic years. Faculty directly observed 189 students completing a full history and neurologic examination on real inpatients. Mock grades were calculated utilizing the BSE in the final grade, and number of students with a grade difference was determined when compared to true grade. Correlation was explored between the BSE and clinical scores, National Board of Medical Examiners (NBME) scores, case complexity, and true final grades. A survey was administered to students to assess their clinical skills exposure and the usefulness of the BSE.

Results

Faculty completed and submitted a BSE form for 88.3% of students. There was a mock final grade change for 13.2% of students. Correlation coefficients between BSE score and clinical score/NBME score were 0.36 and 0.35, respectively. A statistically significant effect of BSE was found on final clerkship grade (F_2,186 = 31.9, p < 0.0001). There was no statistical difference between BSE score and differing case complexities.

Conclusions

Incorporating a formal faculty-observed BSE into the 3rd year neurology clerkship was feasible. Low correlation between BSE score and other evaluations indicated a unique measurement to contribute to student grade. Using real patients with differing case complexity did not alter the grade.

SUBMITTER: Thompson Stone R

PROVIDER: S-EPMC5123551 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

Formal art observation training improves medical students' visual diagnostic skills.

Project description:BACKGROUND: Despite evidence of inadequate physical examination skills among medical students, teaching these skills has declined. One method of enhancing inspection skills is teaching "visual literacy," the ability to reason physiology and pathophysiology from careful and unbiased observation. OBJECTIVE: To improve students' visual acumen through structured observation of artworks, understanding of fine arts concepts and applying these skills to patient care. DESIGN: Prospective, partially randomized pre- vs. post-course evaluation using mixed-methods data analysis. PARTICIPANTS: Twenty-four pre-clinical student participants were compared to 34 classmates at a similar stage of training. INTERVENTION: Training the Eye: Improving the Art of Physical Diagnosis consists of eight paired sessions of art observation exercises with didactics that integrate fine arts concepts with physical diagnosis topics and an elective life drawing session. MEASUREMENTS: The frequency of accurate observations on a 1-h visual skills examination was used to evaluate pre- vs. post-course descriptions of patient photographs and art imagery. Content analysis was used to identify thematic categories. All assessments were blinded to study group and pre- vs. post-course evaluation. RESULTS: Following the course, class participants increased their total mean number of observations compared to controls (5.41 +/- 0.63 vs. 0.36 +/- 0.53, p < 0.0001) and had increased sophistication in their descriptions of artistic and clinical imagery. A 'dose-response' was found for those who attended eight or more sessions, compared to participants who attended seven or fewer sessions (6.31 + 0.81 and 2.76 + 1.2, respectively, p = 0.03). CONCLUSIONS: This interdisciplinary course improved participants' capacity to make accurate observations of art and physical findings.

| S-EPMC2517949 | biostudies-literature

Longitudinal Faculty Development Program to Promote Effective Observation and Feedback Skills in Direct Clinical Observation.

Project description:IntroductionWe developed a longitudinal faculty development program to maximize faculty training in direct clinical observation (DCO) and feedback, as there was a perceived need for higher quality of DCO and feedback. To achieve this, we created a behaviorally anchored DCO instrument and worked to improve faculty skills in this area.MethodsWe describe an innovative model of faculty training that is learner centered and reinforces evidence-based principles of effective feedback that are introduced and then repeated in all sessions. The training centers on both peer-led observation of and feedback on faculty learners' recorded DCO feedback encounters, and is guided by our DCO instrument. Residents and faculty completed surveys to assess program impact. Qualitative responses were analyzed for themes. The Wilcoxon signed rank test was used to examine significance of difference in feedback quality before and after DCO faculty development education sessions.ResultsOur faculty development program has been well received and had a significant impact on quality of faculty feedback, as rated by resident learners.DiscussionOur faculty development model is effective at growing faculty learners' DCO and feedback skills. Potential strengths of this program include the use of a behaviorally anchored DCO instrument, longitudinal and experiential faculty development, and use of small-group peer review of recorded faculty feedback encounters. We have found that when their learning needs are attended to, faculty learners cultivate a deep appreciation for principles of effective feedback. In fact, faculty feedback skills can be enhanced in the eyes of resident learners.

| S-EPMC6338150 | biostudies-literature

Effect of Perceived Level of Interaction on Faculty Evaluations of 3rd Year Medical Students.

Project description:IntroductionSeveral factors are known to affect the way clinical performance evaluations (CPEs) of medical students are completed by supervising physicians. We sought to explore the effect of faculty perceived "level of interaction" (LOI) on these evaluations.MethodsOur third-year CPE requires evaluators to identify perceived LOI with each student as low, moderate, or high. We examined CPEs completed during the academic year 2018-2019 for differences in (1) clinical and professionalism ratings, (2) quality of narrative comments, (3) quantity of narrative comments, and (4) percentage of evaluation questions left unrated.ResultsA total of 3682 CPEs were included in the analysis. ANOVA revealed statistically significant differences between LOI and clinical ratings (p ≤ .001), with mean ratings from faculty with a high LOI significantly higher than from faculty with a moderate or low LOI (p ≤ .001). Chi-squared analysis demonstrated differences based on faculty LOI and whether questions were left unrated (p ≤ .001), quantity of narrative comments (p ≤ .001), and specificity of narrative comments (p ≤ .001).ConclusionsFaculty who perceive higher LOI were more likely to assign that student higher ratings, complete more of the clinical evaluation and were more likely to provide narrative feedback with more specific, higher-quality comments.Supplementary informationThe online version contains supplementary material available at 10.1007/s40670-021-01307-w.

| S-EPMC8368453 | biostudies-literature

Four-Station Group Observed Structured Clinical Encounter for Formative Assessment of Communication Skills for Internal Medicine Clerks.

Project description:IntroductionCommunication with patients and among colleagues is critical to effective clinical care. A group observed structured clinical encounter (GOSCE) is an effective and resource-saving tool for teaching communication skills to medical students. While objective structured clinical exams (OSCEs) are a well-established assessment tool for communication skills, a GOSCE allows for formal observation of communication skills while also providing an opportunity for peer observation and feedback. Additionally, a GOSCE costs less and requires fewer faculty per learner than a traditional OSCE.MethodsThis is a four-station GOSCE to teach advanced communication skills to medical students. The stations are smoking cessation, difficult doctor-patient encounter, shared decision making, and delivering bad news. A group is made up of four to six students and one faculty member. At each station, one student takes the lead in the patient interview, followed by a group interview and ending with feedback by all participants.ResultsIn the pilot phase, a total of 44 students were administered the GOSCE and were surveyed about their experience. Students felt the GOSCE was an enjoyable and educational experience. The GOSCE has subsequently been administered to more than 600 students, and 25 internal medicine faculty have participated.DiscussionOur work demonstrates that the GOSCE is a feasible curricular enhancement for formative assessment of communication skills during the internal medicine clerkship. It is easy to implement and has been well received by all participants, with minimal impact on limited medical school and faculty resources.

| S-EPMC6464416 | biostudies-literature

Core neurological examination items for neurology clerks: A modified Delphi study with a grass-roots approach.

Project description:With the evolution of treatments for neurological diseases, the contents of core neurological examinations (NEs) for medical students may need to be modified. We aimed to establish a consensus on the core NE items for neurology clerks and compare viewpoints between different groups of panelists.First, a pilot group proposed the core contents of NEs for neurology clerks. The proposed core NE items were then subject to a modified web-based Delphi process using the online software "SurveyMonkey". A total of 30 panelists from different backgrounds (tutors or learners, neurologists or non-neurologists, community hospitals or medical centers, and different academic positions) participated in the modified Delphi process. Each panelist was asked to agree or disagree on the inclusion of each item using a 9-point Likert scale and was encouraged to provide feedback. We also compared viewpoints between different groups of panelists using the Mann-Whitney U test.Eighty-three items were used for the first round of the Delphi process. Of them, 18 without consensus of being a core NE item for the neurology clerks in the first round and another 14 items suggested by the panelists were further discussed in the second round. Finally, 75 items with different grades were included in the recommended NE items for neurology clerks.Our findings provide a reference regarding the core NE items for milestone development for neurology clerkships. We hope that prioritizing the NE items in this order can help medical students to learn NE more efficiently.

| S-EPMC5957356 | biostudies-other

Clinical Skills Evaluation in Neurology, Child Neurology and Psychiatry: Program Directors' Perspective and Future Opportunities.

Project description:BackgroundWhen the American Board of Psychiatry and Neurology (ABPN) eliminated the oral segment of the board-certification examination, it began requiring in-training assessments termed Clinical Skill Evaluations (CSEs).ObjectiveThis study describes the experience of residency program directors (PDs) with CSEs and identifies opportunities for improvement.MethodsA 23-question survey was administered electronically to neurology, child neurology, and psychiatry PDs assessing their CSE testing procedures in April 2019. Data from the ABPN preCERT® Credentialing System CSE was analyzed to corroborate the survey results.ResultsA total of 439 PDs were surveyed. The overall response rate was approximately 40% with a similar response across the 3 specialties. Overall, there was a strong enthusiasm for CSEs as they captured the essence of the physician-patient relationship. Most PDs encouraged trainees to attempt CSEs early in their training though the completion time frame varied by specialty. Approximately 57% of psychiatry residencies offered formal, in-person faculty training while less than one-fourth of neurology and child neurology programs offered such a program. Most PDs are interested in a faculty development course to ensure a standardized CSE testing process at their institution.ConclusionsThis survey confirmed earlier findings that CSEs are usually implemented early in the course of residency training and that most PDs think it captures the essence of the physician-patient relationship. While few residencies offer a CSE training course, there is widespread support for a formal approach to faculty development and this offers a specific opportunity for CSE improvement in the future.

| S-EPMC8368539 | biostudies-literature

Leadership Observation and Feedback Tool: A Novel Instrument for Assessment of Clinical Leadership Skills.

Project description:Background :While leadership training is increasingly incorporated into residency education, existing assessment tools to provide feedback on leadership skills are only applicable in limited contexts. Objective :We developed an instrument, the Leadership Observation and Feedback Tool (LOFT), for assessing clinical leadership. Methods :We used an iterative process to develop the tool, beginning with adapting the Leadership Practices Inventory to create an open-ended survey for identification of clinical leadership behaviors. We presented these to leadership experts who defined essential behaviors through a modified Delphi approach. In May 2014 we tested the resulting 29-item tool among residents in the internal medicine and pediatrics departments at 2 academic medical centers. We analyzed instrument performance using Cronbach's alpha, interrater reliability using intraclass correlation coefficients (ICCs), and item performance using linear-by-linear test comparisons of responses by postgraduate year, site, and specialty. Results :A total of 377 (of 526, 72%) team members completed the LOFT for 95 (of 519, 18%) residents. Overall ratings were high-only 14% scored at the novice level. Cronbach's alpha was 0.79, and the ICC ranged from 0.20 to 0.79. Linear-by-linear test comparisons revealed significant differences between postgraduate year groups for some items, but no significant differences by site or specialty. Acceptability and usefulness ratings by respondents were high. Conclusions :Despite a rigorous approach to instrument design, we were unable to collect convincing validity evidence for our instrument. The tool may still have some usefulness for providing formative feedback to residents on their clinical leadership skills.

| S-EPMC6194892 | biostudies-other

Peer observation of teaching as a faculty development tool.

Project description:BackgroundPeer observation of Teaching involves observers providing descriptive feedback to their peers on learning and teaching practice as a means to improve quality of teaching. This study employed and assessed peer observation as a constructive, developmental process for members of a Pediatric Teaching Faculty.MethodsThis study describes how peer observation was implemented as part of a teaching faculty development program and how it was perceived by teachers. The PoT process was divided into 4 stages: pre-observation meeting, observation, post-observation feedback and reflection. Particular care was taken to ensure that teachers understood that the observation and feedback was a developmental and not an evaluative process. Twenty teachers had their teaching peer observed by trained Faculty members and gave an e-mail 'sound-bite' of their perceptions of the process. Teaching activities included lectures, problem-based learning, small group teaching, case-based teaching and ward-based teaching sessions.ResultsTeachers were given detailed verbal and written feedback based on the observer's and students' observations. Teachers' perceptions were that PoT was useful and relevant to their teaching practice. Teachers valued receiving feedback and viewed PoT as an opportunity for insight and reflection. The process of PoT was viewed as non-threatening and teachers thought that PoT enhanced the quality of their teaching, promoted professional development and was critical for Faculty development.ConclusionsThis study demonstrated that PoT can be used in a constructive way to improve course content and delivery, to support and encourage medical teachers, and to reinforce good teaching.

| S-EPMC3406982 | biostudies-literature

The Faculty Self-Reported Assessment Survey (FRAS): differentiating faculty knowledge and experience in assessment.

Project description:Science, technology, engineering, and mathematics education reform efforts have called for widespread adoption of evidence-based teaching in which faculty members attend to student outcomes through assessment practice. Awareness about the importance of assessment has illuminated the need to understand what faculty members know and how they engage with assessment knowledge and practice. The Faculty Self-Reported Assessment Survey (FRAS) is a new instrument for evaluating science faculty assessment knowledge and experience. Instrument validation was composed of two distinct studies: an empirical evaluation of the psychometric properties of the FRAS and a comparative known-groups validation to explore the ability of the FRAS to differentiate levels of faculty assessment experience. The FRAS was found to be highly reliable (α = 0.96). The dimensionality of the instrument enabled distinction of assessment knowledge into categories of program design, instrumentation, and validation. In the known-groups validation, the FRAS distinguished between faculty groups with differing levels of assessment experience. Faculty members with formal assessment experience self-reported higher levels of familiarity with assessment terms, higher frequencies of assessment activity, increased confidence in conducting assessment, and more positive attitudes toward assessment than faculty members who were novices in assessment. These results suggest that the FRAS can reliably and validly differentiate levels of expertise in faculty knowledge of assessment.

| S-EPMC4477733 | biostudies-literature

Formal Semantics in the Neurology Clinic: Atypical Understanding of Aspectual Coercion in ALS Patients.

Project description:Amyotrophic lateral sclerosis (ALS) is a neurodegenerative disease of the motor system with subtle adverse effects on cognition. It is still unclear whether ALS also affects language and semantics, and if so, what aspects and processes exactly. We investigated how ALS patients understand verb phrases modified by temporal preposition phrases, e.g., "To watch TV for half an hour." Interpretation here requires operations such as aspectual coercion that add or delete elements from event structures, depending on temporal modifiers, and constraints on coercion, which make combinations with certain modifiers not viable. Using a theoretically-motivated experimental design, we observed that acceptance rates for aspectual coercion were abnormally high in ALS patients. The effect was largest for the more complex cases of coercion: not those that involve enrichment of event structures ("To switch on the TV in half an hour," where a number of failed attempts must be included in the interpretation) but those that, if applied, would result in deletion of event structure elements ("To repair the TV for half an hour"). Our experimental results are consistent with a deficit of constraints on coercion, and not with impaired semantic processes or representations, in line with recent studies suggesting that verb semantics is largely spared in ALS.

| S-EPMC5095610 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data