Dataset Information

Development of the objective, structured communication assessment of residents (OSCAR) tool for measuring communication skills with patients.

ABSTRACT: BACKGROUND: Although interpersonal and communication skills are essential to physician practice, there is a dearth of effective tools to meaningfully teach and assess communication skills. OBJECTIVE: The purpose of our study was to create a standardized tool for evaluation of communication skills for residents across specialties. METHODS: We designed an Objective, Structured Communication Assessment of Residents (OSCAR) tool, consisting of 4 clinical stations, to assess intern communication skills with relationship development, their establishment of case goals, and their organization and time management skills. Interns from 11 training programs completed the stations, with senior residents trained to function as standardized patients. The 4 stations' scenarios were a disruptive patient, handling a phone call for a narcotics refill, disclosing a medical mistake, and delivering bad news. RESULTS: Eighty-three interns completed OSCAR during orientation. The assessment took interns about 40 minutes to complete, and participants were given immediate feedback by the standardized patients. The total possible score for each station was 50. Resident performance was highest for disclosing a medical error (94%, 47 of 50), followed by handling a disruptive patient (90%, 45 of 50), disclosing bad news (86%, 43 of 50), and handling the phone call for the narcotics refill (62%, 31 of 50). Multivariate analysis of variance results indicated differences between residents from US and international medical schools, but there were no significant differences across specialties. Interrater reliability was excellent for each station (> 0.80). CONCLUSIONS: OSCAR is a practical tool for assessing interns' communication skills to provide timely results to program directors.

SUBMITTER: Caron A

PROVIDER: S-EPMC3886453 | biostudies-other | 2013 Dec

REPOSITORIES: biostudies-other

ACCESS DATA

Similar Datasets

Project description:BackgroundTeaching and assessment of communication skills have become essential in medical education. The Objective Structured Clinical Examination (OSCE) has been found as an appropriate means to assess communication skills within medical education. Studies have demonstrated the importance of a valid assessment of medical students' communication skills. Yet, the validity of the performance scores depends fundamentally on the quality of the rating scales used in an OSCE. Thus, this systematic review aimed at providing an overview of existing rating scales, describing their underlying definition of communication skills, determining the methodological quality of psychometric studies and the quality of psychometric properties of the identified rating scales.MethodsWe conducted a systematic review to identify psychometrically tested rating scales, which have been applied in OSCE settings to assess communication skills of medical students. Our search strategy comprised three databases (EMBASE, PsycINFO, and PubMed), reference tracking and consultation of experts. We included studies that reported psychometric properties of communication skills assessment rating scales used in OSCEs by examiners only. The methodological quality of included studies was assessed using the COnsensus based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. The quality of psychometric properties was evaluated using the quality criteria of Terwee and colleagues.ResultsData of twelve studies reporting on eight rating scales on communication skills assessment in OSCEs were included. Five of eight rating scales were explicitly developed based on a specific definition of communication skills. The methodological quality of studies was mainly poor. The psychometric quality of the eight rating scales was mainly intermediate.DiscussionOur results reveal that future psychometric evaluation studies focusing on improving the methodological quality are needed in order to yield psychometrically sound results of the OSCEs assessing communication skills. This is especially important given that most OSCE rating scales are used for summative assessment, and thus have an impact on medical students' academic success.

Project description:BackgroundObjective assessment of skills after training is essential for safe implementation of lung point-of-care ultrasound (POCUS). In low-and middle-income countries (LMIC) there is a need for assessment tools without onsite experts to scale up POCUS access. Our objective is to develop a web-based assessment tool and evaluate trainees across different countries and at different time points after initial lung POCUS training.MethodsWe adapted the objective and validated lung ultrasound score (LUS-OSAUS) to a web-based tool with quiz and practical skills test. Trainees were evaluated after a short (4-day) standardized lung POCUS training and were classified in distinct groups according to (i) their geographical location (Benin vs. South-Africa) and (ii) time elapsed since training (Benin 0 months vs. Benin 6 months). The Benin 6 months group had minimal continuous education. Skills test images were read by two blinded experts. We report the overall success rates and then compare these rates based on location and timing since training, using the Fischer's exact test.ResultsA total of 35 out of 43 participants completed the online LUS-OSAUS quiz and skills test. The overall success rate was 0.84 (95%CI 0.80-0.88), with lower success rates for "correct depth" 0.54 (0.37-0.71), "correct assessment of pleura" 0.63 (0.45-0.79) and "conclusion" 0.71 (0.54-0.85). There were no differences based on location, with respective rates of 0.86 (0.80-0.92) and 0.83 (0.75-0.91) (p-value = 0.125) for Benin and South Africa at 0 months, respectively. Similarly, there were no differences according to timing with success rates of 0.86 (0.80-0.92) and 0.82 (0.72-0.93) (p-value = 0.563) for Benin at 0 months and 6 months, respectively.ConclusionWeb-based objective and structured assessment of lung POCUS skills in LMIC following a short-standardized training is feasible and has a good overall success rate with consistent results across regions and up to 6 months after training given minimal continuous education. Overall, technical and POCUS-based clinical conclusion skills are the most difficult to acquire.

Project description:PurposeRecently, some attempts have been made to integrate lung ultrasound (LUS) teaching into medical curricula. However, current education studies of LUS are extremely heterogeneous due to the lack of evidence-based guidelines on LUS education. In particular, the assessment of competencies is poorly standardized and mostly relies on non-validated scales. A new validated tool, the objective structured assessment of lung ultrasound skills (LUS-OSAUS), has the potential to overcome these limitations. Therefore, we adopted the LUS-OSAUS tool to assess the competencies of a group of LUS-trained undergraduates. Existing no prior practical applications of the LUS-OSAUS, our aim was to investigate the practical utility of this tool and its applicability in the evaluation of US-trained medical students.MethodsEight undergraduates (two males, six females) were enrolled on a voluntary basis to receive a theoretical and practical training in LUS. Once completed their training, each student performed an LUS examination on a different patient hospitalized for respiratory symptoms. The same eight patients were also scanned by a senior resident in emergency medicine for a comparison with students' results. Students and the senior resident were tested by an examiner using the LUS-OSAUS tool. We compared the scores obtained by operators in all areas of competence of the LUS-OSAUS, the total scores, and the time needed to complete the sonographic task.ResultsMedian students' score in the single items of the scale was significantly lower than the ones obtained by the senior resident (4.0 [3.3-5.0] vs. 5.0 [5.0-5.0]; p < 0.0001). Students scored significantly lower than the senior resident in each item, except for B-line identification, choice of the correct transducer, and suggested focused questions. Median total score was also lower for students compared to the senior resident (70.5 [61.0-74.8] vs. 84.0 [83.5-84.3] (p = 0.0116). Median time required to complete the examination was significantly higher for students (14.1 [12.8-16.1] vs. 4.7 [3.9-5.2] min, p = 0.0117).ConclusionsThe LUS-OSAUS tool allowed for a standardized and comprehensive assessment of student's competencies in lung ultrasound, and helped to discriminate their level of expertise from that of a more experienced operator. The scale also specifically tests the theoretical knowledge of trainees, thus making redundant the use of questionnaires designed for this purpose.

Dataset Information

Development of the objective, structured communication assessment of residents (OSCAR) tool for measuring communication skills with patients.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets