Dataset Information

Serious Illness Conversation-Evaluation Exercise: A Novel Assessment Tool for Residents Leading Serious Illness Conversations.

ABSTRACT: Background/Objectives: The serious illness conversation (SIC) is an evidence-based framework for conversations with patients about a serious illness diagnosis. The objective of our study was to develop and validate a novel tool, the SIC-evaluation exercise (SIC-Ex), to facilitate assessment of resident-led conversations with oncology patients. Design: We developed the SIC-Ex based on SIC and on the Royal College of Canada Medical Oncology milestones. Seven resident trainees and 10 evaluators were recruited. Each trainee conducted an SIC with a patient, which was videotaped. The evaluators watched the videos and evaluated each trainee by using the novel SIC-Ex and the reference Calgary-Cambridge guide (CCG) at months zero and three. We used Kane's validity framework to assess validity. Results: Intra-class correlation using average SIC-Ex scores showed a moderate level of inter-evaluator agreement (range 0.523-0.822). Most evaluators rated a particular resident similar to the group average, except for one to two evaluator outliers in each domain. Test-retest reliability showed a moderate level of consistency among SIC-Ex scores at months zero and three. Global rating at zero and three months showed fair to good/very good inter-evaluator correlation. Pearson correlation coefficients comparing total SIC-Ex and CCG scores were high for most evaluators. Self-scores by trainees did not correlate well with scores by evaluators. Conclusions: SIC-Ex is the first assessment tool that provides evidence for incorporating the SIG guide framework for evaluation of resident competence. SIC-Ex is conceptually related to, but more specific than, CCG in evaluating serious illness conversation skills.

SUBMITTER: Ko JJ

PROVIDER: S-EPMC8241377 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Serious Illness Conversation-Evaluation Exercise: A Novel Assessment Tool for Residents Leading Serious Illness Conversations.

Ko Jenny J JJ Ballard Mark S MS Shenkier Tamara T Simon Jessica J Roze des Ordons Amanda A Fyles Gillian G Lefresne Shilo S Hawley Philippa P Chen Charlie C McKenzie Michael M Ghement Isabella I Sanders Justin J JJ Bernacki Rachelle R Jones Scott S

Palliative medicine reports 20201124 1

Background/Objectives: The serious illness conversation (SIC) is an evidence-based framework for conversations with patients about a serious illness diagnosis. The objective of our study was to develop and validate a novel tool, the SIC-evaluation exercise (SIC-Ex), to facilitate assessment of resident-led conversations with oncology patients. Design: We developed the SIC-Ex based on SIC and on the Royal College of Canada Medical Oncology milestones. Seven resident tr ...[more]

PMID: 34223487

Similar Datasets

Project description:ObjectivesThe Serious Illness Conversation Guide (SICG) has emerged as a framework for conversations with patients with a serious illness diagnosis. This study reports on narratives generated from open-ended questions of a novel assessment tool, the Serious Illness Conversation-Evaluation Exercise (SIC-Ex), to assess resident-led conversations with patients in oncology outpatient clinics.DesignQualitative study using template analysis.SettingThree academic cancer centres in Canada.Participants7 resident physicians (trainees), 7 patients from outpatient cancer clinics, 10 preceptors (raters) consisting of medical oncologists, palliative care physicians and radiation oncologists.InterventionsEach trainee conducted an SIC with a patient, which was videotaped. The raters watched the videos and evaluated each trainee using the novel SIC-Ex and the reference Calgary-Cambridge Guide (CCG) initially and again 3 months later. Two independent coders used template analysis to code the raters' narrative comments and identify themes/subthemes.Outcome measuresHow narrative comments aligned with elements of the CCG and SICG.ResultsTemplate analysis yielded four themes: adhering to SICG, engaging patients and family members, conversation management and being mindful of demeanour. Narrative comments identified numerous verbal and non-verbal elements essential to SICG. Some comments addressing general skills in engaging patients/families and managing the conversation (eg, setting agenda, introduction, planning, exploring, non-verbal communication) related to both the CCG and SICG, whereas other comments such as identifying substitute decision maker(s), affirming commitment and introducing Advance Care Planning were specific to the SICG.ConclusionsNarrative comments generated by SIC-Ex provided detailed and nuanced insights into trainees' competence in SIC, beyond the numerical ratings of SIC-Ex and the general communication skills outlined in the CCG, and may contribute to a more fulsome assessment of SIC skills.

Project description:BackgroundThe Serious Illness Care Program (SICP) increases quality of documentation about patients' values and priorities, but it is not known whether patient characteristics and goals of care are associated with the elements documented. The purpose of this study was to explore for associations between the quantity and type of elements documented after SICP conversations with patient characteristics and goals of care order.MethodsDocumentation of SICP conversations by internal medicine physicians with hospitalized patients was evaluated in a retrospective chart review between March 2018 to December 2019. The conversations occurred after SICP implementation in a Tertiary Hospital, Medical teaching unit which uses "Goals of Care Designation" (GCD) medical orders to communicate a patient's general intent, specific interventions, and preferred locations of care. A validated SICP codebook was used to determine the frequency of conversation elements documented for (1) Goals and Values; (2) Prognosis/illness understanding; (3) End-of-life care planning and (4) GCD/Life-sustaining treatment preferences. Univariate and multivariate generalized linear models were used to analyze associations between quantity of elements documented and patient characteristics (age, gender, frailty, language spoken and GCD).ResultsOf 175 SICP conversations documented, in the univariate analysis more goals and values were documented for patients who understand/speak English (0.89; 95% CI: 0.14 - 1.63) and more content was recorded for patients with a non-resuscitative GCD focus ("Medical": 2.42; 95% CI: 1.51 - 3.33; "Comfort": 1.06; 95% CI: 0.24 - 1.88) although not in all domains. In the multivariate analysis, controlling for age, gender, language and frailty, the association between content scores and GCD remained highly significant. Patients with a non-resuscitative GCD had higher total domain scores than those with a resuscitative GCD ("Medical": 1.27 95% CI: 0.42-2.13; "Comfort": 2.67, 95% CI:1.71-3.62).ConclusionThe type of content documented by physicians after a SICP conversation is associated with the patient's goals of care.

Dataset Information

Serious Illness Conversation-Evaluation Exercise: A Novel Assessment Tool for Residents Leading Serious Illness Conversations.

Publications

Serious Illness Conversation-Evaluation Exercise: A Novel Assessment Tool for Residents Leading Serious Illness Conversations.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets