Dataset Information

Strategies to evaluate healthcare provider trainings in shared decision-making (SDM): a systematic review of evaluation studies.

ABSTRACT:

Design and objectives

We performed a systematic review of studies evaluating healthcare provider (HCP) trainings in shared decision-making (SDM) to analyse their evaluation strategies.

Setting and participants

HCP trainings in SDM from all healthcare settings.

Methods

We searched scientific databases (Medline, PsycInfo, CINAHL), performed reference and citation tracking, contacted experts in the field and scanned the Canadian inventory of SDM training programmes for healthcare professionals. We included articles reporting data of summative evaluations of HCP trainings in SDM. Two reviewers screened records, assessed full-text articles, performed data extraction and assessed study quality with the integrated quality criteria for review of multiple study designs (ICROMS) tool. Analysis of evaluation strategies included data source use, use of unpublished or published measures and coverage of Kirkpatrick's evaluation levels. An evaluation framework based on Kirkpatrick's evaluation levels and the Quadruple Aim framework was used to categorise identified evaluation outcomes.

Results

Out of 7234 records, we included 41 articles reporting on 30 studies: cluster-randomised (n=8) and randomised (n=9) controlled trials, controlled (n=1) and non-controlled (n=7) before-after studies, mixed-methods (n=1), qualitative (n=1) and post-test (n=3) studies. Most studies were conducted in the USA (n=9), Germany (n=8) or Canada (n=7) and evaluated physician trainings (n=25). Eleven articles met ICROMS quality criteria. Almost all studies (n=27) employed HCP-reported outcomes for training evaluation and most (n=19) additionally used patient-reported (n=12), observer-rated (n=10), standardised patient-reported (n=2) outcomes or training process and healthcare data (n=10). Most studies employed a mix of unpublished and published measures (n=17) and covered two (n=12) or three (n=10) Kirkpatrick's levels. Identified evaluation outcomes covered all categories of the proposed framework.

Conclusions

Strategies to evaluate HCP trainings in SDM varied largely. The proposed evaluation framework maybe useful to structure future evaluation studies, but international agreement on a core set of outcomes is needed to improve evidence.

Prospero registration number

CRD42016041623.

SUBMITTER: Muller E

PROVIDER: S-EPMC6596948 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThe Shared Decision Making Questionnaire (SDM-Q-9 and SDM-Q-Doc) is a 9-item measure of the decisional process in medical encounters from both patients' and physicians' perspectives. It has good acceptance, feasibility, and reliability. This systematic review aimed to 1) evaluate the use of the SDM-Q-9 and SDM-Q-Doc in intervention studies on shared decision making (SDM) in clinical settings, 2) describe how the SDM-Q-9 and SDM-Q-Doc performed regarding sensitivity to change, and 3) assess the methodological quality of studies and study protocols that use the measure.MethodsWe conducted a systematic review of studies published between 2010 and October 2015 that evaluated interventions to facilitate SDM. The search strategy comprised three databases (EMBASE, PsycINFO, and Medline), reference tracking, citation tracking, and personal knowledge. Two independent reviewers screened titles and abstracts as well as full texts of potentially relevant records. We extracted the data using a pilot tested sheet, and we assessed the methodological quality of included studies using the Quality Assessment Tools from the U.S. National Institute of Health (NIH).ResultsFive completed studies and six study protocols fulfilled the inclusion criteria. The measure was used in a variety of health care settings, mainly in Europe, to evaluate several types of interventions. The reported mean sum scores ranged from 42 to 75 on a scale from 0 to 100. In four studies no significant change was detected in the mean-differences between main groups. In the fifth study the difference was small. Quality assessment revealed a high risk of bias in four of the five completed studies, while the study protocols received moderate quality ratings.ConclusionsWe found a wide range of areas in which the SDM-Q-9 and SDM-Q-Doc were applied. In the future this review may help researchers decide whether the measure fits their purposes. Furthermore, the review revealed risk of bias in previous trials that used the measure, and may help future trials decrease this risk. More research on the measure's sensitivity to change is strongly suggested.

Project description:PURPOSE:The SDM-Q-9 and SDM-Q-Doc measure patient and physician perception of the extent of shared decision making (SDM) during a physician-patient consultation. So far, no self-report instrument for SDM was available in Dutch, and validation of the scales in other languages has been limited. The aim of this study was to translate both scales into Dutch and assess their psychometric characteristics. METHODS:Participants were patients and their treating physicians (general practitioners and medical specialists). Patients (N = 182) rated their consultation using the SDM-Q-9, 43 physicians rated their consultations using the SDM-Q-Doc (N = 201). Acceptability, reliability (internal consistency), and the factorial structure of the instruments were determined. For convergent validity the CPSpost was used. RESULTS:Reliabilities of both scales were high (alpha SDM-Q-9 0.88; SDM-Q-Doc 0.87). The SDM-Q-9 and SDM-Q-Doc total scores correlated as expected with the CPSpost (SDM-Q-9: r = 0.29; SDM-Q-Doc: r = 0.48) and were significantly different between the CPSpost categories, with lowest mean scores when the physician made the decision alone. Principal Component Analyses showed a two-component model for each scale. A confirmatory factor analysis yielded a mediocre, but acceptable, one-factor model, if Item 1 was excluded; for both scales the best indices of fit were obtained for a one-factor solution, if both Items 1 and 9 were excluded. CONCLUSION:The Dutch SDM-Q-9 and SDM-Q-Doc demonstrate good acceptance and reliability; they correlated as expected with the CPSpost and are suitable for use in Dutch primary and specialised care. Although the best model fit was found when excluding Items 1 and 9, we believe these items address important aspects of SDM. Therefore, also based on the coherence with theory and comparability with other studies, we suggest keeping all nine items of the scale. Further research on the SDM-concept in patients and physicians, in different clinical settings and different countries, is necessary to gain a better understanding of the SDM-construct and its measurement.

Project description:BackgroundShared decision making (SDM) is a core element in the meeting between patient and healthcare professionals, but has proved difficult to implement and sustain in routine clinical practice. One of five Danish regions set out to succeed and to develop a model that ensures lasting SDM based on learnings from large-scale real-world implementation initiatives that go beyond the 'barriers' and 'facilitators' research approach. This paper describes this process and development of a generic implementation model, SDM:HOSP.MethodsThis project was carried out in the Region of Southern Denmark with five major hospital units. Based on existing theory of SDM, SDM implementation, implementation science and improvement methodology, a process of four phases were described; development of conceptual elements, field-testing, evaluation, and development of the final implementation model. The conceptual elements developed aimed to prepare leaders, train SDM teachers, teach clinicians to perform SDM, support development of patient decision aids, and support systematic planning, execution and follow-up. Field testing was done including continuous participant evaluations and an overall evaluation after one year.ResultsData from field testing and learnings from the implementation process, illustrated the need for a dynamic and easy adjustable model. The final SDM:HOSP model included four themes; i)Training of Leaders, ii) Training of Teachers and Clinicians, iii) Decision Helper, and iv) 'Process', each with details in three levels, 1) shared elements, 2) recommendations, and 3) local adaption.ConclusionsA feasible and acceptable model for implementation of SDM across hospitals and departments that accounts for different organizations and cultures was developed. The overall design can easily be adapted to other organizations and can be adjusted to fit the specific organization and culture. The results from the ongoing and overall evaluation suggest promising avenues for future work in further testing and research of the usability of the model.

Project description:IntroductionShared decision-making (SDM) is not yet widely used when making decisions in German hospitals. Making SDM a reality is a complex task. It involves training healthcare professionals in SDM communication and enabling patients to actively participate in communication, in addition to providing sound, easy to understand information on treatment alternatives in the form of evidence-based patient decision aids (EbPDAs). This project funded by the German Innovation Fund aims at designing, implementing and evaluating a multicomponent, large-scale and integrative SDM programme-called SHARE TO CARE (S2C)-at all clinical departments of a University Hospital Campus in Northern Germany within a 4-year time period.Methods and analysisS2C tackles the aforementioned components of SDM: (1) training physicians in SDM communication, (2) activating and empowering patients, (3) developing EbPDAs in the most common/relevant diseases and (4) training other healthcare professionals in SDM coaching. S2C is designed together with patients and providers. The physicians' training programme entails an online and an in situ training module. The decision coach training is based on a similar but less comprehensive approach. The development of online EbPDAs follows the International Patient Decision Aid Standards and includes written, graphical and video-based information. Validated outcomes of SDM implementation are measured in a preintervention and postintervention evaluation design. Process evaluation accompanies programme implementation. Health economic impact of the intervention is investigated using a propensity-score-matched approach based on potentially preference-sensitive hospital decisions.Ethics and disseminationEthics committee review approval has been obtained from Medical Ethics Committee of the Medical Faculty of the Christian-Albrechts-University Kiel. Project information and results will be disseminated at conferences, on project-hosted websites at University Hospital Medical Center Schleswig Holstein and by S2C as well as in peer-reviewed and professional journals.

Project description:BackgroundOncological patients often feel left out of important treatment decisions. However, when physicians engage them in shared decision-making (SDM), patients benefit in many ways and the situation is improved. SDM can effectively be taught to physicians, but participation barriers for SDM physician group trainings are high, making it hard to convince physicians to participate. With this in mind, we aim to develop and evaluate two new dissemination strategies for a brief, SDM training program based upon a proven SDM group-training concept: an individualized context-based SDM face-to-face training (IG I) and a web-based interactive SDM online training (IG II). We aim to analyze which improvements can be achieved by IG I and II compared to a control group (CG) in physician SDM competence and performance as well as the impact on the physician-patient relationship. Furthermore, we analyze differences in satisfaction concerning the two dissemination strategies by means of a training evaluation.Methods/designWe examine - based on a three-armed randomized controlled trial (IG I, IG II, CG) - the effectiveness of two new dissemination strategies for a SDM training program compared to a CG receiving no SDM training (voluntary access to SDM training as an incentive for participation after completion of the study). We aim to include 162 physicians randomized to one of the three arms. There will be two assessment points in time (before intervention: T0 and post-training: T1). The main outcome is the SDM competence of physicians as measured by an established observational assessment rating system (OPTION-12) by means of consultations with Standardized Patients. Standardized Patients are individuals trained to act as "real" patients. Secondary outcome measures are the SDM performance (SDM-Q-9) and the Questionnaire on the Quality of Physician-Patient-Interaction (QQPPI) both rated by Standardized Patients as well as the physicians' training evaluation.DiscussionThis trial will assess the effectiveness and acceptability of two new dissemination strategies for a brief, SDM training program for physicians. Opportunities and challenges regarding implementation in daily routines will be discussed.Trial registrationClinicalTrials.gov, Identifier: NCT02674360 . Prospectively registered on 4 February 2016.