Dataset Information

Using a single item to measure burnout in primary care staff: a psychometric evaluation.

ABSTRACT:

Background

Burnout affects nearly half of all U.S. nurses and physicians, and has been linked to poor outcomes such as worse patient safety. The most common measure of burnout is the well-validated Maslach Burnout Inventory (MBI). However, the MBI is proprietary and carries licensing fees, posing challenges to routine or repeated assessment.

Objective

To compare a non-proprietary, single-item burnout measure to a single item from the MBI Emotional Exhaustion (MBI:EE) subscale that has been validated as a standalone burnout measure.

Design

Cross-sectional online survey.

Participants

A sample of primary care providers (PCPs), registered nurses, clinical associates (e.g., licensed practical nurses (LPNs), medical technicians), and administrative clerks in the Veterans Health Administration surveyed in 2012.

Main methods

We compared a validated one-item version of the MBI:EE and a non-proprietary single-item burnout measure used in the Physician Work Life Study. We calculated kappa statistics, sensitivity and specificity, positive predictive (PPV) and negative predictive values (NPV), and area under the receiver operator curve (AUC). We conducted analyses stratified by occupation to determine the stability of the correlation between the two measures.

Key results

We analyzed responses from 5,404 participants, including 1,769 providers and 1,380 registered nurses. The prevalence of burnout was 36.7% as measured on the single MBI:EE item and 38.5% as measured on the non-proprietary single-item measure. Relative to the MBI:EE, the non-proprietary single-item measure had a correlation of 0.79, sensitivity of 83.2%, specificity of 87.4%, and AUC of 0.93 (se = 0.004). Results were similar when stratified by respondent occupation.

Conclusions

A non-proprietary single-item measure served as a reliable substitute for the MBI:EE across occupations. Because it is non-proprietary and easy to interpret, it has logistical advantages over the one-item MBI.

SUBMITTER: Dolan ED

PROVIDER: S-EPMC4395610 | biostudies-literature | 2015 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Using a single item to measure burnout in primary care staff: a psychometric evaluation.

Dolan Emily D ED Mohr David D Lempa Michele M Joos Sandra S Fihn Stephan D SD Nelson Karin M KM Helfrich Christian D CD

Journal of general internal medicine 20141202 5

<h4>Background</h4>Burnout affects nearly half of all U.S. nurses and physicians, and has been linked to poor outcomes such as worse patient safety. The most common measure of burnout is the well-validated Maslach Burnout Inventory (MBI). However, the MBI is proprietary and carries licensing fees, posing challenges to routine or repeated assessment.<h4>Objective</h4>To compare a non-proprietary, single-item burnout measure to a single item from the MBI Emotional Exhaustion (MBI:EE) subscale that ...[more]

PMID: 25451989

Similar Datasets

Project description:BackgroundClinicians and healthcare staff report high levels of burnout. Two common burnout assessments are the Maslach Burnout Inventory (MBI) and a single-item, self-defined burnout measure. Relatively little is known about how the measures compare.ObjectiveTo identify the sensitivity, specificity, and concurrent validity of the self-defined burnout measure compared to the more established MBI measure.DesignCross-sectional survey (November 2016-January 2017).ParticipantsFour hundred forty-four primary care clinicians and 606 staff from three San Francisco Aarea healthcare systems.Main measuresThe MBI measure, calculated from a high score on either the emotional exhaustion or cynicism subscale, and a single-item measure of self-defined burnout. Concurrent validity was assessed using a validated, 7-item team culture scale as reported by Willard-Grace et al. (J Am Board Fam Med 27(2):229-38, 2014) and a standard question about workplace atmosphere as reported by Rassolian et al. (JAMA Intern Med 177(7):1036-8, 2017) and Linzer et al. (Ann Intern Med 151(1):28-36, 2009).Key resultsSimilar to other nationally representative burnout estimates, 52% of clinicians (95% CI: 47-57%) and 46% of staff (95% CI: 42-50%) reported high MBI emotional exhaustion or high MBI cynicism. In contrast, 29% of clinicians (95% CI: 25-33%) and 31% of staff (95% CI: 28-35%) reported "definitely burning out" or more severe symptoms on the self-defined burnout measure. The self-defined measure's sensitivity to correctly identify MBI-assessed burnout was 50.4% for clinicians and 58.6% for staff; specificity was 94.7% for clinicians and 92.3% for staff. Area under the receiver operator curve was 0.82 for clinicians and 0.81 for staff. Team culture and atmosphere were significantly associated with both self-defined burnout and the MBI, confirming concurrent validity.ConclusionsPoint estimates of burnout notably differ between the self-defined and MBI measures. Compared to the MBI, the self-defined burnout measure misses half of high-burnout clinicians and more than 40% of high-burnout staff. The self-defined burnout measure has a low response burden, is free to administer, and yields similar associations across two burnout predictors from prior studies. However, the self-defined burnout and MBI measures are not interchangeable.

Project description:BACKGROUND:Burnout among primary care physicians, advanced practice clinicians (nurse practitioners and physician assistants [APCs]), and staff is common and associated with negative consequences for patient care, but the association of burnout with characteristics of primary care practices is unknown. OBJECTIVE:To examine the association between physician-, APC- and staff-reported burnout and specific structural, organizational, and contextual characteristics of smaller primary care practices. DESIGN:Cross-sectional analysis of survey data collected from 9/22/2015-6/19/2017. SETTING:Sample of smaller primary care practices in the USA participating in a national initiative focused on improving the delivery of cardiovascular preventive services. PARTICIPANTS:10,284 physicians, APCs and staff from 1380 primary care practices. MAIN MEASURE:Burnout was assessed with a validated single-item measure. KEY RESULTS:Burnout was reported by 20.4% of respondents overall. In a multivariable analysis, burnout was slightly more common among physicians and APCs (physician vs. non-clinical staff, adjusted odds ratio [aOR]?=?1.26; 95% confidence interval [CI], 1.05-1.49, APC vs. non-clinical staff, aOR?=?1.34, 95% CI, 1.10-1.62). Other multivariable correlates of burnout included non-solo practice (2-5 physician/APCs vs. solo practice, aOR?=?1.71; 95% CI, 1.35-2.16), health system affiliation (vs. physician/APC-owned practice, aOR?=?1.42; 95%CI, 1.16-1.73), and Federally Qualified Health Center status (vs. physician/APC-owned practice, aOR?=?1.36; 95%CI, 1.03-1.78). Neither the proportion of patients on Medicare or Medicaid, nor practice-level patient volume (patient visits per physician/APC per day) were significantly associated with burnout. In analyses stratified by professional category, practice size was not associated with burnout for APCs, and participation in an accountable care organization was associated with burnout for clinical and non-clinical staff. CONCLUSIONS:Burnout is prevalent among physicians, APCs, and staff in smaller primary care practices. Members of solo practices less commonly report burnout, while members of health system-owned practices and Federally Qualified Health Centers more commonly report burnout, suggesting that practice level autonomy may be a critical determinant of burnout.

Project description:STUDY OBJECTIVES:A single-item sleep quality scale (SQS) was developed as a simple and practical sleep quality assessment and psychometrically evaluated. METHODS:SQS measurement characteristics were evaluated using the Pittsburgh Sleep Quality Index (PSQI) and morning questionnaire-insomnia (MQI) according to prespecified analysis plans in separate clinical studies of patients with insomnia and depression. Patients with insomnia (n = 70) received 4 weeks' usual care with an FDA-approved hypnotic agent; patients with depression (n = 651) received 8 weeks' active or experimental therapy. RESULTS:Concurrent criterion validity (correlation with measures of a similar construct) was demonstrated by strong (inverse) correlations between the SQS and MQI (week 1 Pearson correlation -.76) and PSQI (week 8 Goodman-Kruskal correlation -.92) sleep quality items in populations with insomnia and depression, respectively. In patients with depression, stronger correlations between the SQS and PSQI core sleep quality components versus other items supported convergent/divergent construct validity (similarity/dissimilarity to related/unrelated measures). Known-groups validity was evidenced by decreasing mean SQS scores across those who sleep normally, those borderline to having sleep problems, and those with problems sleeping. Test-retest reliability (intraclass correlation coefficient) was .62 during a 4-week period of sleep stability in patients with insomnia and .74 in stable patients with depression (1 week). Effect sizes (standardized response means) for change from baseline were 1.32 (week 1) and .67 (week 8) in populations with insomnia and depression, respectively. Mean SQS changes from baseline to week 8 convergently decreased across groups of patients with depression categorized by level of PSQI sleep quality improvement. CONCLUSIONS:The SQS possesses favorable measurement characteristics relative to lengthier or more frequently administered sleep questionnaires in patients with insomnia and depression. CLINICAL TRIAL REGISTRATION:Registry: ClincalTrials.gov, Title: Treatment of Patients With Major Depressive Disorder With MK0869, Identifier: NCT00034983, URL: https://clinicaltrials.gov/ct2/show/NCT00034983.

Project description:BackgroundThe investigation of patient-reported outcomes and psycho-oncological interventions mainly focuses on psychological distress or psychopathology. However, the recognition of the equal importance of positive mental health (PMH) has increased lately. The PMH-scale is a brief questionnaire allowing to assess well-being in individuals in the general population and in patients. Previous studies evaluated the psychometric properties of the PMH-scale using classical test theory (CTT). This study is the first to investigate the PMH-scale in patients with cancer using item analysis according to the Rasch model.MethodsIn total, N = 357 cancer patients participated in the study. A Rasch analysis of the PMH-scale was conducted including testing of unidimensionality, local independence, homogeneity and differential item functioning (DIF) with regard to age, gender, type of cancer, the presence of metastases, psycho-oncological support, and duration of disease. Additionally, the ordering of the item thresholds as well as the targeting of the scale were investigated.ResultsAfter excluding one misfitting item and accounting for local dependence by forming superitems, a satisfactory overall fit to the Rasch model was established (χ2 = 30.34, p = 0.21). The new PMH-8 scale proved to be unidimensional, and homogeneity of the scale could be inferred. All items showed ordered thresholds, there was no further item misfit. DIF was found for age, but as the impact of DIF was not substantial, no adjustment related to the age-DIF had to be made. The Person Separation Index (PSI = 0.89) was excellent, indicating excellent discriminatory power between different levels of positive mental health. Overall, the targeting of the PMH-8 was good for the majority of the present sample. However, at both ends of the scale item thresholds are missing as indicated by a slight floor effect (1.4%) and a considerable ceiling effect (9.8%).ConclusionsOverall, the results of the analysis according to the Rasch model support the use of the revised PMH-scale in a psycho-oncological context.

Project description:BackgroundWorkplace burnout among healthcare professionals is a critical public health concern. Few studies have examined organizational and individual factors associated with burnout across healthcare professional groups.ObjectiveThe purpose of this study was to examine the association between practice adaptive reserve (PAR) and individual behavioural response to change and burnout among healthcare professionals in primary care.DesignThis cross-sectional study used survey data from 154 primary care practices participating in the EvidenceNOW Heart of Virginia Healthcare initiative.ParticipantsWe analysed data from 1279 healthcare professionals in Virginia. Our sample included physicians, advanced practice clinicians, clinical support staff and administrative staff.Main measuresWe used the PAR instrument to measure organizational capacity for change and the Change Diagnostic Index© (CDI) to measure individual behavioural response, which achieved a 76% response rate. Logistic regression analysis was used to estimate the effects of PAR and CDI on burnout.Key resultsAs organizational capacity for change increased, burnout in healthcare professionals decreased by 51% (OR: 0.49; 95% CI, 0.33, 0.73). As healthcare professionals showed improved response toward change, burnout decreased by 84% (OR: 0.16; 95% CI, 0.11, 0.23). Analysis by healthcare professional type revealed a significant association between high organizational capacity for change, positive response to change and low burnout among administrative staff (OR: 2.92; 95% CI, 1.37, 6.24). Increased hours of work per week was associated with higher odds of burnout (OR: 1.07; 95% CI, 1.05, 1.10) across healthcare professional groups.ConclusionAs transformation efforts in primary care continue, it is critical to understand the influence of these initiatives on healthcare professionals' well-being. Efforts to reduce burnout among healthcare professionals are needed at both a system and organizational level. Building organizational capacity for change, supporting providers and staff during major change and consideration of individual workload may reduce levels of burnout.

Dataset Information

Using a single item to measure burnout in primary care staff: a psychometric evaluation.

Background

Objective

Design

Participants

Main methods

Key results

Conclusions

Publications

Using a single item to measure burnout in primary care staff: a psychometric evaluation.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets