Dataset Information

Do Experts Understand Performance Measures? A Mixed-Methods Study of Infection Preventionists.

ABSTRACT: OBJECTIVE Central line-associated bloodstream infection (CLABSI) is associated with significant morbidity and mortality. Despite a nationwide decline in CLABSI rates, individual hospital success in preventing CLABSI is variable. Difficulty in interpreting and applying complex CLABSI metrics may explain this problem. Therefore, we assessed expert interpretation of CLABSI quality data. DESIGN:Cross-sectional survey PARTICIPANTS. Members of the Society for Healthcare Epidemiology of America (SHEA) Research Network (SRN) METHODS. We administered a 10-item test of CLABSI data comprehension. The primary outcome was percent correct of attempted questions pertaining to the CLABSI data. We also assessed expert perceptions of CLABSI reporting. RESULTS The response rate was 51% (n=67).Among experts, the average proportion of correct responses was 73% (95% confidence interval [CI], 69%-77%). Expert performance on unadjusted data was significantly better than risk-adjusted data (86% [95% CI, 81%-90%] vs 65% [95% CI, 60%-70%]; P<.001). Using a scale of 1 to 100 (0, never reliable; 100, always reliable), experts rated the reliability of CLABSI data as 61. Perceived reliability showed a significant inverse relationship with performance (r=-0.28; P=.03), and as interpretation of data improved, perceptions regarding reliability of those data decreased. Experts identified concerns regarding understanding and applying CLABSI definitions as barriers to care. CONCLUSIONS Significant variability in the interpretation of CLABSI data exists among experts. This finding is likely related to data complexity, particularly with respect to risk-adjusted data. Improvements appear necessary in data sharing and public policy efforts to account for this complexity. Infect Control Hosp Epidemiol 2018;39:71-76.

SUBMITTER: Govindan S

PROVIDER: S-EPMC7181973 | biostudies-literature | 2018 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Do Experts Understand Performance Measures? A Mixed-Methods Study of Infection Preventionists.

Govindan Sushant S Wallace Beth B Iwashyna Theodore J TJ Chopra Vineet V

Infection control and hospital epidemiology 20171205 1

OBJECTIVE Central line-associated bloodstream infection (CLABSI) is associated with significant morbidity and mortality. Despite a nationwide decline in CLABSI rates, individual hospital success in preventing CLABSI is variable. Difficulty in interpreting and applying complex CLABSI metrics may explain this problem. Therefore, we assessed expert interpretation of CLABSI quality data.<h4>Design</h4>Cross-sectional survey PARTICIPANTS. Members of the Society for Healthcare Epidemiology of America ...[more]

PMID: 29202884

Similar Datasets

Project description:ObjectiveTo describe patients' perceived value and use of quality measures in evaluating and choosing community pharmacies.DesignFocus group methodology was combined with a survey tool. During the focus groups, participants assessed the value of the Pharmacy Quality Alliance's quality measures in evaluating and choosing a pharmacy. Also, participants completed questionnaires rating their perceived value of quality measures in evaluating a pharmacy (1 being low value and 5 being high) or choosing a pharmacy (yes/no). Thematic analysis and descriptive statistics were used to analyse the focus groups and surveys, respectively.SettingSemistructured focus groups were conducted in a private meeting space of an urban and a rural area of a Mid-western State in the USA.ParticipantsThirty-four adults who filled prescription medications in community pharmacies for a chronic illness were recruited in community pharmacies, senior centres and public libraries.ResultsWhile comments indicated that all measures were important, medication safety measures (eg, drug-drug interactions) were valued more highly than others. Rating of quality measure utility in evaluating a pharmacy ranged from a mean of 4.88 ('drug-drug interactions') to a mean of 4.0 ('absence of controller therapy for patients with asthma'). Patients were hesitant to use quality information in choosing a pharmacy (depending on the participant's location) but might consider if moving to a new area or having had a negative pharmacy experience. Use of select quality measures to choose a pharmacy ranged from 97.1% of participants using 'drug-drug interactions' (medication safety measure) to 55.9% using 'absence of controller therapy for patients with asthma'.ConclusionsThe study participants valued quality measures in evaluating and selecting a community pharmacy, with medication safety measures valued highest. The participants reported that the quality measures would not typically cause a switch in pharmacy but might influence their selection in certain situations.

Project description:New models of primary care include patient-reported outcome measures (PROMs) to promote patient-centered care. PROMs provide information on patient functional status and well-being, can be used to enhance care quality, and are proposed for use in assessing performance. Our objective was to identify a short list of candidate PROMs for use in primary care practice and to serve as a basis for performance measures (PMs). We used qualitative and quantitative methods to identify relevant patient-reported outcome (PRO) domains for use in performance measurement (PRO-PM) and their associated PROMs. We collected data from key informant groups: patients (n = 13; one-on-one and group interviews; concept saturation analysis), clinical thought leaders (n = 9; group discussions; thematic analysis), primary care practices representatives (n = 37; six focus groups; thematic analysis), and primary care payer representatives (n = 10; 12-question survey; frequencies of responses). We merged the key informant group information with findings from environmental literature scans. We conducted a targeted evidence review of measurement properties for candidate PROMs. We used a scoping review and key informant groups to identify PROM evaluation criteria, which were linked to the National Quality Forum measure evaluation criteria. We developed a de novo schema to score candidate PROMs against our criteria. We identified four PRO domains and 10 candidate PROMs: 3 for depressive symptoms, 2 for physical function, 3 for self-efficacy, 2 for ability to participate. Five PROMs met ≥ 70% of the evidence criteria for three PRO domains: PHQ-9 or PROMIS Depression (depression), PF-10 or PROMIS-PF (physical functioning), and PROMIS Self-Efficacy for Managing Treatments and Medications (self-efficacy). The PROMIS Ability to Participate in Social Roles and Activities met 68% of our criteria and might be considered for inclusion. Existing evidence and key informant data identified 5 candidate PROMs to use in primary care. These instruments can be used to develop PRO-PMs.

Project description:BackgroundTimely intrapartum referral between facilities is pivotal in reducing maternal/neonatal mortality and morbidity but is distressing to women, resource-intensive and likely to cause delays in care provision. We explored the complexities around referrals to gain understanding of the characteristics, experiences and outcomes of those being transferred.MethodsWe used a mixed-method parallel convergent design, in Tanzania and Zambia. Quantitative data were collected from a consecutive, retrospective case-note review (target, n?=?2000); intrapartum transfers and stillbirths were the outcomes of interest. A grounded theory approach was adopted for the qualitative element; data were collected from semi-structured interviews (n?=?85) with women, partners and health providers. Observations (n?=?33) of transfer were also conducted. Quantitative data were analysed descriptively, followed by binary logistic regression models, with multiple imputation for missing data. Qualitative data were analysed using Strauss's constant comparative approach.ResultsIntrapartum transfer rates were 11% (111/998; 2 unknown) in Tanzania and 37% (373/996; 1 unknown) in Zambia. Main reasons for transfer were prolonged/obstructed labour and pre-eclampsia/eclampsia. Women most likely to be transferred were from Zambia (as opposed to Tanzania), HIV positive, attended antenatal clinic <?4 times and living >?30?min away from the referral hospital. Differences were observed between countries. Of those transferred, delays in care were common and an increase in poor outcomes was observed. Qualitative findings identified three categories: social threats to successful transfer, barriers to timely intrapartum care and reparative interventions which were linked to a core category: journey of vulnerability.ConclusionAlthough intrapartum transfers are inevitable, modifiable factors exist with the potential to improve the experience and outcomes for women. Effective transfers rely on adequate resources, effective transport infrastructures, social support and appropriate decision-making. However, women's (and families) vulnerability can be reduced by empathic communication, timely assessment and a positive birth outcome; this can improve women's resilience and influence positive decision-making, for the index and future pregnancy.

Project description:OBJECTIVES:To develop outcome measures to assess practical management of primary surgical wounds and patient experience. DESIGN:Mixed methods, including qualitative interviews and data extraction from published randomised controlled trials (RCTs). SETTING:Two university-teaching NHS hospitals and three district NHS hospitals in the South West and Midlands regions of England. PARTICIPANTS:Sixty-four patients and 15 healthcare professionals from abdominal general surgical specialities and obstetrics (caesarean section). METHODS:Measures were developed according to standard guidelines to identify issues relevant to patients' experiences of surgical wounds and dressings, including analysis of existing RCT outcomes and semi-structured interviews. These were written into provisional questionnaire items for a single outcome measure. Cognitive interviews with patients and healthcare professionals assessed face validity, acceptability and relevance. Findings from interviews were regularly shared with the study team who suggested amendments to modify and reword items to improve understanding before further iterative testing with patients and healthcare professionals. RESULTS:Analyses of existing RCT outcomes and interviews produced a total of 69 issues. Pretesting and iterative revision established the need for two separate measures. One measure addresses healthcare professionals' experience of wound management in two key areas: exudate and its impact, and allergic reactions to the dressing. The other measure addresses patients' experience of wounds in seven key areas: wound comfort, dressing removal, dressings to protect the wound, impact on daily activities, ease of movement, anxiety about the wound and satisfaction with dressing. Each measure took less than five?min to complete and both were understood and acceptable to patients and healthcare professionals. CONCLUSION:This in-depth study has developed two measures to assess practical management of primary surgical wounds and patient experience. Further work to test their validity, reliability and application to other settings is now required. TRIAL REGISTRATION NUMBER:HTA - 12/200/04; Pre-results.

Project description:ObjectivesTo examine the acceptability and validity of two patient-reported outcome measures (PROMs) for adult acne, comparing them to the validated Acne-specific Quality of Life (Acne-QoL) measure.DesignMixed-methods validation study.SettingParticipants were recruited by (1) mail-out through primary care if they had ever consulted for acne and received a prescription for acne treatment within the last 6 months, (2) opportunistically in secondary care and (3) poster advertisement in community venues.Participants221 (204 quantitative and 17 qualitative) participants with acne, aged 18-50 years.Outcome measuresQuantitative sub-study participants completed Acne-QoL, Skindex-16 and Comprehensive Acne Quality of Life Scale (CompAQ) at baseline, 24 hours and 6 weeks. Qualitative sub-study participants took part in cognitive think-aloud interviews, while completing the same measures. Transcribed audio recordings were analysed using inductive thematic analysis.ResultsQuantitative analyses suggested high internal consistency (Cronbach's alpha 0.74-0.96) and reliability (intraclass correlation coefficient values 0.88-0.97) for both questionnaires. Both scales showed floor effects on some subdomains. Skindex-16 and CompAQ showed good evidence of construct validity when compared with Acne-QoL with Spearman's correlation coefficients 0.54-0.81, and good repeatability over 24 hours.Qualitative data uncovered wide-ranging views regarding usability and acceptability. Interviewees held strong but differing views about layout, question/response wording, redundant/similar questions and guidance notes. Similarly, interviewees differed in perceptions of acceptability of the different scales, particularly on relatability of questions and emotive reactions to scales.ConclusionsAll PROMs performed well in statistical analyses. No PROM showed superior usability and acceptability in the qualitative study. Any PROM should be acceptable for further research in adult acne but researchers should consider the different domains and whether they will measure only facial or facial and trunk acne before making a selection. A new PROM or further evaluation of novel PROMs may be beneficial.

Project description:IntroductionResearch on binge eating disorder continues to evolve and advance our understanding of recurrent binge eating.MethodsThis mixed-methods, cross-sectional survey aimed to collect information from experts in the field about clinical aspects of adult binge eating disorder pathology. Fourteen experts in binge eating disorder research and clinical care were identified based on receipt of relevant federal funding, PubMed-indexed publications, active practice in the field, leadership in relevant societies, and/or clinical and popular press distinction. Anonymously recorded semi-structured interviews were analyzed by ≥2 investigators using reflexive thematic analysis and quantification.ResultsIdentified themes included: (1) obesity (100%); (2) intentional/voluntary or unintentional/involuntary food/eating restriction (100%); (3) negative affect, emotional dysregulation, and negative urgency (100%); (4) diagnostic heterogeneity and validity (71%); (5) paradigm shifts in understanding binge eating disorder (29%); and (6) research gaps/future directives (29%).DiscussionOverall, experts call for a better understanding of the relationship between binge eating disorder and obesity, including a need for clarification around the extent to which the two health issues are separate vs. related/overlapping. Experts also commonly endorse food/eating restriction and emotion dysregulation as important components of binge eating disorder pathology, which aligns with two common models of binge eating disorder conceptualization (e.g., dietary restraint theory and emotion/affect regulation theory). A few experts spontaneously identified several paradigm shifts in our understanding of who can have an eating disorder (beyond the anorexi-centric "thin, White, affluent, cis-gendered neurotypical female" stereotype), and the various factors that can drive binge eating. Experts also identified several areas where classification issues may warrant future research. Overall, these results highlight the continual advancement of the field to better understand adult binge eating disorder as an autonomous eating disorder diagnosis.

Project description:BackgroundHealth care systems worldwide are struggling to keep rising costs at bay with only modest outcome improvement among many diseases. Digitization with technologies like Artificial Intelligence or Machine Learning algorithms might address this. Although digital technologies have been successfully applied in clinical studies the effect on the overall health care system so far was limited. The regulatory ecosystem or data privacy might be responsible, but other reasons may also predominate.ObjectiveWe analyzed how the digitization of the German health care market is currently perceived among different stakeholders and investigated reasons for its slow adaption.MethodsThis was a mixed methods study split into a qualitative Part A using the conceptual approach of the Grounded Theory and a quantitative Part B using the Delphi method. For Part A we interviewed experts in the health care system and converted the results into 17 hypotheses. The Delphi method consisted of an online survey which was sent to the participants via email and was available for three months. For the assessment of the 17 hypotheses, the participants were given a six-point Likert scale. The participants were grouped into patients, physicians, and providers of services within the German health care market.ResultsThere was a strong alignment of opinions on the hypotheses between experts (N=21) and survey participants (N=733), with 70.5% overall agreement on 12/17 hypotheses. Physicians demonstrated the lowest level of agreement with the expert panel at 88% (15/17) disagreement, with the hypotheses "H8: Digitization in the health care system will free up jobs," and "H6: Digitization in the health care system will empower the patients," perceived to be in profound disagreement (P=.036 and P<.001, respectively).ConclusionsDespite the firm agreement among participants and experts regarding the impact of digitization on the health care system, physicians demonstrated a more negative attitude. We assume that this might be a factor contributing to the slow adoption of digitization in practice. Physicians might be struggling with changing power structures, so future measures to transform the market should involve them to a larger degree.

Dataset Information

Do Experts Understand Performance Measures? A Mixed-Methods Study of Infection Preventionists.

Publications

Do Experts Understand Performance Measures? A Mixed-Methods Study of Infection Preventionists.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets