Prospective monitoring of imaging guideline adherence by physicians in a surgical collaborative: comparison of statistical process control methods for detecting outlying performance.
Ontology highlight
ABSTRACT:
SUBMITTER: Inadomi M
PROVIDER: S-EPMC7218839 | biostudies-literature | 2020 May
REPOSITORIES: biostudies-literature
Publications
Prospective monitoring of imaging guideline adherence by physicians in a surgical collaborative: comparison of statistical process control methods for detecting outlying performance.
Inadomi Michael M Singh Karandeep K Qi Ji J Dunn Rodney R Linsell Susan S Denton Brian B Hurley Patrick P Kleer Eduardo E Montie James J Ghani Khurshid R KR
BMC medical informatics and decision making 20200513 1
<h4>Background</h4>Systematic, automated methods for monitoring physician performance are necessary if outlying behavior is to be detected promptly and acted on. In the Michigan Urological Surgery Improvement Collaborative (MUSIC), we evaluated several statistical process control (SPC) methods to determine the sensitivity and ease of interpretation for assessing adherence to imaging guidelines for patients with newly diagnosed prostate cancer.<h4>Methods</h4>Following dissemination of imaging gu ...[more]
Similar Datasets
Project description:Network meta-analysis (NMA) expands the scope of a conventional pairwise meta-analysis to simultaneously handle multiple treatment comparisons. However, some trials may appear to deviate markedly from the others and thus be inappropriate to be synthesized in the NMA. In addition, the inclusion of these trials in evidence synthesis may lead to bias in estimation. We call such trials trial-level outliers. To the best of our knowledge, while heterogeneity and inconsistency in NMA have been extensively discussed and well addressed, few previous papers have considered the proper detection and handling of trial-level outliers. In this paper, we propose several Bayesian outlier detection measures, which are then applied to a diabetes data set. Simulation studies comparing our approaches in both arm-based and contrast-based model settings are provided in two supporting appendices.
| S-EPMC4496319 | biostudies-literature
Project description:In this paper, we propose a method for automatically detecting the times during which game players exhibit specific behavior, such as when players commonly show excitement, concentration, immersion, and surprise. The proposed method detects such outlying behavior based on the game players' characteristics. These characteristics are captured non-invasively in a general game environment. In this paper, cameras were used to analyze observed data such as facial expressions and player movements. Moreover, multimodal data from the game players (i.e., data regarding adjustments to the volume and the use of the keyboard and mouse) was used to analyze high-dimensional game-player data. A support vector machine was used to efficiently detect outlying behaviors. We verified the effectiveness of the proposed method using games from several genres. The recall rate of the outlying behavior pre-identified by industry experts was approximately 70%. The proposed method can also be used for feedback analysis of various interactive content provided in PC environments.
| S-EPMC4690374 | biostudies-literature
Project description:BACKGROUND:Statistical Process Monitoring (SPM) is not typically used in traditional quality assurance of inpatient care. While SPM allows a rapid detection of performance deficits, SPM results strongly depend on characteristics of the evaluated process. When using SPM to monitor inpatient care, in particular the hospital risk profile, hospital volume and properties of each monitored performance indicator (e.g. baseline failure probability) influence the results and must be taken into account to ensure a fair process evaluation. Here we study the use of CUSUM charts constructed for a predefined false alarm probability within a single process, i.e. a given hospital and performance indicator. We furthermore assess different monitoring schemes based on the resulting CUSUM chart and their dependence on the process characteristics. METHODS:We conduct simulation studies in order to investigate alarm characteristics of the Bernoulli log-likelihood CUSUM chart for crude and risk-adjusted performance indicators, and illustrate CUSUM charts on performance data from the external quality assurance of hospitals in Bavaria, Germany. RESULTS:Simulating CUSUM control limits for a false alarm probability allows to control the number of false alarms across different conditions and monitoring schemes. We gained better understanding of the effect of different factors on the alarm rates of CUSUM charts. We propose using simulations to assess the performance of implemented CUSUM charts. CONCLUSIONS:The presented results and example demonstrate the application of CUSUM charts for fair performance evaluation of inpatient care. We propose the simulation of CUSUM control limits while taking into account hospital and process characteristics.
| S-EPMC6947979 | biostudies-literature
Project description:OBJECTIVES:Opioid-related deaths continue to increase in North America, an epidemic that was initiated by high rates of opioid prescribing. We designed a multifaceted, theory-informed Opioid Self-Assessment (OSA) package, to increase adherence to the Canadian Opioid Guideline among family physicians. This study aimed to assess changes in Canadian family physicians' knowledge and practices after completing the OSA package. DESIGN:We conducted a mixed-method evaluation using a pre-test and post-test design that involved the collection of both qualitative and quantitative data. SETTING:This research was conducted in the primary care setting in Ontario, Canada. PARTICIPANTS:We recruited a purposive sample of nine family physicians in Ontario who use long-term opioid therapy to treat patients with chronic pain. INTERVENTIONS:The OSA package included four components: an online knowledge test, an online learning programme, a safe medication practice self-assessment questionnaire and chart audit with feedback. OUTCOME MEASURES:Our measures included changes in knowledge, opioid safety practices and physicians' perspectives on the OSA package. RESULTS:We found statistically significant improvements between pre-test and post-test knowledge scores at both baseline and 6-month follow-up. Physicians' scores improved significantly on five of the seven core characteristics of the practice self-assessment questionnaire. On the chart audits, we observed an improvement in patient education between baseline and 6?months. Qualitative interviews showed that participants appreciated embedded resources in the OSA package. The completion of the package stimulated identification of gaps or deficits in practice and served as a useful reminder to discuss risk and safety with patients. Participants described the chart review as helpful in prompting discussions with their patients, identifying deficits and strengths and a 'primary motivator' for project participation. CONCLUSIONS:The OSA package has the potential to improve medication safety practices in primary care related to opioid monitoring and adherence to current opioid guidelines.
| S-EPMC7044850 | biostudies-literature
Project description:BackgroundPrescription of guideline-recommended medicines after acute coronary syndrome (ACS) has been suboptimal. Tools for improving the use of medications have been developed, but they mainly targeted physicians.ObjectiveWe evaluated the effects of reinforcement of patient and family education on the usage of guideline-recommended secondary prevention medications.MethodsThis was a retrospective analysis of a prospectively collected registry of patients with ACS who were admitted to a regional teaching hospital in Taiwan between February 2015 and April 2017. The control group included 76 patients discharged before implementing the electronic-based patient and family education (PFE) system. The intervention group included 206 patients discharged after implementation. The primary outcome was the prescription rate of all four guideline-recommended drugs. Predictors of adherence were also evaluated.ResultsThe study cohort included 282 ACS patients (188 men and 94 women) with a mean age of 68.5 years (standard deviation, 14.2). The intervention group patients were younger, had more family history of premature cardiovascular disease, more dyslipidemia, and underwent more reperfusion therapy. The intervention group was prescribed more guideline-recommended drugs than the control group: dual antiplatelet agents, 79.61% vs. 47.37% (p<0.001); statins, 74.76% vs. 34.21% (p<0.001); beta-blockers, 81.07% vs. 46.05% (p<0.001); angiotensin-converting enzyme inhibitors/angiotensin receptor blockers, 62.62% vs. 38.16% (p<0.001); and a combination of all four medications, 39.32% vs. 14.47% (p<0.001). After adjusting baseline variables, the PFE system remained a significant contributor to adherence to these drugs use (P = 0.02).ConclusionsReinforcement of patient education was associated with significant improvements in physicians' adherence to guideline-recommended medical therapy after acute coronary syndrome.
| S-EPMC6553689 | biostudies-literature
Project description:BackgroundThe WHO Surgical Safety Checklist reduces morbidity and mortality after surgery, but uptake remains challenging. In particular, low-income countries have been found to have lower rates of checklist use compared with high-income countries. The aim of this study was to determine the impact of educational workshops on Surgical Safety Checklist use implemented as part of a quality improvement initiative in five hospitals in Ethiopia that had variable experience with the Surgical Safety Checklist.MethodsFrom April 2019 to September 2020, each hospital implemented a 6-month surgical quality improvement programme, which included a Surgical Safety Checklist workshop. Statistical process control methodology was used to understand the variation in Surgical Safety Checklist compliance before and after workshops and a time-series analysis was performed using population-averaged generalized estimating equation Poisson regression. Checklist compliance was defined as correctly completing a sign in, timeout, and sign out. Incidence rate ratios of correct checklist use pre- and post-intervention were calculated and the change in mean weekly compliance was predicted.ResultsChecklist compliance data were obtained from 2767 operations (1940 (70 per cent) pre-intervention and 827 (30 per cent) post-intervention). Mean weekly checklist compliance improved from 27.3 to 41.2 per cent (mean difference 13.9 per cent, P = 0.001; incidence rate ratio 1.51, P = 0.001). Hospitals with higher checklist compliance at baseline had the greatest overall improvements in compliance, more than 50 per cent over pre-intervention, while low-performing hospitals showed no improvement.ConclusionSurgical Safety Checklist workshops improved checklist compliance in hospitals with some experience with its use. Workshops had little effect in hospitals unfamiliar with the Surgical Safety Checklist, emphasizing the importance of multifactorial interventions and culture-change approaches. In receptive facilities, short workshops can accelerate behaviour change.
| S-EPMC10564401 | biostudies-literature
Project description:BackgroundAntipsychotics are frequently prescribed to children and adolescents for nonpsychotic indications. Guidelines recommend regularly assessing treatment response and adverse effects and the ongoing need for their use. We aimed to assess adherence to recommendations of available guidelines regarding monitoring antipsychotic use and to test the influence of children's age, sex, intelligence quotient, and diagnosis on adherence.MethodsWe reviewed 426 medical records from 26 centers within 3 large Dutch child and adolescent psychiatry organizations, excluding children with schizophrenia, psychosis, mania, or an intelligence quotient below 70. We investigated whether there was regular assessment of treatment response, adverse events (physical and laboratory), and at least annual discussion of the need of continued use.ResultsOn average, treatment response was assessed in 69.3% of the recommended treatment periods, height in 25.6%, weight in 30.6%, blood pressure in 20.6%, evaluation of adverse events in 19.4%, and cardiometabolic measures in 13.7%; discontinuation and/or continued need was discussed at least annually in 36.2%. Extrapyramidal and prolactin-related adverse effects, waist circumference, glucose, and lipids were rarely investigated. Higher age was associated with lower rates of assessment of treatment response. Most antipsychotics were prescribed long-term. In those children with sufficient documentation of the course of treatment, 57.7% was still using an antipsychotic 3 years after initiation.ConclusionsOur findings indicate insufficient adherence to guideline recommendations for monitoring antipsychotic use in children and adolescents, as well as long duration of use in the majority of children. Especially, older children are at higher risk of receiving suboptimal care.
| S-EPMC7752226 | biostudies-literature
Project description:Unsupervised process monitoring for fault detection and data cleaning is underdeveloped for municipal wastewater treatment plants (WWTPs) due to the complexity and volume of data produced by sensors, equipment, and control systems. The goal of this work is to extensively test and tune an unsupervised process monitoring method that can promptly identify faults in a full-scale decentralized WWTP prior to significant system changes. Adaptive dynamic principal component analysis (AD-PCA) is a dimension reduction method modified to address autocorrelation and nonstationarity in multivariate processes and is evaluated in this work for its ability to continuously detect drift, shift, and spike faults. For spike faults, univariate drift faults, and multivariate shift faults, implementing AD-PCA on data that are subset by treatment processes and operating states with significant differences in covariates and whose model parameters use week-long training windows, moderate cumulative variance, and a high threshold for detection was found to detect faults prior to existing operational thresholds. To improve the consistency with which the AD-PCA method detects out-of-control conditions in real time, additional work is needed to remove outliers prior to model fitting and to detect multivariate drift faults in which the covariates change slowly.
| S-EPMC10928711 | biostudies-literature
Project description:Background and purposeReduced toxicity while maintaining loco-regional control rates have been reported after reducing planning target volume (PTV) margins for head-and-neck radiotherapy (HNRT). In this context, quantifying anatomical changes to monitor patient treatment is preferred. This retrospective feasibility study investigated the application of deformable image registration (DIR) and Exponentially Weighted Moving Average (EWMA) Statistical Process Control (SPC) charts for this purpose.Materials and methodsDIR between the computed tomography for treatment planning (pCT) images of twelve patients and their daily on-treatment cone beam computed tomography (CBCT) images quantified anatomical changes during treatment. EWMA charts investigated corresponding trends. Uncertainty analysis provided 90% confidence limits which were used to confirm whether a trend previously breached a threshold.ResultsTrends in patient positioning reproducibility occurred before the end of treatment week four in 54% of cases. Using SPC process limits, only 24% of these were confirmed at a 90% confidence level before the end of treatment. Using an a priori clinical limit of 2 mm, absolute changes in patient pose were detected in 39% of cases, of which 82% were confirmed. Soft tissue trends outside SPC process limits occurring before the end of treatment week four were confirmed in 90% of cases.ConclusionStructure specific action thresholds enabled detection of systematic anatomical changes during the first four weeks of treatment. Investigation of the dosimetric impact of the observed deviations is needed to show the efficacy of SPC to timely indicate required treatment adaptation and provide a safety net for PTV margin reduction.
| S-EPMC7807752 | biostudies-literature
Project description:Adherence to hypertension guidelines in the outpatient setting is low.To evaluate adherence to JNC VII guidelines in nursing home patients.Data were obtained from the 2004 National Nursing Home Survey (NNHS), a nationally representative sample of US nursing homes. Patients with hypertension were identified using ICD-9 codes. Adherence to JNC VII guidelines was defined as the use of a thiazide diuretic in patients without a compelling indication for a different class of antihypertensive medication, such as diabetes, chronic kidney disease, coronary artery disease, congestive heart failure, or a history of stroke.There were 13,507 patients in the 2004 NNHS survey, of whom 7,129 had hypertension.Of these 7,129 hypertensive patients, only 12.6% were on a thiazide. Out of the 7,129 hypertensive patients, 3,113 did not have diabetes, chronic kidney disease, coronary artery disease, congestive heart failure, or a history of stroke. Of these 3,113 patients, only 13.9% were on a thiazide. After excluding patients with a potential contraindication to a diuretic, such as hospice care or incontinence, only 18% were prescribed a thiazide. Of the 3,113 patients, 1,148 were on a single class of antihypertensive and more were prescribed a beta blocker, ACE inhibitor, calcium channel blocker, loop diuretic, and ARB than a thiazide diuretic.Adherence to hypertension guidelines among nursing home patients is low. The appropriate use of thiazide diuretics could reduce costs and improve blood pressure control and patient outcomes.
| S-EPMC2659159 | biostudies-other