Dataset Information

Association Between Surgeon Technical Skills and Patient Outcomes.

ABSTRACT:

Importance

Postoperative complications remain common after surgery, but little is known about the extent of variation in operative technical skill and whether variation is associated with patient outcomes.

Objectives

To examine the (1) variation in technical skill scores of practicing surgeons, (2) association between technical skills and patient outcomes, and (3) amount of variation in patient outcomes explained by a surgeon's technical skill.

Design, setting, and participants

In this quality improvement study, 17 practicing surgeons submitted a video of a laparoscopic right hemicolectomy that was then rated by at least 10 blinded peer surgeons and 2 expert raters. The association between surgeon technical skill scores and risk-adjusted outcomes was examined using data from the American College of Surgeons National Surgical Quality Improvement Program. The association between technical skill scores and outcomes was examined for colorectal procedures and noncolorectal procedures (ie, assessed on whether technical skills demonstrated during colectomy were associated with patient outcomes across other cases). In addition, the proportion of patient outcomes explained by technical skill scores was examined using robust regression techniques. The study was conducted from September 23, 2016, to February 10, 2018; data analysis was performed from November 2018 to January 2019.

Exposures

Colorectal and noncolorectal procedures.

Main outcomes and measures

Any complication, mortality, unplanned hospital readmission, unplanned reoperation related to principal procedure, surgical site infection, and death or serious morbidity.

Results

Of the 17 surgeons included in the study, 13 were men (76%). The participants had a range from 1 to 28 years in surgical practice (median, 11 years). Based on 10 or more reviewers per video and with a maximum quality score of 5, overall technical skill scores ranged from 2.8 to 4.6. From 2014 to 2016, study participants performed a total of 3063 procedures (1120 colectomies). Higher technical skill scores were significantly associated with lower rates of any complication (15.5% vs 20.6%, P = .03; Spearman rank-order correlation coefficient r = -0.54, P = .03), unplanned reoperation (4.7% vs 7.2%, P = .02; r = -0.60, P = .01), and a composite measure of death or serious morbidity (15.9% vs 21.4%, P = .02; r = -0.60, P = .01) following colectomy. Similar associations were found between colectomy technical skill scores and patient outcomes for all types of procedures performed by a surgeon. Overall, technical skill scores appeared to account for 25.8% of the variation in postcolectomy complication rates and 27.5% of the variation when including noncolectomy complication rates.

Conclusions and relevance

The findings of this study suggest that there is wide variation in technical skill among practicing surgeons, accounting for more than 25% of the variation in patient outcomes. Higher colectomy technical skill scores appear to be associated with lower complication rates for colectomy and for all other procedures performed by a surgeon. Efforts to improve surgeon technical skills may result in better patient outcomes.

SUBMITTER: Stulberg JJ

PROVIDER: S-EPMC7439214 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:The National Surgical Adjuvant Breast and Bowel Project B-32 trial was designed to determine whether sentinel lymph node resection can achieve the same therapeutic outcomes as axillary lymph node resection but with fewer side effects and is one of the most carefully controlled and monitored randomized trials in the field of surgical oncology. We evaluated the relationship of surgeon trial preparation, protocol compliance audit, and technical outcomes.Preparation for this trial included a protocol manual, a site visit with key participants, an intraoperative session with the surgeon, and prerandomization documentation of protocol compliance. Training categories included surgeons who submitted material on five prerandomization surgeries and were trained by a core trainer (category 1) or by a site trainer (category 2). An expedited group (category 3) included surgeons with extensive experience who submitted material on one prerandomization surgery. At completion of training, surgeons could accrue patients. Two hundred twenty-four surgeons enrolled 4994 patients with breast cancer and were audited for 94 specific items in the following four categories: procedural, operative note, pathology report, and data entry. The relationship of training method; protocol compliance performance audit; and the technical outcomes of the sentinel lymph node resection rate, false-negative rate, and number of sentinel lymph nodes removed was determined. All statistical tests were two-sided.The overall sentinel lymph node resection success rate was 96.9% (95% confidence interval [CI] = 96.4% to 97.4%), and the overall false-negative rate was 9.5% (95% CI = 7.4% to 12.0%), with no statistical differences between training methods. Overall audit outcomes were excellent in all four categories. For all three training groups combined, a statistically significant positive association was observed between surgeons' average number of procedural errors and their false-negative rate (rho = +0.188, P = .021).All three training methods resulted in uniform and high overall sentinel lymph node resection rates. Subgroup analyses identified some variation in false-negative rates that were related to audited outcome performance measures.

Project description:ImportanceDespite growing interest from various surgical societies and patient safety organizations, concerns remain that volume-based credentialing standards are arbitrary and may fail to recognize a surgeon's full scope of practice.ObjectiveTo evaluate whether surgeon experience with related procedures was associated with better outcomes for pancreaticoduodenectomy compared with procedure-specific experience alone.Design, setting, and participantsThis proof-of-concept cohort study used the all-payer State Inpatient Databases from 6 geographically diverse states to identify all operations for surgeons who performed at least 1 pancreaticoduodenectomy from January 1, 2012, to December 31, 2014. Each surgeon's mean annual volume for pancreaticoduodenectomies and related complex hepatopancreatobiliary (HPB) procedures was calculated. Outcomes for surgeons above and below a threshold of 12 pancreaticoduodenectomies per year were evaluated. Whether related HPB procedure volume was also associated with better outcomes for surgeons not meeting the procedure-specific threshold was also evaluated. Data were analyzed from March 2 through 20, 2019.Main outcomes and measuresThirty-day mortality and complications.ResultsThe study cohort included 176 043 patients, of whom 92 064 were female (52.3%), with a mean (SD) age of 59 (17) years. Within 270 hospitals, only 54 of 1028 surgeons (5.3%) met the mean pancreaticoduodenectomy volume threshold from 2012 to 2014. In-hospital mortality after pancreaticoduodenectomy was lower for surgeons who performed 12 or more procedures per year (1.8% [95% CI, 1.1%- 2.4%] vs 4.7% [95% CI, 4.0%-5.4%]; odds ratio, 0.32; 95% CI, 0.21-0.50). However, in-hospital mortality varied 7-fold among surgeons who did not meet the threshold (1.2% [95% CI, 0.8%-1.6%] to 8.4% [95% CI, 7.9%-8.9%]). Increasing HPB case volume was associated with better outcomes for pancreaticoduodenectomy in this group. For example, surgeons performing 2 or fewer pancreaticoduodenectomies annually would need to perform an additional 27 related HPB procedures to match the in-hospital mortality rate of surgeons performing 12 or more pancreaticoduodenectomies.Conclusions and relevanceIn this proof-of-concept cohort study, few surgeons met even modest annual volume thresholds for pancreaticoduodenectomy. The findings suggest that inclusion of related procedure volumes may safely expand the cohort of surgeons credentialed to perform certain procedures under volume-based standards.

Project description:ImportanceRisk-adjusted variation in surgeon outcomes has been traditionally explained by surgeon volume and hospital infrastructure, yet it is unclear how a surgeon's operative proficiency directly contributes to their patients' outcomes.ObjectiveTo assess the variation of surgeons' operative proficiency and investigate its association with surgical outcomes.Design, setting, and participantsThis case series was a retrospective analysis of all digit replantations and revascularizations at a single US university medical center between January 2000 and August 2020. Surgeons were assigned a proficiency score based on the expected procedure difficulty and outcomes from a sample of their cases. Surgeon proficiency scores were then used to determine associations with outcomes from subsequent cases. The expected difficulty of each case was calculated using a novel scoring system that applied pooled relative risks from a meta-analysis of risk factors for replantation and revascularization failure.ExposuresDigit replantation and revascularization.Main outcomes and measuresDigit survival at 1-month follow up (case success) and number of complications.ResultsA total of 145 patients and 226 digits were treated by 11 surgeons with training in hand or microsurgery (mean [SD] age, 41.9 [15.2] years; 204 [90%] men); there were 116 replantations and 110 revascularizations. Surgeon proficiency scores ranged from 1.3 to 5.7, with a mean (SD) of 3.4 (1.4). Case success rates among surgeons varied from 20.0% to 90.5%, with a mean (SD) of 64.9%. Higher proficiency scores were associated with fewer case failures: each point increase was associated with 40% decreased odds of failure (odds ratio, 0.60; 95% CI, 0.38-0.94). Every 3-point increase in proficiency score was associated with 1 less complication (effect estimate, -0.29; 95% CI, -0.56 to 0.02). Surgeon proficiency score had a greater association with case failure than surgeon volume (16.7% vs 12.0%). The final model's association with case failure had an area under the receiver operating characteristics curve of 0.93.Conclusions and relevanceOperative proficiency varied widely among practicing surgeons and accounted for 17% of estimative ability for success of digit replantation and revascularization. Greater surgeon proficiency was associated with better outcomes, indicating that the value of surgical care may be optimized by improving surgeon proficiency.

Project description:BackgroundDespite potential concerns regarding their validity, physician-rating websites continue to grow in number and utilization and feature prominently on major search engines, potentially affecting patient decision-making regarding physician selection.Questions/purposesWe sought to determine whether patient ratings on public physician-rating websites correlate with surgeon-specific outcomes for high-volume total knee replacement (TKR) surgeons in New York State (NYS) from 2010 to 2012.MethodsOnline patient ratings were compared to surgeon-specific outcomes from the Statewide Planning and Research Cooperative System (SPARCS) database from the NYS Department of Health. For each surgeon, we determined the infection rate, re-admission rate, and revision surgery rate within the study period, as well as the mean inpatient length of stay, for TKR from the SPARCS database. Online ratings were collected from two physician-rating websites (Vitals.com and HealthGrades.com).ResultsOne hundred seventy-four high-volume TKR surgeons were identified in NYS from 2010 to 2012. The mean rates of in-hospital infection, 90-day infection, 30-day re-admission, 90-day re-admission, and revision surgery were 0.25, 1.00, 4.89, 8.43, and 1.31%, respectively. The mean number of ratings for individual surgeons on HealthGrades.com and Vitals.com were 24.0 (range: 0 to 109) and 19.3 (range: 0 to 114), respectively, and mean overall ratings were 4.2 and 4.1 (out of 5) stars, respectively. As with online patient ratings of individual surgeons, variability was observed in the total adverse event rate distribution for individual surgeons. Despite sufficient variability in both online patient rating and surgeon-specific outcomes for high-volume TKR surgeons in NYS, no correlation was observed.ConclusionThere was no correlation between surgeon-specific TKR outcome measures and online patient ratings. We therefore advise that patients exert caution when interpreting ratings on these websites.