Dataset Information

Using objective robotic automated performance metrics and task-evoked pupillary response to distinguish surgeon expertise.

ABSTRACT:

Purpose

In this study, we investigate the ability of automated performance metrics (APMs) and task-evoked pupillary response (TEPR), as objective measures of surgeon performance, to distinguish varying levels of surgeon expertise during generic robotic surgical tasks. Additionally, we evaluate the association between APMs and TEPR.

Methods

Participants completed ten tasks on a da Vinci Xi Surgical System (Intuitive Surgical, Inc.), each representing a surgical skill type: EndoWrist^® manipulation, needle targeting, suturing/knot tying, and excision/dissection. Automated performance metrics (instrument motion tracking, EndoWrist^® articulation, and system events data) and TEPR were recorded by a systems data recorder (Intuitive Surgical, Inc.) and Tobii Pro Glasses 2 (Tobii Technologies, Inc.), respectively. The Kruskal-Wallis test determined significant differences between groups of varying expertise. Spearman's rank correlation coefficient measured associations between APMs and TEPR.

Results

Twenty-six participants were stratified by robotic surgical experience: novice (no prior experience; n = 9), intermediate (< 100 cases; n = 9), and experts (≥ 100 cases; n = 8). Several APMs differentiated surgeon experience including task duration (p < 0.01), time active of instruments (p < 0.03), linear velocity of instruments (p < 0.04), and angular velocity of dominant instrument (p < 0.04). Task-evoked pupillary response distinguished surgeon expertise for three out of four task types (p < 0.04). Correlation trends between APMs and TEPR revealed that expert surgeons move more slowly with high cognitive workload (ρ < - 0.60, p < 0.05), while novices move faster under the same cognitive experiences (ρ > 0.66, p < 0.05).

Conclusions

Automated performance metrics and TEPR can distinguish surgeon expertise levels during robotic surgical tasks. Furthermore, under high cognitive workload, there can be a divergence in robotic movement profiles between expertise levels.

SUBMITTER: Nguyen JH

PROVIDER: S-EPMC6980922 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ObjectiveSurgical efficiency and variability are critical contributors to optimal outcomes, patient experience, care team experience, and total cost to treat per disease episode. Opportunities remain to develop scalable, objective methods to quantify surgical behaviors that maximize efficiency and reduce variability. Such objective measures can then be used to provide surgeons with timely and user-specific feedbacks to monitor performances and facilitate training and learning. In this study, we used objective task-level analysis to identify dominant contributors toward surgical efficiency and variability across the procedural steps of robotic-assisted sleeve gastrectomy (RSG) over a five-year period for a single surgeon. These results enable actionable insights that can both complement those from population level analyses and be tailored to an individual surgeon's practice and experience.MethodsIntraoperative video recordings of 77 RSG procedures performed by a single surgeon from 2015 to 2019 were reviewed and segmented into surgical tasks. Surgeon-initiated events when controlling the robotic-assisted surgical system were used to compute objective metrics. A series of multi-staged regression analysis were used to determine: if any specific tasks or patient body mass index (BMI) statistically impacted procedure duration; which objective metrics impacted critical task efficiency; and which task(s) statistically contributed to procedure variability.ResultsStomach dissection was found to be the most significant contributor to procedure duration (β = 0.344, p< 0.001; R = 0.81, p< 0.001) followed by surgical inactivity and stomach stapling. Patient BMI was not found to be statistically significantly correlated with procedure duration (R = -0.01, p = 0.90). Energy activation rate, a robotic system event-based metric, was identified as a dominant feature in predicting stomach dissection duration and differentiating earlier and later case groups. Reduction of procedure variability was observed between earlier (2015-2016) and later (2017-2019) groups (IQR = 14.20 min vs. 6.79 min). Stomach dissection was found to contribute most to procedure variability (β = 0.74, p < 0.001).ConclusionsA surgical task-based objective analysis was used to identify major contributors to surgical efficiency and variability. We believe this data-driven method will enable clinical teams to quantify surgeon-specific performance and identify actionable opportunities focused on the dominant surgical tasks impacting overall procedure efficiency and consistency.

Project description:BackgroundRobotically assisted cardiac surgery is performed in a team setting and is well known to be associated with learning curves. Surgeon and operative team learning curves are distinct entities, with total operative time representing the entire operative team (surgery, anesthesia, nursing, and perfusion) and cross-clamp time representing mainly the surgical team. Little is known about how a team learning curve evolves when an experienced surgeon transitions from one surgical center to another. This study investigates the dynamics of the team learning curve expressed as total operative time in the case of a surgeon with previous experience transitioning to a new team.MethodsA retrospective analysis was conducted on robotic cardiac surgeries performed by a surgeon who transitioned from one experienced surgical center to another. Operative time data were collected and categorized to assess the evolution of the learning curve. Statistical analysis, including learning curve modeling and linear regression analysis, was used to evaluate changes in total time in the operating room per case.Results103 cases were included in Weill Cornell Medicine (2019-2023). The median patient age was 63 years, 68% were males, 90.3% of cases were repaired for degenerative mitral valve disease, and the median body mass index was 23.87. Operative time (ORT) decreased from a median of 5.00 h [95%CI: 4.76, 6.00] in the first 30 cases to 4.83 [95%CI: 4.10, 5.27] thereafter, with the apparent curve plateauing indicative of the adaptation period to the new surgical environment (p = 0.01). Subgroup analysis among mitral cases (n = 93) showed a decrease in ORT from 5.00 [95%CI: 4.71, 5.98] in the first 26 cases to 4.83 [95%CI: 4.14, 5.30] (p = 0.045). There was no difference between the initial 30 cases and subsequent cases regarding cardiopulmonary bypass time, myocardial ischemia time, reoperation for bleeding, prolonged ventilation, reintubation, renal failure, need for an intra-aortic balloon pump, readmission to the ICU, reoperation for valvular dysfunction within 30 days, pneumonia, and deep venous thrombosis. Multivariate significant predictors of longer operative time were the first 30 cases, resection-based repairs, and MAZE as a concomitant procedure.ConclusionsTotal operative time can be expected to decrease after about 30 cases when an experienced robotic surgeon moves between centers. Complications and cross-clamp times are less susceptible to a learning curve phenomenon in such a circumstance, as these depend primarily on the operating surgeon's level of experience. Understanding these dynamics can inform the planning and management of surgical transitions, ensuring optimal patient care and continued improvement in surgical outcomes.

Project description:Pupillometry, the measure of pupil size and reactivity, has been widely used to assess cognitive processes. Changes in pupil size have been shown to correlate with various behavioral states, both externally and internally induced such as locomotion, arousal, cortical state, and decision-making processes. Besides, these pupillary responses have also been linked to the activity of neuromodulatory systems that modulate attention and perception such as the noradrenergic and cholinergic systems. Due to the extent of processes the pupil reflects, we aimed at further resolving pupillary responses in the context of behavioral state and task performance while recording pupillary transients of mice performing a vibrotactile two-alternative forced-choice task (2-AFC). We show that before the presentation of task-relevant information, pre-stimulus, pupil size differentiates between states of disengagement from task performance vs. engagement. Also, when subjects have to attend to task stimuli to attain a reward, post-stimulus, pupillary dilations exhibit a difference between correct and error responses with this difference reflecting an internal decision variable. We hypothesize that this internal decision variable relates to response confidence, the internal perception of the confidence the subject has in its choice. As opposed to this, we show that in a condition of passive performance, when the stimulus has no more task relevance due to reward being provided automatically, pupillary dilations reflect the occurrence of stimulation and reward provision but not decisional variables as under active performance. Our results provide evidence that in addition to reflecting attentiveness under task performance rather than arousal per se, pupil dilations also reflect the confidence of the subject in his ensuing response. This confidence coding is overlaid within a more pronounced pupil dilation that reflects post-decision components that are related to the response itself but not to the decision. We also provide evidence as to how different behavioral states, imposed by task demands, modulate what the pupil is reflecting, presumably showing what the underlying cognitive network is coding for.