Subjective vs Computerized Assessment of Surgeon Skill Level During Mastoidectomy.
Ontology highlight
ABSTRACT:
SUBMITTER: Close MF
PROVIDER: S-EPMC8136835 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Flow is a state of "optimal experience" that arises when skill and task demands match. Flow has been well studied in psychology using a range of self-report and experimental methods; with most research typically focusing on how Flow is elicited by a particular task. Here, we focus on how the experience of Flow changes during task skill development. We present a longitudinal experimental study of learning, wherein participants (N = 9) play a novel steering-game task designed to elicit Flow by matching skill and demand, and providing clear goals and feedback. Experimental design involves extensive in-depth measurement of behavior, physiology, and Flow self-reports over 2 weeks of 40 game trials in eight sessions. Here we report behavioral results, which are both strikingly similar and strong within each participant. We find that the game induces a near-constant state of elevated Flow. We further find that the variation in Flow across all trials is less affected by overall performance improvement than by deviation of performance from the expected value predicted by a power law model of learning.
| S-EPMC6530424 | biostudies-literature
Project description:A prospective randomized controlled pilot study was performed to determine if video self-assessment improves competency in mastoidectomy and to assess interrater agreement between expert and resident evaluations of recorded mastoidectomy. Sixteen otolaryngology residents were recorded while performing cadaveric mastoidectomy and randomized into video self-assessment and control groups. All residents performed a second recorded mastoidectomy. Performance was evaluated by blinded experts with a validated assessment scale. Video self-assessment did not lead to greater skill improvement between the first and second mastoidectomy. Interrater agreement was fair to substantial between the expert evaluators and between resident self-evaluations by recall and video review. Agreement between experts and residents was only slight to fair; residents consistently rated their performance higher than experts (P < .05). In conclusion, 1 session of video self-review did not lead to improved competence in mastoidectomy over standard practice. While experts agree on assessments, residents may overestimate their competency in performing cadaveric mastoidectomy.
| S-EPMC6239141 | biostudies-literature
Project description:Introduction: The objective of this study was to determine if use of an automated irrigation pump (AIP) during ureteroscopy (URS) and percutaneous nephrolithotomy (PCNL) affects circulating nurse labor, irrigation-related issues, and surgeon and nurse satisfaction when compared to manual hand pump (HP) irrigation. Methods: Eighty consecutive adult patients undergoing unilateral URS or PCNL were prospectively randomized to irrigation with the HP or AIP. Preoperative pump setup time, intraoperative pump maintenance time, total pump time (setup+maintenance), and the number of irrigation-related concerns verbalized by the surgeon intraoperatively were recorded; postoperatively, surgeons and nurses rated their satisfaction with the irrigation system (1?=?highly dissatisfied to 10?=?highly satisfied). Results: Eighty patients were enrolled (39 AIP and 41 HP); 51 patients underwent URS and 29 patients underwent PCNL. On univariate analysis, the AIP resulted in a significantly reduced total pump time for URS (2.9 vs 5.9 minutes) and PCNL (4.6 vs 33.9 minutes; p?<?0.001). The number of irrigation-related concerns was significantly lower in the AIP group during URS (1.2 vs 2.8, p?<?0.001), but not during PCNL (1.9 vs 4.0, p?=?0.07). The AIP was associated with significantly higher nurse satisfaction during URS (9.2/10 vs 6.5/10, p?<?0.001) and PCNL (9.4/10 vs 4.4/10, p?=?0.001). There was no significant association between pump type and surgeon satisfaction. On multivariate analysis of URS cases controlling for body mass index and number of stones, use of the AIP was a predictor of total pump time <5 minutes (odds ratio 25.8, 95% confidence interval [CI] 4.0-165.4; p?<?0.001) and favorable (8-10/10) nurse satisfaction rating (odds ratio 25.4, 95% CI 4.1-164.0; p?<?0.001). Operative time, stone-free rate, and liters of irrigant used with the HP and AIP were similar. Conclusions: During URS and PCNL, the AIP was associated with a significant reduction in irrigation pump time and higher nurse satisfaction.
| S-EPMC7047110 | biostudies-literature
Project description:Need to assess the skill of ecosystem modelsAccelerated changes to global ecosystems call for holistic and integrated analyses of past, present and future states under various pressures to adequately understand current and projected future system states. Ecosystem models can inform management of human activities in a complex and changing environment, but are these models reliable? Ensuring that models are reliable for addressing management questions requires evaluating their skill in representing real-world processes and dynamics. Skill has been evaluated for just a limited set of some biophysical models. A range of skill assessment methods have been reviewed but skill assessment of full marine ecosystem models has not yet been attempted.Northeast us atlantis marine ecosystem modelWe assessed the skill of the Northeast U.S. (NEUS) Atlantis marine ecosystem model by comparing 10-year model forecasts with observed data. Model forecast performance was compared to that obtained from a 40-year hindcast. Multiple metrics (average absolute error, root mean squared error, modeling efficiency, and Spearman rank correlation), and a suite of time-series (species biomass, fisheries landings, and ecosystem indicators) were used to adequately measure model skill. Overall, the NEUS model performed above average and thus better than expected for the key species that had been the focus of the model tuning. Model forecast skill was comparable to the hindcast skill, showing that model performance does not degenerate in a 10-year forecast mode, an important characteristic for an end-to-end ecosystem model to be useful for strategic management purposes.Skill assessment is both possible and advisableWe identify best-practice approaches for end-to-end ecosystem model skill assessment that would improve both operational use of other ecosystem models and future model development. We show that it is possible to not only assess the skill of a complicated marine ecosystem model, but that it is necessary do so to instill confidence in model results and encourage their use for strategic management. Our methods are applicable to any type of predictive model, and should be considered for use in fields outside ecology (e.g. economics, climate change, and risk assessment).
| S-EPMC4701724 | biostudies-literature
Project description:BACKGROUND:Technological advances in healthcare have enabled patients to participate in digital self-assessment, with reported benefits of enhanced healthcare efficiency and self-efficacy. This report describes the design and validation of a patient-administered preanaesthesia health assessment digital application for gathering medical history relevant to preanaesthesia assessment. Effective preoperative evaluation allows for timely optimization of medical conditions and reduces case cancellations on day of surgery. METHODS:Using an iterative mixed-methods approach of literature review, surveys and panel consensus, the study sought to develop and validate a digitized preanaesthesia health assessment questionnaire in terms of face and criterion validity. A total of 228 patients were enrolled at the preoperative evaluation clinic of a tertiary women's hospital. Inclusion criteria include: age ?? 21?years, scheduled for same-day-admission surgery, literacy in English and willingness to use a digital device. Patient perception of the digitized application was also evaluated using the QQ10 questionnaire. Reliability of health assessment questionnaire was evaluated by comparing the percentage agreement of patient responses with nurse assessment. RESULTS:Moderate to good criterion validity was obtained in 81.1 and 83.8% of questions for the paper and digital questionnaires respectively. Of total 3626 response-pairs obtained, there were 3405 (93.4%) concordant and 221 (6.1%) discrepant response-pairs for the digital questionnaire. Discrepant response-pairs, such as ""no/yes" and "unsure/yes", constitute only 3.7% of total response-pairs. Patient acceptability of the digitized assessment was high, with QQ10 value and burden scores of 76 and 30%, respectively. CONCLUSIONS:Self-administration of digitized preanaesthesia health assessment is acceptable to patients and reliable in eliciting medical history. Further iteration should focus on improving reliability of the digital tool, adapting it for use in other languages and incorporating clinical decision tools.
| S-EPMC7666442 | biostudies-literature
Project description:Word-selective neural responses in human ventral occipito-temporal cortex (VOTC) emerge as children learn to read, creating a visual word form area (VWFA) in the literate brain. It has been suggested that the VWFA arises through competition between pre-existing selectivity for other stimulus categories, changing the topography of VOTC to support rapid word recognition. Here, we hypothesized that competition between words and objects would be resolved as children acquire reading skill. Using functional magnetic resonance imaging (fMRI), we examined the relationship between responses to words and objects in VOTC in two ways. First, we defined the VWFA using a words?>?objects contrast and found that only skilled readers had a region that responded more to words than objects. Second, we defined the VWFA using a words?>?faces contrast and examined selectivity for words over objects in this region. We found that word selectivity strongly correlated with reading skill, suggesting reading skill-dependent tuning for words. Furthermore, we found that low word selectivity in struggling readers was not due to a lack of response to words, but to a high response to objects. Our results suggest that the fine-tuning of word-selective responses in VOTC is a critical component of skilled reading.
| S-EPMC6969272 | biostudies-literature
Project description: Not available
| S-EPMC5885969 | biostudies-literature
Project description:ObjectiveTo test whether crowdsourced lay raters can accurately assess cataract surgical skills.DesignTwo-armed study: independent cross-sectional and longitudinal cohorts.SettingWashington University Department of Ophthalmology.Participants and methodsSixteen cataract surgeons with varying experience levels submitted cataract surgery videos to be graded by 5 experts and 300+ crowdworkers masked to surgeon experience. Cross-sectional study: 50 videos from surgeons ranging from first-year resident to attending physician, pooled by years of training. Longitudinal study: 28 videos obtained at regular intervals as residents progressed through 180 cases. Surgical skill was graded using the modified Objective Structured Assessment of Technical Skill (mOSATS). Main outcome measures were overall technical performance, reliability indices, and correlation between expert and crowd mean scores.ResultsExperts demonstrated high interrater reliability and accurately predicted training level, establishing construct validity for the modified OSATS. Crowd scores were correlated with (r = 0.865, p < 0.0001) but consistently higher than expert scores for first, second, and third-year residents (p < 0.0001, paired t-test). Longer surgery duration negatively correlated with training level (r = -0.855, p < 0.0001) and expert score (r = -0.927, p < 0.0001). The longitudinal dataset reproduced cross-sectional study findings for crowd and expert comparisons. A regression equation transforming crowd score plus video length into expert score was derived from the cross-sectional dataset (r2 = 0.92) and demonstrated excellent predictive modeling when applied to the independent longitudinal dataset (r2 = 0.80). A group of student raters who had edited the cataract videos also graded them, producing scores that more closely approximated experts than the crowd.ConclusionsCrowdsourced rankings correlated with expert scores, but were not equivalent; crowd scores overestimated technical competency, especially for novice surgeons. A novel approach of adjusting crowd scores with surgery duration generated a more accurate predictive model for surgical skill. More studies are needed before crowdsourcing can be reliably used for assessing surgical proficiency.
| S-EPMC8217126 | biostudies-literature
Project description:BackgroundCOVID-19 has become a global pandemic with a dramatic impact on healthcare systems. Concern for viral transmission necessitates the investigation of otologic procedures that use high-speed drilling instruments, including mastoidectomy, which we hypothesized to be an aerosol-generating procedure.MethodsMastoidectomy with a high-speed drill was simulated using fresh-frozen cadaveric heads with fluorescein solution injected into the mastoid air cells. Specimens were drilled for 1-minute durations in test conditions with and without a microscope. A barrier drape was fashioned from a commercially available drape (the OtoTent). Dispersed particulate matter was quantified in segments of an octagonal test grid measuring 60 cm in radius.ResultsDrilling without a microscope dispersed fluorescent particles 360 degrees, with the areas of highest density in quadrants near the surgeon and close to the surgical site. Using a microscope or varying irrigation rates did not significantly reduce particle density or percent surface area with particulate. Using the OtoTent significantly reduced particle density and percent surface area with particulate across the segments of the test grid beyond 30 cm (which marked the boundary of the OtoTent) compared with the microscope only and no microscope test conditions (Kruskall-Wallis test, p = 0.0066).ConclusionsMastoidectomy with a high-speed drill is an aerosol-generating procedure, a designation that connotes the potential high risk of viral transmission and need for higher levels of personal protective equipment. A simple barrier drape significantly reduced particulate dispersion in this study and could be an effective mitigation strategy in addition to appropriate personal protective equipment.
| S-EPMC7497894 | biostudies-literature
Project description:We aim to assess physicians' level of resilience and define factors that improve or decrease the resilience level during the COVID-19 pandemic. Physicians from hospitals located in areas with different COVID-19 caseload levels, were invited to participate in a national e-survey between April and May 2020. Study participants were mainly emergency physicians, and anaesthesiologists, infectious disease consultants, and intensive care. The survey assessed participant's characteristics, factors potentially associated with resilience, and resilience using the Connor-Davidson Resilience Scale (RISC-25), with higher scores indicative of greater resilience. Factors associated with the resilience score were assessed using a multivariable linear regression. Of 451 responding physicians involved in the care of COVID-19 patients, 442 were included (98%). Age was 36.1 ± 10.3 years and 51.8% were male; 63% worked in the emergency department (n = 282), 10.4% in anesthesiology (n = 46), 9.9% in infectious disease department (n = 44), 4.8% in intensive care unit (n = 21) or other specialties (n = 49). The median RISC-25 score was at 69 (IQR 62-75). Factors associated with higher RISC scores were anesthesia as a specialty, parenthood, no previous history of anxiety or depression and nor increased anxiety. To conclude, this study is the first to characterize levels of resilience among physicians involved in COVID-19 unit. Our data points to certain protective characteristics and some detrimental factors, such as anxiety or depression, that could be amenable to remediating or preventing strategies to promote resilience and support caregivers in a pandemic.
| S-EPMC8114969 | biostudies-literature