Dataset Information

Validity assessment of the laparoscopic radical nephrectomy module of the LapVision virtual reality simulator.

ABSTRACT:

Background

Virtual reality simulators allow trainees to perform repeated practice and provide objective dexterity metrics regarding their performance, which means that virtual reality-based surgical training is becoming a vital part of initial learning of basic laparoscopic surgical skills. However, its educational role in learning advanced procedures remains undetermined. We evaluated the validity of the laparoscopic radical nephrectomy module of the LapVision virtual reality simulator.

Methods

Urologists, medical students, and a junior resident voluntarily participated in the present study, and they performed training with a laparoscopic left radical nephrectomy module. For construct validation, dexterity metrics calculated in the simulator and the mean score of Global Operative Assessment of Laparoscopic Skills evaluated by 2 experts' video review were compared according to the certification of Japanese Endoscopic Surgical Skill Qualification or previous surgical experience.

Results

Ten experts (≥ 50 laparoscopic surgeries), 9 intermediates (11-49), and 14 novices (0-10) voluntarily participated in the present study. Regarding the construct validity, there was a significant difference in the total number of errors, blood loss, and Global Operative Assessment of Laparoscopic Skills score among the groups for both the Endoscopic Surgical Skill Qualification status and previous surgical experience.

Conclusion

The present study demonstrated good construct validity for the LapVision nephrectomy module. Furthermore, global skill assessment was possible by experts' reviews, which indicates the usefulness of the virtual reality procedural module as a skill assessment tool. Virtual reality-based procedural simulation has marked potential to become a vital part of integrated laparoscopic training programs.

SUBMITTER: Miyata H

PROVIDER: S-EPMC8083013 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:PURPOSE:To test the face validity of the hip diagnostics module of a virtual reality hip arthroscopy simulator. METHODS:A total of 25 orthopaedic surgeons, 7 faculty members and 18 orthopaedic residents, performed diagnostic supine hip arthroscopies of a healthy virtual reality hip joint using a 70° arthroscope. Twelve specific targets were visualised within the central compartment; six via the anterior portal, three via the anterolateral portal and three via the posterolateral portal. This task was immediately followed by a questionnaire regarding the realism and training capability of the system. This consisted of seven questions addressing the verisimilitude of the simulator and five questions addressing the training environment of the simulator. Each question consisted of a statement stem and 10-point Likert scale. Following similar work in surgical simulators, a rating of 7 or above was considered an acceptable level of realism. RESULTS:The diagnostic hip arthroscopy module was found to have an acceptable level of realism in all domains apart from the tactile feedback received from the soft tissue. 23 out of 25 participants (92%) felt the simulator provided a non-threatening learning environment and 22 participants (88%) stated they enjoyed using the simulator. It was most frequently agreed that the level of trainees who would benefit most from the simulator were registrars and fellows (22 participants; 88%). Additionally, 21 of the participants (84%) agreed that this would be a beneficial training modality for foundation and core trainees, and 20 participants (80%) agreed that his would be beneficial for consultants. CONCLUSIONS:This VR hip arthroscopy simulator was demonstrated to have a sufficient level of realism, thus establishing its face validity. These results suggest this simulator has sufficient realism for use in the acquisition of basic arthroscopic skills and supports its use in orthopaedics surgical training. LEVEL OF EVIDENCE:I.

Project description:IntroductionTotal Laparoscopic hysterectomy (LH) requires an advanced level of operative skills and training. The aim of this study was to develop an objective scale specific for the assessment of technical skills for LH (H-OSATS) and to demonstrate feasibility of use and validity in a virtual reality setting.Material and methodsThe scale was developed using a hierarchical task analysis and a panel of international experts. A Delphi method obtained consensus among experts on relevant steps that should be included into the H-OSATS scale for assessment of operative performances. Feasibility of use and validity of the scale were evaluated by reviewing video recordings of LH performed on a virtual reality laparoscopic simulator. Three groups of operators of different levels of experience were assessed in a Marseille teaching hospital (10 novices, 8 intermediates and 8 experienced surgeons). Correlations with scores obtained using a recognised generic global rating tool (OSATS) were calculated.ResultsA total of 76 discrete steps were identified by the hierarchical task analysis. 14 experts completed the two rounds of the Delphi questionnaire. 64 steps reached consensus and were integrated in the scale. During the validation process, median time to rate each video recording was 25 minutes. There was a significant difference between the novice, intermediate and experienced group for total H-OSATS scores (133, 155.9 and 178.25 respectively; p = 0.002). H-OSATS scale demonstrated high inter-rater reliability (intraclass correlation coefficient [ICC] = 0.930; p<0.001) and test retest reliability (ICC = 0.877; p<0.001). High correlations were found between total H-OSATS scores and OSATS scores (rho = 0.928; p<0.001).ConclusionThe H-OSATS scale displayed evidence of validity for assessment of technical performances for LH performed on a virtual reality simulator. The implementation of this scale is expected to facilitate deliberate practice. Next steps should focus on evaluating the validity of the scale in the operating room.

Project description:Objectives: Attention Restoration Theory (ART) suggests that walking or being in natural settings, as opposed to urban environments, benefits cognitive skills because it is less demanding on attentional resources. However, it is unclear whether the same occurs when the person is performing a complex task such as driving, although it is proven that driving through different road environments is associated with different levels of fatigue and may engage attention differently. The present study investigated whether exposure to rural vs. urban road environments while driving would affect attentional capacity in young people after the drive, in line with the classic ART paradigms. Methods: We asked 38 young participants to complete the Sustained Attention to Response Task (SART) before and after being exposed to a rural or urban road in a virtual reality environment while driving in a full vehicle immersive driving simulator. Changes in SART performance based on environmental exposure where explored in terms of target sensitivity, accuracy, reaction times, and inverse efficiency. We analyzed potential road type effects on driving speed and accuracy. Possible effects of driving on attention were tested by comparing the sample performance to that of a control group of 15 participants who did not drive and sat on the passenger seat instead. Results: Exposure to rural or urban road environments in the driving sample was not associated with any significant changes in attentional performance. The two exposure groups did not differ significantly in terms of driving behavior. Comparisons between the driving sample and the control group controlling for age indicated that participants who drove were more accurate but slower at the SART than those who were passengers. Conclusion: The present study does not support the hypothesis that a short drive in a natural setting may promote attention restoration as compared to an urban setting. Methodological considerations as well as recommendations for future research are discussed.

Project description:BackgroundThe high cost and low availability of virtual reality simulators in surgical specialty training programs in low- and middle-income countries make it necessary to develop and obtain sources of validity for new models of low-cost portable simulators that enable ubiquitous learning of psychomotor skills in minimally invasive surgery.ObjectiveThe aim of this study was to obtain validity evidence for relationships to other variables, internal structure, and consequences of testing for the task scores of a new low-cost portable simulator mediated by gestures for learning basic psychomotor skills in minimally invasive surgery. This new simulator is called SIMISGEST-VR (Simulator of Minimally Invasive Surgery mediated by Gestures - Virtual Reality).MethodsIn this prospective observational validity study, the authors looked for multiple sources of evidence (known group construct validity, prior videogaming experience, internal structure, test-retest reliability, and consequences of testing) for the proposed SIMISGEST-VR tasks. Undergraduate students (n=100, reference group), surgical residents (n=20), and experts in minimally invasive surgery (n=28) took part in the study. After answering a demographic questionnaire and watching a video of the tasks to be performed, they individually repeated each task 10 times with each hand. The simulator provided concurrent, immediate, and terminal feedback and obtained the task metrics (time and score). From the reference group, 29 undergraduate students were randomly selected to perform the tasks 6 months later in order to determine test-retest reliability.ResultsEvidence from multiple sources, including strong intrarater reliability and internal consistency, considerable evidence for the hypothesized consequences of testing, and partial confirmation for relations to other variables, supports the validity of the scores and the metrics used to train and teach basic psychomotor skills for minimally invasive surgery via a new low-cost portable simulator that utilizes interaction technology mediated by gestures.ConclusionsThe results obtained provided multiple sources of evidence to validate SIMISGEST-VR tasks aimed at training novices with no prior experience and enabling them to learn basic psychomotor skills for minimally invasive surgery.