Dataset Information

HoloPointer: a virtual augmented reality pointer for laparoscopic surgery training.

ABSTRACT:

Purpose

In laparoscopic surgery training, experts guide novice physicians to desired instrument positions or indicate relevant areas of interest. These instructions are usually given via verbal communication or using physical pointing devices. To facilitate a sterile work flow and to improve training, new guiding methods are needed. This work proposes to use optical see-through augmented reality to visualize an interactive virtual pointer on the laparoscopic.

Methods

After an interdisciplinary development, the pointer's applicability and feasibility for training was evaluated and it was compared to a standard condition based on verbal and gestural communication only. In this study, ten surgical trainees were guided by an experienced trainer during cholecystectomies on a laparoscopic training simulator. All trainees completed a virtual cholecystectomy with and without the interactive virtual pointer in alternating order. Measures included procedure time, economy of movement and error rates.

Results

Results of standardized variables revealed significantly improved economy of movement (p?=?0.047) and error rates (p?=?0.047), as well as an overall improved user performance (Total z-score; p?=?0.031) in conditions using the proposed method.

Conclusion

The proposed HoloPointer is a feasible and applicable tool for laparoscopic surgery training. It improved objective performance metrics without prolongation of the task completion time in this pre-clinical setup.

SUBMITTER: Heinrich F

PROVIDER: S-EPMC7822765 | biostudies-literature | 2021 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

HoloPointer: a virtual augmented reality pointer for laparoscopic surgery training.

Heinrich Florian F Huettl Florentine F Schmidt Gerd G Paschold Markus M Kneist Werner W Huber Tobias T Hansen Christian C

International journal of computer assisted radiology and surgery 20201023 1

<h4>Purpose</h4>In laparoscopic surgery training, experts guide novice physicians to desired instrument positions or indicate relevant areas of interest. These instructions are usually given via verbal communication or using physical pointing devices. To facilitate a sterile work flow and to improve training, new guiding methods are needed. This work proposes to use optical see-through augmented reality to visualize an interactive virtual pointer on the laparoscopic.<h4>Methods</h4>After an inte ...[more]

PMID: 33095424

Similar Datasets

Project description:BackgroundThe COVID-19 pandemic challenges our ability to provide surgical education, as our ability to gather and train together has been restricted due to safety concerns. However, the importance of quality surgical education has remained. High-fidelity simulation platforms have been developed that merge virtual reality video streams to allow for remote instruction and collaboration. This study sought to validate the use of a merged virtual reality (MVR) platform for the instruction and assessment of the fundamentals of laparoscopic surgery (FLS) skills.MethodsThis was a prospective randomized controlled non-inferiority study. Thirty participants were randomized between three groups: The standard group received in-person instruction and expert feedback, the experimental group received identical training via the MVR platform, and the control group practiced on their own, but received no feedback. All participants were pre-tested for baseline performance at the beginning of the study. Change in performance was evaluated immediately after training and one month later for retention. Ordinary one-way analysis of variance was used to evaluate the effects of time, group, and time-on-group.ResultsThe pre-test confirmed baseline homogeneity between the groups. MVR was non-inferior to standard in-person training for total FLS times on either the post-test (p = 0.632) or the retention test (p = 0.829). Performance was also identical between MVR and standard training groups for each of the individual FLS tasks. Each group improved significantly in nearly all tasks after practice; however, the standard and MVR training groups both improved significantly more than controls for the ligating loop, extracorporeal suturing, intracorporeal suturing, and total FLS task training but did not reach statistical significance for peg transfer and pattern cut tasks.ConclusionThis randomized, controlled trial has demonstrated the use of an MVR platform as non-inferior to in-person instruction for the FLS program, forming the foundation for future work on remote instruction and collaboration.

Project description:Virtual reality (VR) can create safe, cost-effective, and engaging learning environments. It is commonly assumed that improvements in simulation fidelity lead to better learning outcomes. Some aspects of real environments, for example vestibular or haptic cues, are difficult to recreate in VR, but VR offers a wealth of opportunities to provide additional sensory cues in arbitrary modalities that provide task relevant information. The aim of this study was to investigate whether these cues improve user experience and learning outcomes, and, specifically, whether learning using augmented sensory cues translates into performance improvements in real environments. Participants were randomly allocated into three matched groups: Group 1 (control) was asked to perform a real tyre change only. The remaining two groups were trained in VR before performance was evaluated on the same, real tyre change task. Group 2 was trained using a conventional VR system, while Group 3 was trained in VR with augmented, task relevant, multisensory cues. Objective performance, time to completion and error number, subjective ratings of presence, perceived workload, and discomfort were recorded. The results show that both VR training paradigms improved performance for the real task. Providing additional, task-relevant cues during VR training resulted in higher objective performance during the real task. We propose a novel method to quantify the relative performance gains between training paradigms that estimates the relative gain in terms of training time. Systematic differences in subjective ratings that show comparable workload ratings, higher presence ratings and lower discomfort ratings, mirroring objective performance measures, were also observed. These findings further support the use of augmented multisensory cues in VR environments as an efficient method to enhance performance, user experience and, critically, the transfer of training from virtual to real environment scenarios.

Project description:Some of the barriers preventing virtual reality (VR) from being widely adopted are the cost and unfamiliarity of VR systems. Here, we propose that in many cases, the specialized controllers shipped with most VR head-mounted displays can be replaced by a regular smartphone, cutting the cost of the system, and allowing users to interact in VR using a device they are already familiar with. To achieve this, we developed SmartVR Pointer, an approach that uses smartphones to replace the specialized controllers for two essential operations in VR: selection and navigation by teleporting. In SmartVR Pointer, a camera mounted on the head-mounted display (HMD) is tilted downwards so that it points to where the user will naturally be holding their phone in front of them. SmartVR Pointer supports three selection modalities: tracker based, gaze based, and combined/hybrid. In the tracker-based SmartVR Pointer selection, we use image-based tracking to track a QR code displayed on the phone screen and then map the phone's position to a pointer shown within the field of view of the camera in the virtual environment. In the gaze-based selection modality, the user controls the pointer using their gaze and taps on the phone for selection. The combined technique is a hybrid between gaze-based interaction in VR and tracker-based Augmented Reality. It allows the user to control a VR pointer that looks and behaves like a mouse pointer by moving their smartphone to select objects within the virtual environment, and to interact with the selected objects using the smartphone's touch screen. The touchscreen is used for selection and dragging. The SmartVR Pointer is simple and requires no calibration and no complex hardware assembly or disassembly. We demonstrate successful interactive applications of SmartVR Pointer in a VR environment with a demo where the user navigates in the virtual environment using teleportation points on the floor and then solves a Tetris-style key-and-lock challenge.

Dataset Information

HoloPointer: a virtual augmented reality pointer for laparoscopic surgery training.

Purpose

Methods

Results

Conclusion

Publications

HoloPointer: a virtual augmented reality pointer for laparoscopic surgery training.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets