Evaluation of augmented reality technology in global urologic surgery.
Ontology highlight
ABSTRACT: Background
The COVID-19 pandemic drastically reduced opportunities for surgical skill sharing between high-income and low to middle-income countries. Augmented reality (AR) technology allows mentors in one country to virtually train a mentee in another country during surgical cases without international travel. We hypothesize that AR technology is an effective live surgical training and mentorship modality.Methods
Three senior urologic surgeons in the US and UK worked with four urologic surgeon trainees across the continent of Africa using AR systems. Trainers and trainees individually completed post-operative questionnaires evaluating their experience.Results
Trainees rated the quality of virtual training as equivalent to in-person training in 83% of cases (N = 5 of 6 responses). Trainers reported the technology's visual quality as "acceptable" in 67% of cases (N = 12 of 18 responses). The audiovisual capabilities of the technology had a "high" impact in the majority of the cases.Conclusion
AR technology can effectively facilitate surgical training when in-person training is limited or unavailable.
SUBMITTER: Dominique G
PROVIDER: S-EPMC10192066 | biostudies-literature | 2023 May
REPOSITORIES: biostudies-literature
Publications
Evaluation of augmented reality technology in global urologic surgery.
Dominique Georgina G Kunitsky Kevin K Natchagande Gilles G Jalloh Mohamed M Gebreamlak Abeselom Lemma AL Lawal Isiaka I Agounkpe Michel Michaël MM Hodonou Fred D FD Yevi Dodji Magloire Ines DMI Avakoudjo Josué D G JDG McCammon Kurt K Watson Graham G Scotland Kymora B KB
American journal of surgery 20230518 4
<h4>Background</h4>The COVID-19 pandemic drastically reduced opportunities for surgical skill sharing between high-income and low to middle-income countries. Augmented reality (AR) technology allows mentors in one country to virtually train a mentee in another country during surgical cases without international travel. We hypothesize that AR technology is an effective live surgical training and mentorship modality.<h4>Methods</h4>Three senior urologic surgeons in the US and UK worked with four u ...[more]
Similar Datasets
Project description:Background: Educators often face difficulties in explaining abstract concepts such as vectors. During the ongoing coronavirus disease 2019 (COVID-19) pandemic, fully online classes have also caused additional challenges to using conventional teaching methods. To explain a vector concept of more than 2 dimensions, visualization becomes a problem. Although Microsoft PowerPoint can integrate animation, the illustration is still in 2-dimensions. Augmented reality (AR) technology is recommended to aid educators and students in teaching-learning vectors, namely via a vector personal computer augmented reality system (VPCAR), to fulfil the demand for tools to support the learning and teaching of vectors. Methods: A PC learning module for vectors was developed in a 3-dimensional coordinate system by using AR technology. Purposive sampling was applied to get feedback from educators and students in Malaysia through an online survey. The supportiveness of using VPCAR based on six items (attractiveness, easiness, visualization, conceptual understanding, inspiration and helpfulness) was recorded on 5-points Likert-type scales. Findings are presented descriptively and graphically. Results: Surprisingly, both students and educators adapted to the new technology easily and provided significant positive feedback that showed a left-skewed and J-shaped distribution for each measurement item, respectively. The distributions were proven significantly different among the students and educators, where supportive level result of educators was higher than students. This study introduced a PC learning module other than mobile apps as students mostly use laptops to attend online class and educators also engage other IT tools in their teaching. Conclusions: Based on these findings, VPCAR provides a good prospect in supporting educators and students during their online teaching-learning process. However, the findings may not be generalizable to all students and educators in Malaysia as purposive sampling was applied. Further studies may focus on government-funded schools using the newly developed VPCAR system, which is the novelty of this study.
| S-EPMC10520515 | biostudies-literature
Project description:BackgroundVirtual and augmented reality (VAR) represents a combination of current state-of-the-art computer and imaging technologies and has the potential to be a revolutionary technology in many surgical fields. An increasing number of investigators have developed and applied VAR in hip-related surgery with the aim of using this technology to reduce hip surgery-related complications, improve surgical success rates, and reduce surgical risks. These technologies are beginning to be widely used in hip-related preoperative operation simulation and training, intraoperative navigation tools in the operating room, and postoperative rehabilitation.ObjectiveWith the aim of reviewing the current status of virtual reality (VR) and augmented reality (AR) in hip-related surgery and summarizing its benefits, we discussed and briefly described the applicability, advantages, limitations, and future perspectives of VR and AR techniques in hip-related surgery, such as preoperative operation simulation and training; explored the possible future applications of AR in the operating room; and discussed the bright prospects of VR and AR technologies in postoperative rehabilitation after hip surgery.MethodsWe searched the PubMed and Web of Science databases using the following key search terms: ("virtual reality" OR "augmented reality") AND ("pelvis" OR "hip"). The literature on basic and clinical research related to the aforementioned key search terms, that is, studies evaluating the key factors, challenges, or problems of using of VAR technology in hip-related surgery, was collected.ResultsA total of 40 studies and reports were included and classified into the following categories: total hip arthroplasty, hip resurfacing, femoral neck fracture, pelvic fracture, acetabular fracture, tumor, arthroscopy, and postoperative rehabilitation. Quality assessment could be performed in 30 studies. Among the clinical studies, there were 16 case series with an average score of 89 out of 100 points (89%) and 1 case report that scored 81 (SD 10.11) out of 100 points (81%) according to the Joanna Briggs Institute Critical Appraisal Checklist. Two cadaveric studies scored 85 of 100 points (85%) and 92 of 100 points (92%) according to the Quality Appraisal for Cadaveric Studies scale.ConclusionsVR and AR technologies hold great promise for hip-related surgeries, especially for preoperative operation simulation and training, feasibility applications in the operating room, and postoperative rehabilitation, and have the potential to assist orthopedic surgeons in operating more accurately and safely. More comparative studies are necessary, including studies focusing on clinical outcomes and cost-effectiveness.
| S-EPMC10039409 | biostudies-literature
Project description:Study designA prospective, case-based, observational study.ObjectivesTo investigate how microscope-based augmented reality (AR) support can be utilized in various types of spine surgery.MethodsIn 42 spinal procedures (12 intra- and 8 extradural tumors, 7 other intradural lesions, 11 degenerative cases, 2 infections, and 2 deformities) AR was implemented using operating microscope head-up displays (HUDs). Intraoperative low-dose computed tomography was used for automatic registration. Nonlinear image registration was applied to integrate multimodality preoperative images. Target and risk structures displayed by AR were defined in preoperative images by automatic anatomical mapping and additional manual segmentation.ResultsAR could be successfully applied in all 42 cases. Low-dose protocols ensured a low radiation exposure for registration scanning (effective dose cervical 0.29 ± 0.17 mSv, thoracic 3.40 ± 2.38 mSv, lumbar 3.05 ± 0.89 mSv). A low registration error (0.87 ± 0.28 mm) resulted in a reliable AR representation with a close matching of visualized objects and reality, distinctly supporting anatomical orientation in the surgical field. Flexible AR visualization applying either the microscope HUD or video superimposition, including the ability to selectively activate objects of interest, as well as different display modes allowed a smooth integration in the surgical workflow, without disturbing the actual procedure. On average, 7.1 ± 4.6 objects were displayed visualizing target and risk structures reliably.ConclusionsMicroscope-based AR can be applied successfully to various kinds of spinal procedures. AR improves anatomical orientation in the surgical field supporting the surgeon, as well as it offers a potential tool for education.
| S-EPMC7263340 | biostudies-literature
Project description:Computer as an integral part of continual advancements in medicine has experienced tremendous development to minimize the risks and improving the precision of the surgery. Our review included multi-disciplinary publications in English from 2014 to 2017 using Springer, Oxford library, Elsevier, PubMed, Google Scholar, and Springer search engines using terms of "augmented reality (AR), "plastic surgery," and "surgery " and "Augmented Reality Ethics and challenges". It was shown that AR has been successfully effective in different branches of surgery, but with concerns and challenges like acceptance, privacy, different physical, security and behavioral threats. To come over them partially, a methodological approach for cyber threat landscape proactive exploration has been suggested.
| S-EPMC6620801 | biostudies-other
Project description:BackgroundAugmented reality (AR), a form of 3D imaging technology, has been preliminarily applied in tumor surgery of the head and spine, both are rigid bodies. However, there is a lack of research evaluating the clinical value of AR in tumor surgery of the brachial plexus, a non-rigid body, where the anatomical position varies with patient posture.MethodsPrior to surgery in 8 patients diagnosed with brachial plexus tumors, conventional MRI scans were performed to obtain conventional 2D MRI images. The MRI data were then differentiated automatically and converted into AR-based 3D models. After point-to-point relocation and registration, the 3D models were projected onto the patient's body using a head-mounted display for navigation. To evaluate the clinical value of AR-based 3D models compared to the conventional 2D MRI images, 2 senior hand surgeons completed questionnaires on the evaluation of anatomical structures (tumor, arteries, veins, nerves, bones, and muscles), ranging from 1 (strongly disagree) to 5 (strongly agree).ResultsSurgeons rated AR-based 3D models as superior to conventional MRI images for all anatomical structures, including tumors. Furthermore, AR-based 3D models were preferred for preoperative planning and intraoperative navigation, demonstrating their added value. The mean positional error between the 3D models and intraoperative findings was approximately 1 cm.ConclusionsThis study evaluated, for the first time, the clinical value of an AR-based 3D navigation system in preoperative planning and intraoperative navigation for brachial plexus tumor surgery. By providing more direct spatial visualization, compared with conventional 2D MRI images, this 3D navigation system significantly improved the clinical accuracy and safety of tumor surgery in non-rigid bodies.
| S-EPMC10792838 | biostudies-literature
Project description:BackgroundTechnological advances have transformed vascular intervention in recent decades. In particular, improvements in imaging and data processing have allowed for the development of increasingly complex endovascular and hybrid interventions. Augmented reality (AR) is a subject of growing interest in surgery, with the potential to improve clinicians' understanding of 3D anatomy and aid in the processing of real-time information. This study hopes to elucidate the potential impact of AR technology in the rapidly evolving fields of vascular and endovascular surgery.ObjectiveThe aim of this review is to summarize the fundamental concepts of AR technologies and conduct a scoping review of the impact of AR and mixed reality in vascular and endovascular surgery.MethodsA systematic search of MEDLINE, Scopus, and Embase was performed in accordance with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. All studies written in English from inception until January 8, 2021, were included in the search. Combinations of the following keywords were used in the systematic search string: ("augmented reality" OR "hololens" OR "image overlay" OR "daqri" OR "magic leap" OR "immersive reality" OR "extended reality" OR "mixed reality" OR "head mounted display") AND ("vascular surgery" OR "endovascular"). Studies were selected through a blinded process between 2 investigators (JE and AS) and assessed using data quality tools.ResultsAR technologies have had a number of applications in vascular and endovascular surgery. Most studies (22/32, 69%) used 3D imaging of computed tomography angiogram-derived images of vascular anatomy to augment clinicians' anatomical understanding during procedures. A wide range of AR technologies were used, with heads up fusion imaging and AR head-mounted displays being the most commonly applied clinically. AR applications included guiding open, robotic, and endovascular surgery while minimizing dissection, improving procedural times, and reducing radiation and contrast exposure.ConclusionsAR has shown promising developments in the field of vascular and endovascular surgery, with potential benefits to surgeons and patients alike. These include reductions in patient risk and operating times as well as in contrast and radiation exposure for radiological interventions. Further technological advances are required to overcome current limitations, including processing capacity and vascular deformation by instrumentation.
| S-EPMC9547335 | biostudies-literature
Project description:Purpose: Augmented reality (AR) may allow vitreoretinal surgeons to leverage microscope-integrated digital imaging systems to analyze and highlight key retinal anatomic features in real time, possibly improving safety and precision during surgery. By employing convolutional neural networks (CNNs) for retina vessel segmentation, a retinal coordinate system can be created that allows pre-operative images of capillary non-perfusion or retinal breaks to be digitally aligned and overlayed upon the surgical field in real time. Such technology may be useful in assuring thorough laser treatment of capillary non-perfusion or in using pre-operative optical coherence tomography (OCT) to guide macular surgery when microscope-integrated OCT (MIOCT) is not available. Methods: This study is a retrospective analysis involving the development and testing of a novel image-registration algorithm for vitreoretinal surgery. Fifteen anonymized cases of pars plana vitrectomy with epiretinal membrane peeling, along with corresponding preoperative fundus photographs and optical coherence tomography (OCT) images, were retrospectively collected from the Mayo Clinic database. We developed a TPU (Tensor-Processing Unit)-accelerated CNN for semantic segmentation of retinal vessels from fundus photographs and subsequent real-time image registration in surgical video streams. An iterative patch-wise cross-correlation (IPCC) algorithm was developed for image registration, with a focus on optimizing processing speeds and maintaining high spatial accuracy. The primary outcomes measured were processing speed in frames per second (FPS) and the spatial accuracy of image registration, quantified by the Dice coefficient between registered and manually aligned images. Results: When deployed on an Edge TPU, the CNN model combined with our image-registration algorithm processed video streams at a rate of 14 FPS, which is superior to processing rates achieved on other standard hardware configurations. The IPCC algorithm efficiently aligned pre-operative and intraoperative images, showing high accuracy in comparison to manual registration. Conclusions: This study demonstrates the feasibility of using TPU-accelerated CNNs for enhanced AR in vitreoretinal surgery.
| S-EPMC11766602 | biostudies-literature
Project description:ObjectivesThis study aimed to review and synthesize the current research and state of augmented reality (AR), mixed reality (MR) and the applications developed for healthcare education beyond surgery.MethodsAn integrative review was conducted on all relevant material, drawing on different data sources, including the databases of PubMed, PsycINFO, and ERIC from January 2013 till September 2018. Inductive content analysis and qualitative synthesis were performed. Additionally, the quality of the studies was assessed with different structured tools.ResultsTwenty-six studies were included. Studies based on both AR and MR involved established applications in 27% of all cases (n=6), the rest being prototypes. The most frequently studied subjects were related to anatomy and anesthesia (n=13). All studies showed several healthcare educational benefits of AR and MR, significantly outperforming traditional learning approaches in 11 studies examining various outcomes. Studies had a low-to-medium quality overall with a MERSQI mean of 12.26 (SD=2.63), while the single qualitative study had high quality.ConclusionsThis review suggests the progress of learning approaches based on AR and MR for various medical subjects while moving the research base away from feasibility studies on prototypes. Yet, lacking validity of study conclusions, heterogeneity of research designs and widely varied reporting challenges transferability of the findings in the studies included in the review. Future studies should examine suitable research designs and instructional objectives achievable by AR and MR-based applications to strengthen the evidence base, making it relevant for medical educators and institutions to apply the technologies.
| S-EPMC7246121 | biostudies-literature
Project description:Human anatomical specimen museums are commonly used by medical, nursing, and paramedical students. Through dissection and prosection, the specimens housed in these museums allow students to appreciate the complex relationships of organs and structures in more detail than textbooks could provide. However, it may be difficult for students, particularly novices, to identify the various parts of these anatomical structures without additional explanations from a docent or supplemental illustrations. Recently, augmented reality (AR) has been used in many museum exhibits to display virtual objects in videos captured from the real world. This technology can significantly enhance the learning experience. In this study, three AR-based support systems for tours in medical specimen museums were developed, and their usability and effectiveness for learning were examined. The first system was constructed using an AR marker. This system could display virtual label information for specimens by capturing AR markers using a tablet camera. Individual AR markers were required for all specimens, but their presence in and on the prosected specimens could also be obtrusive. The second system was developed to set the specimen image itself as an image marker, as most specimens were displayed in cross section. Visitors could then obtain the label information presented by AR without any markers intruding on the display or anatomical specimens. The third system was comprised of a head-mounted display combined with a natural click interface. The system could provide visitors with an environment for the natural manipulation of virtual objects with future scalability.
| S-EPMC6767574 | biostudies-literature
Project description:The present paper explores the benefits and the capabilities of various emerging state-of-the-art interactive 3D and Internet of Things technologies and investigates how these technologies can be exploited to develop a more effective technology supported exposure therapy solution for social anxiety disorder. "DJINNI" is a conceptual design of an in vivo augmented reality (AR) exposure therapy mobile support system that exploits several capturing technologies and integrates the patient's state and situation by vision-based, audio-based, and physiology-based analysis as well as by indoor/outdoor localization techniques. DJINNI also comprises an innovative virtual reality exposure therapy system that is adaptive and customizable to the demands of the in vivo experience and therapeutic progress. DJINNI follows a gamification approach where rewards and achievements are utilized to motivate the patient to progress in her/his treatment. The current paper reviews the state of the art of technologies needed for such a solution and recommends how these technologies could be integrated in the development of an individually tailored and yet feasible and effective AR/virtual reality-based exposure therapy. Finally, the paper outlines how DJINNI could be part of classical cognitive behavioral treatment and how to validate such a setup.
| S-EPMC5408008 | biostudies-literature