Clinical Accuracy of Holographic Navigation Using Point-Based Registration on Augmented-Reality Glasses.
Ontology highlight
ABSTRACT: Background
As current augmented-reality (AR) smart glasses are self-contained, powerful computers that project 3-dimensional holograms that can maintain their position in physical space, they could theoretically be used as a low-cost, stand-alone neuronavigation system.Objective
To determine feasibility and accuracy of holographic neuronavigation (HN) using AR smart glasses.Methods
We programmed a fully functioning neuronavigation system on commercially available smart glasses (HoloLens®, Microsoft, Redmond, Washington) and tested its accuracy and feasibility in the operating room. The fiducial registration error (FRE) was measured for both HN and conventional neuronavigation (CN) (Brainlab, Munich, Germany) by using point-based registration on a plastic head model. Subsequently, we measured HN and CN FRE on 3 patients.Results
A stereoscopic view of the holograms was successfully achieved in all experiments. In plastic head measurements, the mean HN FRE was 7.2 ± 1.8 mm compared to the mean CN FRE of 1.9 ± 0.45 (mean difference: -5.3 mm; 95% confidence interval [CI]: -6.7 to -3.9). In the 3 patients, the mean HN FRE was 4.4 ± 2.5 mm compared to the mean CN FRE of 3.6 ± 0.5 (mean difference: -0.8 mm; 95% CI: -3.0 to 4.6).Conclusion
Owing to the potential benefits and promising results, we believe that HN could eventually find application in operating rooms. However, several improvements will have to be made before the device can be used in clinical practice.
SUBMITTER: van Doormaal TPC
PROVIDER: S-EPMC6995446 | biostudies-literature | 2019 Dec
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundAugmented reality (AR) glasses with GPS navigation represent the rapidly evolving technology which spares (and externalizes) navigational capacities. Regarding the expected everyday usage of this device, its impact on neuroplastic brain changes and navigation abilities should be evaluated.AimsThis study aimed to assess possible changes in functional connectivity (FC) of hippocampus and other brain regions involved in spatial navigation.MethodsThirty-three healthy participants completed two resting state functional magnetic resonance imaging (rsfMRI) measurements at the baseline and after 3 months. For this period, the experimental group (n = 17) has had used AR device (Vuzix M100) with incorporated GPS guidance system during navigation in real world. Participants from the control group (n = 16) have not used any GPS device while navigating during walking. The rsfMRI FC of right and left hippocampi was analyzed using a seed-driven approach. Virtual city task was used to test navigational abilities both before and after the usage of AR device.ResultsWe identified strong functional coupling of right and left hippocampi at the baseline (p < 0.05, FDR corrected). Mild changes in bilateral hippocampal FC (p < 0.05, FDR uncorrected) were observed in both assessed groups mainly between the bilateral hippocampi and between each hippocampus and temporal regions and cerebellum. However, the experimental group showed FC decrease after three months of using GPS navigation implemented in AR glasses in contrast to FC increase in the control group without such intervention. Importantly, no effect of intervention on navigational abilities was observed.DiscussionOur observation supports the assumption that externalization of spatial navigation to technological device (GPS in AR glasses) can decrease the functional coupling between hippocampus and associated brain regions. Considering some limitations of the present study, further studies should elucidate the mechanism of the observed changes and their impact on cognitive abilities.
| S-EPMC6020662 | biostudies-literature
Project description:This study demonstrates a full-color near-eye holographic display capable of superimposing color virtual scenes with 2D, 3D, and multiple objects with extended depth upon a real scene, which also has the ability to present different 3D information depending on the focus of the user's eyes using a single computer-generated hologram per color channel. Our setup makes use of a hologram generation method based on two-step propagation and the singular value decomposition of the Fresnel transform impulse response function to efficiently generate the holograms of the target scene. Then, we test our proposal by implementing a holographic display that makes use of a phase-only spatial light modulator and time-division multiplexing for color reproduction. We demonstrate the superior quality and computation speed of this approach compared with other hologram generation techniques with both numerical and experimental results.
| S-EPMC10313800 | biostudies-literature
Project description:Photovoltaic subretinal prosthesis is designed for restoration of central vision in patients with age-related macular degeneration (AMD). We investigated the utility of prosthetic central vision for complex visual tasks using augmented-reality (AR) glasses simulating reduced acuity, contrast, and visual field. AR glasses with blocked central 20° of visual field included an integrated video camera and software which adjusts the image quality according to three user-defined parameters: resolution, corresponding to the equivalent pixel size of an implant; field of view, corresponding to the implant size; and number of grayscale levels. The real-time processed video was streamed on a screen in front of the right eye. Nineteen healthy participants were recruited to complete visual tasks including vision charts, sentence reading, and face recognition. With vision charts, letter acuity exceeded the pixel-sampling limit by 0.2 logMAR. Reading speed decreased with increasing pixel size and with reduced field of view (7°-12°). In the face recognition task (four-way forced choice, 5° angular size) participants identified faces at >75% accuracy, even with 100 ?m pixels and only two grayscale levels. With 60 ?m pixels and eight grayscale levels, the accuracy exceeded 97%. Subjects with simulated prosthetic vision performed slightly better than the sampling limit on the letter acuity tasks, and were highly accurate at recognizing faces, even with 100 ?m/pixel resolution. These results indicate feasibility of reading and face recognition using prosthetic central vision even with 100 ?m pixels, and performance improves further with smaller pixels.
| S-EPMC6880846 | biostudies-literature
Project description:In video surgery, and more specifically in arthroscopy, one of the major problems is positioning the camera and instruments within the anatomic environment. The concept of computer-guided video surgery has already been used in ear, nose, and throat (ENT), gynecology, and even in hip arthroscopy. These systems, however, rely on optical or mechanical sensors, which turn out to be restricting and cumbersome. The aim of our study was to develop and evaluate the accuracy of a navigation system based on electromagnetic sensors in video surgery.We used an electromagnetic localization device (Aurora, Northern Digital Inc., Ontario, Canada) to track the movements in space of both the camera and the instruments. We have developed a dedicated application in the Python language, using the VTK library for the graphic display and the OpenCV library for camera calibration.A prototype has been designed and evaluated for wrist arthroscopy. It allows display of the theoretical position of instruments onto the arthroscopic view with useful accuracy.The augmented reality view represents valuable assistance when surgeons want to position the arthroscope or locate their instruments. It makes the maneuver more intuitive, increases comfort, saves time, and enhances concentration.
| S-EPMC3858680 | biostudies-other
Project description:BackgroundHolographic neuronavigation has several potential advantages compared to conventional neuronavigation systems. We present the first report of a holographic neuronavigation system with patient-to-image registration and patient tracking with a reference array using an augmented reality head-mounted display (AR-HMD).MethodsThree patients undergoing an intracranial neurosurgical procedure were included in this pilot study. The relevant anatomy was first segmented in 3D and then uploaded as holographic scene in our custom neuronavigation software. Registration was performed using point-based matching using anatomical landmarks. We measured the fiducial registration error (FRE) as the outcome measure for registration accuracy. A custom-made reference array with QR codes was integrated in the neurosurgical setup and used for patient tracking after bed movement.ResultsSix registrations were performed with a mean FRE of 8.5 mm. Patient tracking was achieved with no visual difference between the registration before and after movement.ConclusionsThis first report shows a proof of principle of intraoperative patient tracking using a standalone holographic neuronavigation system. The navigation accuracy should be further optimized to be clinically applicable. However, it is likely that this technology will be incorporated in future neurosurgical workflows because the system improves spatial anatomical understanding for the surgeon.
| S-EPMC7966201 | biostudies-literature
Project description:BackgroundAugmented reality (AR), a form of 3D imaging technology, has been preliminarily applied in tumor surgery of the head and spine, both are rigid bodies. However, there is a lack of research evaluating the clinical value of AR in tumor surgery of the brachial plexus, a non-rigid body, where the anatomical position varies with patient posture.MethodsPrior to surgery in 8 patients diagnosed with brachial plexus tumors, conventional MRI scans were performed to obtain conventional 2D MRI images. The MRI data were then differentiated automatically and converted into AR-based 3D models. After point-to-point relocation and registration, the 3D models were projected onto the patient's body using a head-mounted display for navigation. To evaluate the clinical value of AR-based 3D models compared to the conventional 2D MRI images, 2 senior hand surgeons completed questionnaires on the evaluation of anatomical structures (tumor, arteries, veins, nerves, bones, and muscles), ranging from 1 (strongly disagree) to 5 (strongly agree).ResultsSurgeons rated AR-based 3D models as superior to conventional MRI images for all anatomical structures, including tumors. Furthermore, AR-based 3D models were preferred for preoperative planning and intraoperative navigation, demonstrating their added value. The mean positional error between the 3D models and intraoperative findings was approximately 1 cm.ConclusionsThis study evaluated, for the first time, the clinical value of an AR-based 3D navigation system in preoperative planning and intraoperative navigation for brachial plexus tumor surgery. By providing more direct spatial visualization, compared with conventional 2D MRI images, this 3D navigation system significantly improved the clinical accuracy and safety of tumor surgery in non-rigid bodies.
| S-EPMC10792838 | biostudies-literature
Project description:ObjectiveEndoscopic sinus surgery represents the gold standard for surgical treatment of chronic sinus diseases. Thereby, navigation systems can be of distinct use. In our study, we tested the recently developed KARL STORZ NAV1 SinusTracker navigation software that incorporates elements of augmented reality (AR) to provide a better preoperative planning and guidance during the surgical procedure.MethodsOne hundred patients with chronic sinus disease were operated on using either a conventional navigation software (n = 52, non-AR, control group) or a navigation software incorporating AR elements (n = 48, AR, intervention group). Incidence of postoperative complications, duration of surgery, surgeon-reported benefit from the navigation system and patient-reported postoperative rehabilitation were assessed.ResultsThe surgeons reported a higher benefit during surgery, used the navigation system for more surgical steps and spent longer time with preoperative image analysis when using the AR system as compared with the non-AR system. No significant differences were seen in terms of postoperative complications, target registration error, operation time and postoperative rehabilitation.ConclusionThe AR enhanced navigation software shows a high acceptance by sinus surgeons in different stages of surgical training and offers potential benefits during surgery without affecting the duration of the operation or the incidence of postoperative complications.Level of evidence1b.
| S-EPMC7444769 | biostudies-literature
Project description:BackgroundAugmented reality (AR) is a rising technology gaining increasing utility in medicine. By superimposing the surgical site and the operator's visual field with computer-generated information, it has the potential to enhance the cognitive skills of surgeons. This is the report of the first in man case with "direct holographic navigation" as part of a randomized controlled trial.Case descriptionA pointing instrument was equipped with a sterile fiducial marker, which was used to obtain a digital representation of the intraoperative bony anatomy of the lumbar spine. Subsequently, a previously validated registration method was applied to superimpose the surgery plan with the intraoperative anatomy. The registration result is shown in situ as a 3D AR hologram of the preoperative 3D vertebra model with the planned screw trajectory and entry point for validation and approval by the surgeon. After achieving alignment with the surgery plan, a borehole is drilled and the pedicle screw placed. Postoperativ computer tomography was used to measure accuracy of this novel method for surgical navigation.OutcomeCorrect screw positions entirely within bone were documented with a postoperative CT, with an accuracy similar to current standard of care methods for surgical navigation. The patient was mobilized uneventfully on the first postoperative day with little pain medication and dismissed on the fourth postoperative day.ConclusionThis first in man report of direct AR navigation demonstrates feasibility in vivo. The continuation of this randomized controlled study will evaluate the value of this novel technology.
| S-EPMC8819976 | biostudies-literature
Project description:ObjectiveTo report the first use of a novel projected augmented reality (AR) system in open sinonasal tumor resections in preclinical models and to compare the AR approach with an advanced intraoperative navigation (IN) system.MethodsFour tumor models were created. Five head and neck surgeons participated in the study performing virtual osteotomies. Unguided, AR, IN, and AR + IN simulations were performed. Statistical comparisons between approaches were obtained. Intratumoral cut rate was the main outcome. The groups were also compared in terms of percentage of intratumoral, close, adequate, and excessive distances from the tumor. Information on a wearable gaze tracker headset and NASA Task Load Index questionnaire results were analyzed as well.ResultsA total of 335 cuts were simulated. Intratumoral cuts were observed in 20.7%, 9.4%, 1.2,% and 0% of the unguided, AR, IN, and AR + IN simulations, respectively (p < 0.0001). The AR was superior than the unguided approach in univariate and multivariate models. The percentage of time looking at the screen during the procedures was 55.5% for the unguided approaches and 0%, 78.5%, and 61.8% in AR, IN, and AR + IN, respectively (p < 0.001). The combined approach significantly reduced the screen time compared with the IN procedure alone.ConclusionWe reported the use of a novel AR system for oncological resections in open sinonasal approaches, with improved margin delineation compared with unguided techniques. AR improved the gaze-toggling drawback of IN. Further refinements of the AR system are needed before translating our experience to clinical practice.
| S-EPMC8591179 | biostudies-literature
Project description:BackgroundThe current intraoperative pulmonary nodule localization techniques require specific medical equipment or skillful operators, which limits their widespread application. Here, we present an innovative nodule localization technique in a canine lung model using augmented reality (AR) navigation.MethodsPeripheral pulmonary lesions were artificially created in canine model. A preoperative chest computed tomography scan was performed for each animal. The acquired computed tomography images were analyzed, and an established intraoperative localization plan was uploaded into HoloLens (a head-mounted AR device). Under general anesthesia, lung localization markers were implanted in each canine, guided by the established procedure plan displayed by HoloLens. All artificial lesions and markers were removed by video-assisted wedge resection or lobectomy in a single operation.ResultsSince June 2019, 12 peripheral pulmonary lesions were artificially created in 4 canine models. All lung localization markers were precisely implanted with a median registration and implantation time of 6 minutes (range, 2-15 minutes). The average distance between pulmonary lesions and markers was 1.9±1.7 mm, based on computed tomography examination after localization. No severe pneumothorax was observed after marker implantation. After an average implantation period of 16.5 days, no marker displacement was observed.ConclusionsThe AR navigation-guided pulmonary nodule localization technique was safe and effective in a canine model. The validity and feasibility of using this technology in patients will be examined further (NCT04211051).
| S-EPMC8674612 | biostudies-literature