Effect of marker position and size on the registration accuracy of HoloLens in a non-clinical setting with implications for high-precision surgical tasks.
Ontology highlight
ABSTRACT: Purpose
Emerging holographic headsets can be used to register patient-specific virtual models obtained from medical scans with the patient's body. Maximising accuracy of the virtual models' inclination angle and position (ideally, ≤ 2° and ≤ 2 mm, respectively, as in currently approved navigation systems) is vital for this application to be useful. This study investigated the accuracy with which a holographic headset registers virtual models with real-world features based on the position and size of image markers.Methods
HoloLens® and the image-pattern-recognition tool Vuforia Engine™ were used to overlay a 5-cm-radius virtual hexagon on a monitor's surface in a predefined position. The headset's camera detection of an image marker (displayed on the monitor) triggered the rendering of the virtual hexagon on the headset's lenses. 4 × 4, 8 × 8 and 12 × 12 cm image markers displayed at nine different positions were used. In total, the position and dimensions of 114 virtual hexagons were measured on photographs captured by the headset's camera.Results
Some image marker positions and the smallest image marker (4 × 4 cm) led to larger errors in the perceived dimensions of the virtual models than other image marker positions and larger markers (8 × 8 and 12 × 12 cm). ≤ 2° and ≤ 2 mm errors were found in 70.7% and 76% of cases, respectively.Conclusion
Errors obtained in a non-negligible percentage of cases are not acceptable for certain surgical tasks (e.g. the identification of correct trajectories of surgical instruments). Achieving sufficient accuracy with image marker sizes that meet surgical needs and regardless of image marker position remains a challenge.
SUBMITTER: Perez-Pachon L
PROVIDER: S-EPMC8166698 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Fluorescence microscopy (FM) and electron microscopy (EM) are complementary techniques. FM affords examination of large fields of view and identifying regions of interest but has a low resolution. EM exhibits excellent resolution over a limited field of view. The combination of these two techniques, correlative microscopy, received considerable interest in the past years and has proven its potential in biology and material science. Accurate correlation of FM and EM images is, however, challenging due to the differences in contrast mechanism, size of field of view and resolution. We report an accurate, fast and robust method to correlate FM and EM images using low densities of fiducial markers. Here, 120 nm diameter fiducial markers consisting of fluorescently labelled silica coated gold nanoparticles are used. The method relies on recording FM, low magnification EM and high magnification EM images. Two linear transformation matrices are constructed, FM to low magnification EM and low magnification EM to high magnification EM. Combination of these matrices results in a high accuracy transformation of FM to high magnification EM coordinates. The method was tested using two different transmission electron microscopes and different Tokuyasu and Lowicryl sections. The overall accuracy of the correlation method is high, 5-30 nm.
| S-EPMC6397213 | biostudies-literature
Project description:Surgical navigation systems are increasingly used to aid resection and reconstruction of osseous malignancies. In the process of implementing image-based surgical navigation systems, there are numerous opportunities for error that may impact surgical outcome. This study aimed to examine modifiable sources of error in an idealized scenario, when using a bidirectional infrared surgical navigation system.Accuracy and precision were assessed using a computerized-numerical-controlled (CNC) machined grid with known distances between indentations while varying: 1) the distance from the grid to the navigation camera (range 150 to 247cm), 2) the distance from the grid to the patient tracker device (range 20 to 40cm), and 3) whether the minimum or maximum number of bidirectional infrared markers were actively functioning. For each scenario, distances between grid points were measured at 10-mm increments between 10 and 120mm, with twelve measurements made at each distance. The accuracy outcome was the root mean square (RMS) error between the navigation system distance and the actual grid distance. To assess precision, four indentations were recorded six times for each scenario while also varying the angle of the navigation system pointer. The outcome for precision testing was the standard deviation of the distance between each measured point to the mean three-dimensional coordinate of the six points for each cluster.Univariate and multiple linear regression revealed that as the distance from the navigation camera to the grid increased, the RMS error increased (p<0.001). The RMS error also increased when not all infrared markers were actively tracking (p=0.03), and as the measured distance increased (p<0.001). In a multivariate model, these factors accounted for 58% of the overall variance in the RMS error. Standard deviations in repeated measures also increased when not all infrared markers were active (p<0.001), and as the distance between navigation camera and physical space increased (p=0.005). Location of the patient tracker did not affect accuracy (0.36) or precision (p=0.97).In our model laboratory test environment, the infrared bidirectional navigation system was more accurate and precise when the distance from the navigation camera to the physical (working) space was minimized and all bidirectional markers were active. These findings may require alterations in operating room setup and software changes to improve the performance of this system.
| S-EPMC5481622 | biostudies-other
Project description:Background:Digital templating systems foster patient-specific measurements for preoperative planning. Questions/Purposes:We aim (1) to verify the accuracy of a templating system, (2) to describe the effects of scaling marker position on the accuracy of digital templating of the hip, and (3) to provide a practical guide for scaling marker position using patient body mass index (BMI). Methods:A scaling sphere was placed in five positions along the anterior-posterior axis of an acetabular implant and pelvis phantom, and x-rays were obtained. Each radiograph was templated for the acetabular component and recorded. A retrospective review identified CT scans of preoperative hip arthroplasty cases. The center of the greater trochanter was calculated from these CT scans as the percent distance from the anterior thigh and recorded with the patient's BMI. Results:By centering the scaling sphere on the acetabular component, an accurate cup size was achieved. A difference of 3.5 cm in sphere placement resulted in a full cup size magnification error. Positioning the scaling sphere at the level of the pubic symphysis resulted in a difference of four cup sizes. This patient population had an average BMI of 28.72 kg/m2 (standard deviation 6.26 kg/m2) and an average position of the center of the greater trochanter of 51% (standard deviation of 6%) from the anterior surface of thigh. Conclusions:Digital templating relies on scaling marker position to accurately estimate implant size. Based on the findings in this study, scaling markers for hip imaging should be placed laterally, mid-thigh in the anterior-posterior direction for patients with a BMI between 25 and 40 kg/m2. If abnormal hip anatomy or extremes of BMI are discovered, then scaling sphere positioning should be optimized on a case-by-case basis. Digital templating systems for total hip arthroplasty must use precisely placed scaling markers at the level of the hip joint to allow for accurate implant size estimation.
| S-EPMC5786590 | biostudies-literature
Project description:Image registration is the process of aligning two or more images of the same scene taken at different times; from different viewpoints; and/or by different sensors. This research focuses on developing a practical method for automatic image registration for agricultural systems that use multimodal sensory systems and operate in natural environments. While not limited to any particular modalities; here we focus on systems with visual and thermal sensory inputs. Our approach is based on pre-calibrating a distance-dependent transformation matrix (DDTM) between the sensors; and representing it in a compact way by regressing the distance-dependent coefficients as distance-dependent functions. The DDTM is measured by calculating a projective transformation matrix for varying distances between the sensors and possible targets. To do so we designed a unique experimental setup including unique Artificial Control Points (ACPs) and their detection algorithms for the two sensors. We demonstrate the utility of our approach using different experiments and evaluation criteria.
| S-EPMC4570450 | biostudies-literature
Project description:Food portion size influences energy intake and sustained high-energy intake often leads to obesity. Virtual portion creation tasks (VPCTs), in which a participant creates portions of food on a computer screen, predict intake in healthy individuals. The objective of this study was to determine whether portions created in VPCTs are stable over time (test-retest reliability) and responsive to factors known to influence food intake, such as eating contexts and food types, and to determine if virtual portions can predict weight loss. Patients with obesity scheduled for bariatric surgery (n = 29), and individuals with a normal BMI (18.5-24.9 kg/m2, controls, n = 29), were instructed to create virtual portions of eight snack foods, which varied in energy density (low and high) and taste (sweet and salty). Portions were created in response to the following eating situations, or "contexts": What they would a) eat to stay healthy (healthy), b) typically eat (typical), c) eat to feel comfortably satisfied (satisfied), d) consider the most that they could tolerate eating (maximum), and e) eat if nothing was limiting them (desired). Tasks were completed before, and 3 months after, surgery in patients, and at two visits, 3 months apart, in controls. Body weight (kg) was recorded at both visits. Virtual portions differed significantly across groups, visits, eating contexts, energy densities (low vs. high), and tastes (sweet vs. salty). Portions created by controls did not change over time, while portions created by patients decreased significantly after surgery, for all contexts except healthy. For patients, desired and healthy portions predicted 3-month weight loss. VPCTs are replicable, responsive to foods and eating contexts, and predict surgical weight loss. These tasks could be useful for individual assessment of expectations of amounts that are eaten in health and disease and for prediction of weight loss.
| S-EPMC7370306 | biostudies-literature
Project description:ImportanceAs health care delivery markets have changed and new payment models have emerged, physicians in many specialties have consolidated their practices, but whether this consolidation has occurred in surgical practices is unknown.ObjectiveTo examine changes in the size of surgical practices, market-level factors associated with this consolidation, and how place of service for surgical care delivery varies by practice size.Design, setting, and participantsA cross-sectional study of Medicare Data on Provider Practice and Specialty from January 1 to December 31, 2013, compared with January 1 to December 31, 2017, was conducted on all general surgeon practices caring for patients enrolled in Medicare in the US. Data analysis was performed from November 4, 2019, to January 9, 2020.ExposuresPractice sizes in 2013 and 2017 were compared relative to hospital market concentration measured by the Herfindahl-Hirschman Index in the hospital referral region.Main outcomes and measuresThe primary outcome was the change in size of surgical practices over the study period. Secondary outcomes included change in surgical practice market concentration and the place of service for provision of surgical care stratified by surgical practice size.ResultsFrom 2013 to 2017, the number of surgical practices in the US decreased from 10 432 to 8451. The proportion of surgeons decreased in practices with 1 (from 26.2% to 17.4%), 2 (from 8.3% to 6.6%), and 3 to 5 (from 18.0% to 16.5%) surgeons, and the proportion of surgeons in practices with 6 or more surgeons increased (from 47.6% to 59.5%). Hospital concentration was associated with an increase in the size of the surgical practice. Each 10% increase in the hospital market concentration was associated with an increase of 0.204 surgeons (95% CI, 0.020-0.388 surgeons; P = .03) per practice from 2013 to 2017. Similarly, a 10% increase in the hospital-level HHI was associated with an increase in the surgical practice HHI of 0.023 (95% CI, 0.013-0.033; P < .001). Large surgical practices increased their share of Medicare services provided from 36.5% in 2013 to 45.6% in 2017. Large practices (31.3% inpatient in 2013 to 33.1% in 2017) were much more likely than small practices (19.0% inpatient in 2013 to 17.7% in 2017) to be based in hospital settings and this gap widened over time.Conclusions and relevanceSurgeons have increasingly joined larger practices over time, and there has been a significant decrease in solo, small, and midsize surgical practices. The consolidation of surgeons into larger practices appears to be associated with hospital market concentration in the same market. Although overall care appears to be more hospital based for larger practices, the association between the consolidation of surgical practices and patient access and outcomes should be studied.
| S-EPMC8082320 | biostudies-literature
Project description:The advent of inexpensive consumer virtual reality equipment enables many more researchers to study perception with naturally moving observers. One such system, the HTC Vive, offers a large field-of-view, high-resolution head mounted display together with a room-scale tracking system for less than a thousand U.S. dollars. If the position and orientation tracking of this system is of sufficient accuracy and precision, it could be suitable for much research that is currently done with far more expensive systems. Here we present a quantitative test of the HTC Vive's position and orientation tracking as well as its end-to-end system latency. We report that while the precision of the Vive's tracking measurements is high and its system latency (22 ms) is low, its position and orientation measurements are provided in a coordinate system that is tilted with respect to the physical ground plane. Because large changes in offset were found whenever tracking was briefly lost, it cannot be corrected for with a one-time calibration procedure. We conclude that the varying offset between the virtual and the physical tracking space makes the HTC Vive at present unsuitable for scientific experiments that require accurate visual stimulation of self-motion through a virtual world. It may however be suited for other experiments that do not have this requirement.
| S-EPMC5439658 | biostudies-other
Project description:This work analyzed the use of Microsoft HoloLens 2 in orthopedic oncological surgeries and compares it to its predecessor (Microsoft HoloLens 1). Specifically, we developed two equivalent applications, one for each device, and evaluated the augmented reality (AR) projection accuracy in an experimental scenario using phantoms based on two patients. We achieved automatic registration between virtual and real worlds using patient-specific surgical guides on each phantom. They contained a small adaptor for a 3D-printed AR marker, the characteristic patterns of which were easily recognized using both Microsoft HoloLens devices. The newest model improved the AR projection accuracy by almost 25%, and both of them yielded an RMSE below 3 mm. After ascertaining the enhancement of the second model in this aspect, we went a step further with Microsoft HoloLens 2 and tested it during the surgical intervention of one of the patients. During this experience, we collected the surgeons' feedback in terms of comfortability, usability, and ergonomics. Our goal was to estimate whether the improved technical features of the newest model facilitate its implementation in actual surgical scenarios. All of the results point to Microsoft HoloLens 2 being better in all the aspects affecting surgical interventions and support its use in future experiences.
| S-EPMC9269857 | biostudies-literature
Project description:PurposeWe assessed the accuracy of a new 3D2D registration algorithm to be used for navigated spine surgery and explored anatomical and radiologic parameters affecting the registration accuracy. Compared to existing 3D2D registration algorithms, the algorithm does not need bone-mounted or table-mounted instruments for registration. Neither does the intraoperative imaging device have to be tracked or calibrated.MethodsThe rigid registration algorithm required imaging data (a pre-existing CT scan (3D) and two angulated fluoroscopic images (2D)) to register positions of vertebrae in 3D and is based on non-invasive skin markers. The algorithm registered five adjacent vertebrae and was tested in the thoracic and lumbar spine from three human cadaveric specimens. The registration accuracy was calculated for each registered vertebra and measured with the target registration error (TRE) in millimeters. We used multivariable analysis to identify parameters independently affecting the algorithm's accuracy such as the angulation between the two fluoroscopic images (between 40° and 90°), the detector-skin distance, the number of skin markers applied, and waist circumference.ResultsThe algorithm registered 780 vertebrae with a median TRE of 0.51 mm [interquartile range 0.32-0.73 mm] and a maximum TRE of 2.06 mm. The TRE was most affected by the angulation between the two fluoroscopic images obtained (p < 0.001): larger angulations resulted in higher accuracy. The algorithm was more accurate in thoracic vertebrae (p = 0.004) and in the specimen with the smallest waist circumference (p = 0.003). The algorithm registered all five adjacent vertebrae with similar accuracy.ConclusionWe studied the accuracy of a new 3D2D registration algorithm based on non-invasive skin markers. The algorithm registered five adjacent vertebrae with similar accuracy in the thoracic and lumbar spine and showed a maximum target registration error of approximately 2 mm. To further evaluate its potential for navigated spine surgery, the algorithm may now be integrated into a complete navigation system.
| S-EPMC9468112 | biostudies-literature
Project description:BACKGROUND:Several daily living activities require people to coordinate the motion and the force produced by both arms, using their position sense and sense of effort. However, to date, the interaction in bimanual tasks has not been extensively investigated. METHODS:We focused on bimanual tasks where subjects were required: (Experiment 1) to move their hands until reaching the same position - equal hand position implied identical arm configurations in joint space - under different loading conditions;(Experiment 2) to produce the same amount of isometric force by pushing upward, with their hands placed in symmetric or asymmetric positions. The arm motions and forces required for accomplishing these tasks were in the vertical direction. We enrolled a healthy population of 20 subjects for Experiment 1 and 25 for Experiment 2. Our primary outcome was the systematic difference between the two hands at the end of each trial in terms of position for Experiment 1 and force for Experiment 2. In both experiments using repeated measure ANOVA we evaluated the effect of each specific condition, namely loading in the former case and hand configuration in the latter. RESULTS:In the first experiment, the difference between the hands' positions was greater when they were concurrently loaded with different weights. Conversely, in the second experiment, when subjects were asked to exert equal forces with both arms, the systematic difference between left and right force was not influenced by symmetric or asymmetric arm configurations, but by the position of the left hand, regardless of the right hand position. The performance was better when the left hand was in the higher position. CONCLUSIONS:The experiments report the reciprocal interaction between position sense and sense of effort inbimanual tasks performed by healthy subjects. Apart for the intrinsic interest for a better understanding of basic sensorimotor processes, the results are also relevant to clinical applications, for defining functional evaluation and rehabilitative protocols for people with neurological diseases or conditions that impair the ability to sense and control concurrently position and force.
| S-EPMC6839077 | biostudies-literature