The Beneficial Effects of Conventional Visual Cues Are Retained When Augmented Reality Glasses Are Worn.
Ontology highlight
ABSTRACT:
SUBMITTER: Janssen S
PROVIDER: S-EPMC7166266 | biostudies-literature | 2020
REPOSITORIES: biostudies-literature
Publications
The Beneficial Effects of Conventional Visual Cues Are Retained When Augmented Reality Glasses Are Worn.
Janssen Sabine S de Ruyter van Steveninck Jaap J Salim Hizirwan S HS Bloem Bastiaan R BR Heida Tjitske T van Wezel Richard J A RJA
Parkinson's disease 20200407
Wearing smart glasses may be distracting and thus annihilate the beneficial effects of cues on freezing of gait in Parkinson's disease. Furthermore, augmented reality cues might be effective in reducing FOG specifically in cueing-responsive patients. We present a single-patient study in which a patient with Parkinson's disease traversed a doorway under different cueing conditions. Wearing augmented reality (AR) glasses did not deteriorate FOG nor affect the beneficial effects of cues. The AR vis ...[more]
Similar Datasets
Project description:Photovoltaic subretinal prosthesis is designed for restoration of central vision in patients with age-related macular degeneration (AMD). We investigated the utility of prosthetic central vision for complex visual tasks using augmented-reality (AR) glasses simulating reduced acuity, contrast, and visual field. AR glasses with blocked central 20° of visual field included an integrated video camera and software which adjusts the image quality according to three user-defined parameters: resolution, corresponding to the equivalent pixel size of an implant; field of view, corresponding to the implant size; and number of grayscale levels. The real-time processed video was streamed on a screen in front of the right eye. Nineteen healthy participants were recruited to complete visual tasks including vision charts, sentence reading, and face recognition. With vision charts, letter acuity exceeded the pixel-sampling limit by 0.2 logMAR. Reading speed decreased with increasing pixel size and with reduced field of view (7°-12°). In the face recognition task (four-way forced choice, 5° angular size) participants identified faces at >75% accuracy, even with 100 ?m pixels and only two grayscale levels. With 60 ?m pixels and eight grayscale levels, the accuracy exceeded 97%. Subjects with simulated prosthetic vision performed slightly better than the sampling limit on the letter acuity tasks, and were highly accurate at recognizing faces, even with 100 ?m/pixel resolution. These results indicate feasibility of reading and face recognition using prosthetic central vision even with 100 ?m pixels, and performance improves further with smaller pixels.
| S-EPMC6880846 | biostudies-literature
Project description:Background: Turning in place is particularly bothersome for patients with Parkinson's disease (PD) experiencing freezing of gait (FOG). Cues designed to enforce goal-directed turning are not yet available. Objectives: Assess whether augmented reality (AR) visual cues improve FOG and turning in place in PD patients with FOG. Methods: Sixteen PD patients with FOG performed a series of 180° turns under an experimental condition with AR visual cues displayed through a HoloLens and two control conditions (one consisting of auditory cues and one without any cues). FOG episodes were annotated by two independent raters from video recordings. Motion data were measured with 17 inertial measurement units for calculating axial kinematics, scaling, and timing of turning. Results: AR visual cues did not reduce the percent time frozen (p = 0.73) or the number (p = 0.73) and duration (p = 0.78) of FOG episodes compared to the control condition without cues. All FOG parameters were higher with AR visual cues than with auditory cues [percent time frozen (p = 0.01), number (p = 0.02), and duration (p = 0.007) of FOG episodes]. The AR visual cues did reduce the peak angular velocity (visual vs. uncued p = 0.03; visual vs. auditory p = 0.02) and step height (visual vs. uncued p = 0.02; visual vs. auditory p = 0.007), and increased the step height coefficient of variation (visual vs. uncued p = 0.04; visual vs. auditory p = 0.01) and time to maximum head-pelvis separation (visual vs. uncued p = 0.02; visual vs. auditory p = 0.005), compared to both control conditions. Conclusions: The AR visual cues in this study did not reduce FOG, and worsened some measures of axial kinematics, and turn scaling and timing. Stimulating goal-directed turning might, by itself, be insufficient to reduce FOG and improve turning performance. Trial Registration: This study was registered in the Dutch trial registry (NTR6409; 2017-02-16).
| S-EPMC7105859 | biostudies-literature
Project description:External cueing is a potentially effective strategy to reduce freezing of gait (FOG) in persons with Parkinson's disease (PD). Case reports suggest that three-dimensional (3D) cues might be more effective in reducing FOG than two-dimensional cues. We investigate the usability of 3D augmented reality visual cues delivered by smart glasses in comparison to conventional 3D transverse bars on the floor and auditory cueing via a metronome in reducing FOG and improving gait parameters. In laboratory experiments, 25 persons with PD and FOG performed walking tasks while wearing custom-made smart glasses under five conditions, at the end-of-dose. For two conditions, augmented visual cues (bars/staircase) were displayed via the smart glasses. The control conditions involved conventional 3D transverse bars on the floor, auditory cueing via a metronome, and no cueing. The number of FOG episodes and percentage of time spent on FOG were rated from video recordings. The stride length and its variability, cycle time and its variability, cadence, and speed were calculated from motion data collected with a motion capture suit equipped with 17 inertial measurement units. A total of 300 FOG episodes occurred in 19 out of 25 participants. There were no statistically significant differences in number of FOG episodes and percentage of time spent on FOG across the five conditions. The conventional bars increased stride length, cycle time, and stride length variability, while decreasing cadence and speed. No effects for the other conditions were found. Participants preferred the metronome most, and the augmented staircase least. They suggested to improve the comfort, esthetics, usability, field of view, and stability of the smart glasses on the head and to reduce their weight and size. In their current form, augmented visual cues delivered by smart glasses are not beneficial for persons with PD and FOG. This could be attributable to distraction, blockage of visual feedback, insufficient familiarization with the smart glasses, or display of the visual cues in the central rather than peripheral visual field. Future smart glasses are required to be more lightweight, comfortable, and user friendly to avoid distraction and blockage of sensory feedback, thus increasing usability.
| S-EPMC5468397 | biostudies-literature
Project description:In the field of neuroprosthetics, the current state-of-the-art method involves controlling the prosthesis with electromyography (EMG) or electrooculography/electroencephalography (EOG/EEG). However, these systems are both expensive and time consuming to calibrate, susceptible to interference, and require a lengthy learning phase by the patient. Therefore, it is an open challenge to design more robust systems that are suitable for everyday use and meet the needs of patients. In this paper, we present a new concept of complete visual control for a prosthesis, an exoskeleton or another end effector using augmented reality (AR) glasses presented for the first time in a proof-of-concept study. By using AR glasses equipped with a monocular camera, a marker attached to the prosthesis is tracked. Minimal relative movements of the head with respect to the prosthesis are registered by tracking and used for control. Two possible control mechanisms including visual feedback are presented and implemented for both a motorized hand orthosis and a motorized hand prosthesis. Since the grasping process is mainly controlled by vision, the proposed approach appears to be natural and intuitive.
| S-EPMC7530745 | biostudies-literature
Project description:BackgroundAs current augmented-reality (AR) smart glasses are self-contained, powerful computers that project 3-dimensional holograms that can maintain their position in physical space, they could theoretically be used as a low-cost, stand-alone neuronavigation system.ObjectiveTo determine feasibility and accuracy of holographic neuronavigation (HN) using AR smart glasses.MethodsWe programmed a fully functioning neuronavigation system on commercially available smart glasses (HoloLens®, Microsoft, Redmond, Washington) and tested its accuracy and feasibility in the operating room. The fiducial registration error (FRE) was measured for both HN and conventional neuronavigation (CN) (Brainlab, Munich, Germany) by using point-based registration on a plastic head model. Subsequently, we measured HN and CN FRE on 3 patients.ResultsA stereoscopic view of the holograms was successfully achieved in all experiments. In plastic head measurements, the mean HN FRE was 7.2 ± 1.8 mm compared to the mean CN FRE of 1.9 ± 0.45 (mean difference: -5.3 mm; 95% confidence interval [CI]: -6.7 to -3.9). In the 3 patients, the mean HN FRE was 4.4 ± 2.5 mm compared to the mean CN FRE of 3.6 ± 0.5 (mean difference: -0.8 mm; 95% CI: -3.0 to 4.6).ConclusionOwing to the potential benefits and promising results, we believe that HN could eventually find application in operating rooms. However, several improvements will have to be made before the device can be used in clinical practice.
| S-EPMC6995446 | biostudies-literature
Project description:Digitalization of production environment, also called Industry 4.0 (the term invented by Wahlster Wolfgang in Germany) is now one of the hottest topics in the computer science departments at universities and companies. One of the most significant topics in this area is augmented reality (AR). The interest in AR has grown especially after the introduction of the Microsoft HoloLens in 2016, which made this technology available for researchers and developers all around the world. It is divided into numerous subtopics and technologies. These wireless, see-through glasses give a very natural human-machine interface, with the possibility to present certain necessary information right in front of the user's eyes as 3D virtual objects, in parallel with the observation of the real world, and the possibility to communicate with the system by simple gestures and speech. Scientists noted that in-depth studies connected to the effects of AR applications are presently sparse. In the first part of this paper, the authors recall the research from 2019 about the new method of manual wiring support with the AR glasses. In the second part, the study (tests) for this method carried out by the research team is described. The method was applied in the actual production environment with consideration of the actual production process, which is manual wiring of the industrial enclosures (control cabinets). Finally, authors deliberate on conclusions, technology's imperfections, limitations, and future possible development of the presented solution.
| S-EPMC7506974 | biostudies-literature
Project description:Many salient visual events tend to coincide with auditory events, such as seeing and hearing a car pass by. Information from the visual and auditory senses can be used to create a stable percept of the stimulus. Having access to related coincident visual and auditory information can help for spatial tasks such as localization. However not all visual information has analogous auditory percepts, such as viewing a computer monitor. Here, we describe a system capable of detecting and augmenting visual salient events into localizable auditory events. The system uses a neuromorphic camera (DAVIS 240B) to detect logarithmic changes of brightness intensity in the scene, which can be interpreted as salient visual events. Participants were blindfolded and asked to use the device to detect new objects in the scene, as well as determine direction of motion for a moving visual object. Results suggest the system is robust enough to allow for the simple detection of new salient stimuli, as well accurately encoding direction of visual motion. Future successes are probable as neuromorphic devices are likely to become faster and smaller in the future, making this system much more feasible.
| S-EPMC5549738 | biostudies-other
Project description:BackgroundAugmented reality (AR) glasses with GPS navigation represent the rapidly evolving technology which spares (and externalizes) navigational capacities. Regarding the expected everyday usage of this device, its impact on neuroplastic brain changes and navigation abilities should be evaluated.AimsThis study aimed to assess possible changes in functional connectivity (FC) of hippocampus and other brain regions involved in spatial navigation.MethodsThirty-three healthy participants completed two resting state functional magnetic resonance imaging (rsfMRI) measurements at the baseline and after 3 months. For this period, the experimental group (n = 17) has had used AR device (Vuzix M100) with incorporated GPS guidance system during navigation in real world. Participants from the control group (n = 16) have not used any GPS device while navigating during walking. The rsfMRI FC of right and left hippocampi was analyzed using a seed-driven approach. Virtual city task was used to test navigational abilities both before and after the usage of AR device.ResultsWe identified strong functional coupling of right and left hippocampi at the baseline (p < 0.05, FDR corrected). Mild changes in bilateral hippocampal FC (p < 0.05, FDR uncorrected) were observed in both assessed groups mainly between the bilateral hippocampi and between each hippocampus and temporal regions and cerebellum. However, the experimental group showed FC decrease after three months of using GPS navigation implemented in AR glasses in contrast to FC increase in the control group without such intervention. Importantly, no effect of intervention on navigational abilities was observed.DiscussionOur observation supports the assumption that externalization of spatial navigation to technological device (GPS in AR glasses) can decrease the functional coupling between hippocampus and associated brain regions. Considering some limitations of the present study, further studies should elucidate the mechanism of the observed changes and their impact on cognitive abilities.
| S-EPMC6020662 | biostudies-literature
Project description:Background: Defective pantomime of tool use is a hall mark of limb apraxia. Contextual information has been demonstrated to improve tool use performance. Further, knowledge about the potential impact of technological aids such as augmented reality for patients with limb apraxia is still scarce. Objective: Since augmented reality offers a new way to provide contextual information, we applied it to pantomime of tool use. We hypothesize that the disturbed movement execution can be mitigated by holographic stimulation. If visual stimuli facilitate the access to the appropriate motor program in patients with apraxia, their performance should improve with increased saliency, i.e., should be better when supported by dynamic and holographic cues vs. static and screen-based cues. Methods: Twenty one stroke patients and 23 healthy control subjects were randomized to mime the use of five objects, presented in two Environments (Screen vs. Head Mounted Display, HMD) and two Modes (Static vs. Dynamic) resulting in four conditions (ScreenStat, ScreenDyn, HMDStat, HMDDyn), followed by a real tool demonstration. Pantomiming was analyzed by a scoring system using video recordings. Additionally, the sense of presence was assessed using a questionnaire. Results: Healthy control participants performed close to ceiling and significantly better than patients. Patients achieved significantly higher scores with holographic or dynamic cues. Remarkably, when their performance was supported by animated holographic cues (e.g., striking hammer), it did not differ significantly from real tool demonstration. As the sense of presence increases with animated holograms, so does the pantomiming. Conclusion: Patients' performance improved with visual stimuli of increasing saliency. Future assistive technology could be implemented upon this knowledge and thus, positively impact the rehabilitation process and a patient's autonomy.
| S-EPMC8427527 | biostudies-literature
Project description:It is well known that wearing virtual reality (VR) and augmented reality (AR) devices for long periods can cause visual fatigue and motion sickness due to vergence-accommodation conflict (VAC). VAC is considered the main obstacle to the development of advanced three-dimensional VR and AR technology. In this paper, we present a novel AR high-density super-multiview (HDSMV) display technique capable of eliminating VAC in wide range. The designed binocular time-sequential AR HDSMV projection, which delivers 11 views to each eye pupil, is experimentally demonstrated, confirming that VAC is eliminated over a wide-range of viewer's focus distance. It is believed that the proposed time-sequential AR HDSMV method will pave the way for the development of VAC-free AR technology.
| S-EPMC8863894 | biostudies-literature