Browse
Submit Data
Databases
API
Help

Dataset Information

28 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Augmented reality powers a cognitive assistant for the blind.

ABSTRACT: To restore vision for the blind, several prosthetic approaches have been explored that convey raw images to the brain. So far, these schemes all suffer from a lack of bandwidth. An alternate approach would restore vision at the cognitive level, bypassing the need to convey sensory data. A wearable computer captures video and other data, extracts important scene knowledge, and conveys that to the user in compact form. Here, we implement an intuitive user interface for such a device using augmented reality: each object in the environment has a voice and communicates with the user on command. With minimal training, this system supports many aspects of visual cognition: obstacle avoidance, scene understanding, formation and recall of spatial memories, navigation. Blind subjects can traverse an unfamiliar multi-story building on their first attempt. To spur further development in this domain, we developed an open-source environment for standardized benchmarking of visual assistive devices.

SUBMITTER: Liu Y

PROVIDER: S-EPMC6257813 | biostudies-literature | 2018 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Augmented reality powers a cognitive assistant for the blind.

Liu Yang Y Stiles Noelle Rb NR Meister Markus M

eLife 20181127

To restore vision for the blind, several prosthetic approaches have been explored that convey raw images to the brain. So far, these schemes all suffer from a lack of bandwidth. An alternate approach would restore vision at the cognitive level, bypassing the need to convey sensory data. A wearable computer captures video and other data, extracts important scene knowledge, and conveys that to the user in compact form. Here, we implement an intuitive user interface for such a device using augmente ...[more]

PMID: 30479270

Similar Datasets

An augmented reality sign-reading assistant for users with reduced vision.

Project description:People typically rely heavily on visual information when finding their way to unfamiliar locations. For individuals with reduced vision, there are a variety of navigational tools available to assist with this task if needed. However, for wayfinding in unfamiliar indoor environments the applicability of existing tools is limited. One potential approach to assist with this task is to enhance visual information about the location and content of existing signage in the environment. With this aim, we developed a prototype software application, which runs on a consumer head-mounted augmented reality (AR) device, to assist visually impaired users with sign-reading. The sign-reading assistant identifies real-world text (e.g., signs and room numbers) on command, highlights the text location, converts it to high contrast AR lettering, and optionally reads the content aloud via text-to-speech. We assessed the usability of this application in a behavioral experiment. Participants with simulated visual impairment were asked to locate a particular office within a hallway, either with or without AR assistance (referred to as the AR group and control group, respectively). Subjective assessments indicated that participants in the AR group found the application helpful for this task, and an analysis of walking paths indicated that these participants took more direct routes compared to the control group. However, participants in the AR group also walked more slowly and took more time to complete the task than the control group. The results point to several specific future goals for usability and system performance in AR-based assistive tools.

| S-EPMC6334915 | biostudies-literature

Social interaction in augmented reality.

Project description:There have been decades of research on the usability and educational value of augmented reality. However, less is known about how augmented reality affects social interactions. The current paper presents three studies that test the social psychological effects of augmented reality. Study 1 examined participants' task performance in the presence of embodied agents and replicated the typical pattern of social facilitation and inhibition. Participants performed a simple task better, but a hard task worse, in the presence of an agent compared to when participants complete the tasks alone. Study 2 examined nonverbal behavior. Participants met an agent sitting in one of two chairs and were asked to choose one of the chairs to sit on. Participants wearing the headset never sat directly on the agent when given the choice of two seats, and while approaching, most of the participants chose the rotation direction to avoid turning their heads away from the agent. A separate group of participants chose a seat after removing the augmented reality headset, and the majority still avoided the seat previously occupied by the agent. Study 3 examined the social costs of using an augmented reality headset with others who are not using a headset. Participants talked in dyads, and augmented reality users reported less social connection to their partner compared to those not using augmented reality. Overall, these studies provide evidence suggesting that task performance, nonverbal behavior, and social connectedness are significantly affected by the presence or absence of virtual content.

| S-EPMC6516797 | biostudies-literature

Metasurface eyepiece for augmented reality.

Project description:Recently, metasurfaces composed of artificially fabricated subwavelength structures have shown remarkable potential for the manipulation of light with unprecedented functionality. Here, we first demonstrate a metasurface application to realize a compact near-eye display system for augmented reality with a wide field of view. A key component is a see-through metalens with an anisotropic response, a high numerical aperture with a large aperture, and broadband characteristics. By virtue of these high-performance features, the metalens can overcome the existing bottleneck imposed by the narrow field of view and bulkiness of current systems, which hinders their usability and further development. Experimental demonstrations with a nanoimprinted large-area see-through metalens are reported, showing full-color imaging with a wide field of view and feasibility of mass production. This work on novel metasurface applications shows great potential for the development of optical display systems for future consumer electronics and computer vision applications.

| S-EPMC6212528 | biostudies-literature

Augmented versus virtual reality laparoscopic simulation: what is the difference? A comparison of the ProMIS augmented reality laparoscopic simulator versus LapSim virtual reality laparoscopic simulator.

Project description:BACKGROUND: Virtual reality (VR) is an emerging new modality for laparoscopic skills training; however, most simulators lack realistic haptic feedback. Augmented reality (AR) is a new laparoscopic simulation system offering a combination of physical objects and VR simulation. Laparoscopic instruments are used within an hybrid mannequin on tissue or objects while using video tracking. This study was designed to assess the difference in realism, haptic feedback, and didactic value between AR and VR laparoscopic simulation. METHODS: The ProMIS AR and LapSim VR simulators were used in this study. The participants performed a basic skills task and a suturing task on both simulators, after which they filled out a questionnaire about their demographics and their opinion of both simulators scored on a 5-point Likert scale. The participants were allotted to 3 groups depending on their experience: experts, intermediates and novices. Significant differences were calculated with the paired t-test. RESULTS: There was general consensus in all groups that the ProMIS AR laparoscopic simulator is more realistic than the LapSim VR laparoscopic simulator in both the basic skills task (mean 4.22 resp. 2.18, P < 0.000) as well as the suturing task (mean 4.15 resp. 1.85, P < 0.000). The ProMIS is regarded as having better haptic feedback (mean 3.92 resp. 1.92, P < 0.000) and as being more useful for training surgical residents (mean 4.51 resp. 2.94, P < 0.000). CONCLUSIONS: In comparison with the VR simulator, the AR laparoscopic simulator was regarded by all participants as a better simulator for laparoscopic skills training on all tested features.

| S-EPMC1913183 | biostudies-other

A Cognitive-Based Board Game With Augmented Reality for Older Adults: Development and Usability Study.

Project description:BackgroundOlder adults in Taiwan are advised to adopt regular physical and social activities for the maintenance of their cognitive and physical health. Games offer a means of engaging older individuals in these activities. For this study, a collaborative cognitive-based board game, Nostalgic Seekers, was designed and developed with augmented reality technology to support cognitive engagement in older adults.ObjectiveA user study of the board game was conducted to understand how the game facilitates communication, problem solving, and emotional response in older players and whether augmented reality is a suitable technology in game design for these players.MethodsA total of 23 participants aged 50 to 59 years were recruited to play and evaluate the game. In each session, participants' interactions were observed and recorded, then analyzed through Bales' interaction process analysis. Following each session, participants were interviewed to provide feedback on their experience.ResultsThe quantitative analysis results showed that the participants engaged in task-oriented communication more frequently than social-emotional communication during the game. In particular, there was a high number of answers relative to questions. The analysis also showed a significant positive correlation between task-oriented acts and the game score. Qualitative analysis indicated that participants found the experience of playing the game enjoyable, nostalgic objects triggered positive emotional responses, and augmented reality technology was widely accepted by participants and provided effective engagement in the game.ConclusionsNostalgic Seekers provided cognitive exercise and social engagement to players and demonstrated the positive potential of integrating augmented reality technology into cognitive-based games for older adults. Future game designs could explore strategies for regular and continuous engagement.

| S-EPMC7769693 | biostudies-literature

Exploring the Effect of Augmented Reality on Cognitive Load, Attitude, Spatial Ability, and Stereochemical Perception.

Project description:Augmented reality (AR) has the capacity to afford a virtual experience that obviates the reliance on using two-dimensional representations of 3D molecules for teaching stereochemistry to undergraduate students. Using a combination of quantitative instruments and qualitative surveys/interviews, this study explored the relationships between students' attitudes, perceived cognitive load, spatial ability, and academic performance when engaging in an asynchronous online stereochemistry activity. Our activity was designed using elements of game-based learning, and integrated AR technologies. The control group was provided with a copy of our activity that used two-dimensional drawings, whereas the AR group completed an activity using the AR technologies. For this cohort of students, results indicated significant improvement in academic performance in both the control and AR groups. The introduction of AR technologies did not result in the AR group outperforming the control group. Participants from both groups displayed significant improvements in spatial ability throughout the research period. Further, a moderate correlation (r s = 0.416) between students' spatial ability and academic performance was found. No significant intergroup differences in the perceived cognitive loads of students were observed. A significant difference was observed on one item of the Intellectual Accessibility subscale of the ASCI (V2), Complicated-Simple. We found no correlation for student attitude or cognitive load with academic performance. The findings of this study provide insights for future AR-related studies to explore the role of spatial ability, student attitude, and cognitive load in learning performance.Supplementary informationThe online version contains supplementary material available at 10.1007/s10956-022-09957-0.

| S-EPMC8795959 | biostudies-literature

Virtual Reality and Augmented Reality in Ophthalmology: A Contemporary Prospective.

Project description:PurposeMost published systematic reviews have focused on the use of virtual reality (VR)/augmented reality (AR) technology in ophthalmology as it relates to surgical training. To date, this is the first review that investigates the current state of VR/AR technology applied more broadly to the entire field of ophthalmology.MethodsPubMed, Embase, and CINAHL databases were searched systematically from January 2014 through December 1, 2020. Studies that discussed VR and/or AR as it relates to the field of ophthalmology and provided information on the technology used were considered. Abstracts, non-peer-reviewed literature, review articles, studies that reported only qualitative data, and studies without English translations were excluded.ResultsA total of 77 studies were included in this review. Of these, 28 evaluated the use of VR/AR in ophthalmic surgical training/assessment and guidance, 7 in clinical training, 23 in diagnosis/screening, and 19 in treatment/therapy. 15 studies used AR, 61 used VR, and 1 used both. Most studies focused on the validity and usability of novel technologies.ConclusionsOphthalmology is a field of medicine that is well suited for the use of VR/AR. However, further longitudinal studies examining the practical feasibility, efficacy, and safety of such novel technologies, the cost-effectiveness, and medical/legal considerations are still needed. We believe that time will indeed foster further technological advances and lead to widespread use of VR/AR in routine ophthalmic practice.

| S-EPMC9167643 | biostudies-literature

Exploring Augmented Reality Integration in Diagnostic Imaging: Myth or Reality?

Project description: Not available

| S-EPMC11240696 | biostudies-literature

Integrating augmented reality technology in education: vector personal computer augmented reality [version 2; peer review: 2 approved

Project description: Not available

| S-EPMC10520515 | biostudies-literature

Spine Surgery Supported by Augmented Reality.

Project description:Study designA prospective, case-based, observational study.ObjectivesTo investigate how microscope-based augmented reality (AR) support can be utilized in various types of spine surgery.MethodsIn 42 spinal procedures (12 intra- and 8 extradural tumors, 7 other intradural lesions, 11 degenerative cases, 2 infections, and 2 deformities) AR was implemented using operating microscope head-up displays (HUDs). Intraoperative low-dose computed tomography was used for automatic registration. Nonlinear image registration was applied to integrate multimodality preoperative images. Target and risk structures displayed by AR were defined in preoperative images by automatic anatomical mapping and additional manual segmentation.ResultsAR could be successfully applied in all 42 cases. Low-dose protocols ensured a low radiation exposure for registration scanning (effective dose cervical 0.29 ± 0.17 mSv, thoracic 3.40 ± 2.38 mSv, lumbar 3.05 ± 0.89 mSv). A low registration error (0.87 ± 0.28 mm) resulted in a reliable AR representation with a close matching of visualized objects and reality, distinctly supporting anatomical orientation in the surgical field. Flexible AR visualization applying either the microscope HUD or video superimposition, including the ability to selectively activate objects of interest, as well as different display modes allowed a smooth integration in the surgical workflow, without disturbing the actual procedure. On average, 7.1 ± 4.6 objects were displayed visualizing target and risk structures reliably.ConclusionsMicroscope-based AR can be applied successfully to various kinds of spinal procedures. AR improves anatomical orientation in the surgical field supporting the surgeon, as well as it offers a potential tool for education.

| S-EPMC7263340 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data