ARDebug: An Augmented Reality Tool for Analysing and Debugging Swarm Robotic Systems.
Ontology highlight
ABSTRACT:
SUBMITTER: Millard AG
PROVIDER: S-EPMC7805932 | biostudies-literature | 2018
REPOSITORIES: biostudies-literature
Publications
ARDebug: An Augmented Reality Tool for Analysing and Debugging Swarm Robotic Systems.
Millard Alan G AG Redpath Richard R Jewers Alistair M AM Arndt Charlotte C Joyce Russell R Hilder James A JA McDaid Liam J LJ Halliday David M DM
Frontiers in robotics and AI 20180724
Despite growing interest in collective robotics over the past few years, analysing and debugging the behaviour of swarm robotic systems remains a challenge due to the lack of appropriate tools. We present a solution to this problem-ARDebug: an open-source, cross-platform, and modular tool that allows the user to visualise the internal state of a robot swarm using graphical augmented reality techniques. In this paper we describe the key features of the software, the hardware required to support i ...[more]
Similar Datasets
Project description:How we interact with computer graphics has not changed significantly from viewing 2D text and images on a flatscreen since their invention. Yet, recent advances in computing technology, internetworked devices and gaming are driving the design and development of new ideas in other modes of human-computer interfaces (HCIs). Virtual Reality (VR) technology uses computers and HCIs to create the feeling of immersion in a three-dimensional (3D) environment that contains interactive objects with a sense of spatial presence, where objects have a spatial location relative to, and independent of the users. While this virtual environment does not necessarily match the real world, by creating the illusion of reality, it helps users leverage the full range of human sensory capabilities. Similarly, Augmented Reality (AR), superimposes virtual images to the real world. Because humans learn the physical world through a gradual sensory familiarization, these immersive visualizations enable gaining familiarity with biological systems not realizable in the physical world (e.g., allosteric regulatory networks within a protein or biomolecular pathways inside a cell). As VR/AR interfaces are anticipated to be explosive in consumer markets, systems biologists will be more immersed into their world. Here we introduce a brief history of VR/AR, their current roles in systems biology, and advantages and disadvantages in augmenting user abilities. We next argue that in systems biology, VR/AR technologies will be most useful in visually exploring and communicating data; performing virtual experiments; and education/teaching. Finally, we discuss our perspective on future directions for VR/AR in systems biology.
| S-EPMC9140045 | biostudies-literature
Project description:BackgroundTo provide participants with a more real and immersive intervening experience, virtual reality (VR) and/or augmented reality (AR) technologies have been integrated into some bystander intervention training programs and studies measuring bystander behaviors.ObjectiveWe focused on whether VR or AR can be used as a tool to enhance training bystanders. We reviewed the evidence from empirical studies that used VR and/or AR as a tool for examining bystander behaviors in the domain of interpersonal violence research.MethodsTwo librarians searched for articles in databases, including APA PsycInfo (Ovid), Criminal Justice Abstracts (EBSCO), Medline (Ovid), Applied Social Sciences Index & Abstracts (ProQuest), Sociological Abstracts (ProQuest), and Scopus till April 15, 2020. Studies focusing on bystander behaviors in conflict situations were included. All study types (except reviews) written in English in any discipline were included.ResultsThe search resulted in 12,972 articles from six databases, and the articles were imported into Covidence. Eleven studies met the inclusion and exclusion criteria. All 11 articles examined the use of VR as a tool for studying bystander behaviors. Most of the studies were conducted in US young adults. The types of interpersonal violence were school bullying, dating violence, sexual violence/assault, and soccer-associated violence. VR technology was used as an observational measure and bystander intervention program. We evaluated the different uses of VR for bystander behaviors and noted a lack of empirical evidence for AR as a tool. We also discuss the empirical evidence regarding the design, effectiveness, and limitations of implementing VR as a tool in the reviewed studies.ConclusionsThe reviewed results have implications and recommendations for future research in designing and implementing VR/AR technology in the area of interpersonal violence. Future studies in this area may further contribute to the use of VR as an observational measure and explore the potential use of AR to study bystander behaviors.
| S-EPMC7920754 | biostudies-literature
Project description:We adopted a vision-based tracking system for augmented reality (AR), and evaluated whether it helped surgeons to localize the recurrent laryngeal nerve (RLN) during robotic thyroid surgery. We constructed an AR image of the trachea, common carotid artery, and RLN using CT images. During surgery, an AR image of the trachea and common carotid artery were overlaid on the physical structures after they were exposed. The vision-based tracking system was activated so that the AR image of the RLN followed the camera movement. After identifying the RLN, the distance between the AR image of the RLN and the actual RLN was measured. Eleven RLNs (9 right, 4 left) were tested. The mean distance between the RLN AR image and the actual RLN was 1.9?±?1.5?mm (range 0.5 to 3.7). RLN localization using AR and vision-based tracking system was successfully applied during robotic thyroidectomy. There were no cases of RLN palsy. This technique may allow surgeons to identify hidden anatomical structures during robotic surgery.
| S-EPMC7242458 | biostudies-literature
Project description:Due to loss of tactile feedback the assessment of tumor margins during robotic surgery is based only on visual inspection, which is neither significantly sensitive nor specific. Here we demonstrate time-resolved fluorescence spectroscopy (TRFS) as a novel technique to complement the visual inspection of oral cancers during transoral robotic surgery (TORS) in real-time and without the need for exogenous contrast agents. TRFS enables identification of cancerous tissue by its distinct autofluorescence signature that is associated with the alteration of tissue structure and biochemical profile. A prototype TRFS instrument was integrated synergistically with the da Vinci Surgical robot and the combined system was validated in swine and human patients. Label-free and real-time assessment and visualization of tissue biochemical features during robotic surgery procedure, as demonstrated here, not only has the potential to improve the intraoperative decision making during TORS but also other robotic procedures without modification of conventional clinical protocols.
| S-EPMC6362025 | biostudies-literature
Project description:Patient-specific instruments (PSIs) have become a valuable tool for osteotomy guidance in complex surgical scenarios such as pelvic tumor resection. They provide similar accuracy to surgical navigation systems but are generally more convenient and faster. However, their correct placement can become challenging in some anatomical regions, and it cannot be verified objectively during the intervention. Incorrect installations can result in high deviations from the planned osteotomy, increasing the risk of positive resection margins. In this work, we propose to use augmented reality (AR) to guide and verify PSIs placement. We designed an experiment to assess the accuracy provided by the system using a smartphone and the HoloLens 2 and compared the results with the conventional freehand method. The results showed significant differences, where AR guidance prevented high osteotomy deviations, reducing maximal deviation of 54.03 mm for freehand placements to less than 5 mm with AR guidance. The experiment was performed in two versions of a plastic three-dimensional (3D) printed phantom, one including a silicone layer to simulate tissue, providing more realism. We also studied how differences in shape and location of PSIs affect their accuracy, concluding that those with smaller sizes and a homogeneous target surface are more prone to errors. Our study presents promising results that prove AR's potential to overcome the present limitations of PSIs conveniently and effectively.
| S-EPMC8659846 | biostudies-literature
Project description:Background: Defective pantomime of tool use is a hall mark of limb apraxia. Contextual information has been demonstrated to improve tool use performance. Further, knowledge about the potential impact of technological aids such as augmented reality for patients with limb apraxia is still scarce. Objective: Since augmented reality offers a new way to provide contextual information, we applied it to pantomime of tool use. We hypothesize that the disturbed movement execution can be mitigated by holographic stimulation. If visual stimuli facilitate the access to the appropriate motor program in patients with apraxia, their performance should improve with increased saliency, i.e., should be better when supported by dynamic and holographic cues vs. static and screen-based cues. Methods: Twenty one stroke patients and 23 healthy control subjects were randomized to mime the use of five objects, presented in two Environments (Screen vs. Head Mounted Display, HMD) and two Modes (Static vs. Dynamic) resulting in four conditions (ScreenStat, ScreenDyn, HMDStat, HMDDyn), followed by a real tool demonstration. Pantomiming was analyzed by a scoring system using video recordings. Additionally, the sense of presence was assessed using a questionnaire. Results: Healthy control participants performed close to ceiling and significantly better than patients. Patients achieved significantly higher scores with holographic or dynamic cues. Remarkably, when their performance was supported by animated holographic cues (e.g., striking hammer), it did not differ significantly from real tool demonstration. As the sense of presence increases with animated holograms, so does the pantomiming. Conclusion: Patients' performance improved with visual stimuli of increasing saliency. Future assistive technology could be implemented upon this knowledge and thus, positively impact the rehabilitation process and a patient's autonomy.
| S-EPMC8427527 | biostudies-literature
Project description:There have been decades of research on the usability and educational value of augmented reality. However, less is known about how augmented reality affects social interactions. The current paper presents three studies that test the social psychological effects of augmented reality. Study 1 examined participants' task performance in the presence of embodied agents and replicated the typical pattern of social facilitation and inhibition. Participants performed a simple task better, but a hard task worse, in the presence of an agent compared to when participants complete the tasks alone. Study 2 examined nonverbal behavior. Participants met an agent sitting in one of two chairs and were asked to choose one of the chairs to sit on. Participants wearing the headset never sat directly on the agent when given the choice of two seats, and while approaching, most of the participants chose the rotation direction to avoid turning their heads away from the agent. A separate group of participants chose a seat after removing the augmented reality headset, and the majority still avoided the seat previously occupied by the agent. Study 3 examined the social costs of using an augmented reality headset with others who are not using a headset. Participants talked in dyads, and augmented reality users reported less social connection to their partner compared to those not using augmented reality. Overall, these studies provide evidence suggesting that task performance, nonverbal behavior, and social connectedness are significantly affected by the presence or absence of virtual content.
| S-EPMC6516797 | biostudies-literature
Project description:Recently, metasurfaces composed of artificially fabricated subwavelength structures have shown remarkable potential for the manipulation of light with unprecedented functionality. Here, we first demonstrate a metasurface application to realize a compact near-eye display system for augmented reality with a wide field of view. A key component is a see-through metalens with an anisotropic response, a high numerical aperture with a large aperture, and broadband characteristics. By virtue of these high-performance features, the metalens can overcome the existing bottleneck imposed by the narrow field of view and bulkiness of current systems, which hinders their usability and further development. Experimental demonstrations with a nanoimprinted large-area see-through metalens are reported, showing full-color imaging with a wide field of view and feasibility of mass production. This work on novel metasurface applications shows great potential for the development of optical display systems for future consumer electronics and computer vision applications.
| S-EPMC6212528 | biostudies-literature
Project description:BACKGROUND: Virtual reality (VR) is an emerging new modality for laparoscopic skills training; however, most simulators lack realistic haptic feedback. Augmented reality (AR) is a new laparoscopic simulation system offering a combination of physical objects and VR simulation. Laparoscopic instruments are used within an hybrid mannequin on tissue or objects while using video tracking. This study was designed to assess the difference in realism, haptic feedback, and didactic value between AR and VR laparoscopic simulation. METHODS: The ProMIS AR and LapSim VR simulators were used in this study. The participants performed a basic skills task and a suturing task on both simulators, after which they filled out a questionnaire about their demographics and their opinion of both simulators scored on a 5-point Likert scale. The participants were allotted to 3 groups depending on their experience: experts, intermediates and novices. Significant differences were calculated with the paired t-test. RESULTS: There was general consensus in all groups that the ProMIS AR laparoscopic simulator is more realistic than the LapSim VR laparoscopic simulator in both the basic skills task (mean 4.22 resp. 2.18, P < 0.000) as well as the suturing task (mean 4.15 resp. 1.85, P < 0.000). The ProMIS is regarded as having better haptic feedback (mean 3.92 resp. 1.92, P < 0.000) and as being more useful for training surgical residents (mean 4.51 resp. 2.94, P < 0.000). CONCLUSIONS: In comparison with the VR simulator, the AR laparoscopic simulator was regarded by all participants as a better simulator for laparoscopic skills training on all tested features.
| S-EPMC1913183 | biostudies-other
Project description:BackgroundThe Augmented Reality Home Assessment Tool (ARHAT) is a mobile app developed to provide rapid, highly accurate assessments of the home environment. It uses 3D-capture technologies to help people identify and address functional limitations and environmental barriers.ObjectiveThis study was conducted to gain stakeholder feedback on the acceptability and appropriateness of the ARHAT for identifying and addressing barriers within home environments.MethodsA qualitative descriptive study was conducted because it allows for variability when obtaining data and seeks to understand stakeholders' insights on an understudied phenomenon. Each stakeholder group (occupational therapists, housing professionals, and aging adult and caregiver "dyads") participated in a 60-minute, web-based focus group via a secure Zoom platform. Focus group data were analyzed by 2 trained qualitative research team members using a framework method for analysis.ResultsA total of 19 stakeholders, aged from 18 to 85+ years, were included in the study. Of the occupational therapists (n=5, 26%), housing professionals (n=3, 16%), and dyads (n=11, 58%), a total of 32% (n=6) were male and 68% (n=13) were female, with most living in the Midwestern United States (n=10, 53%). The focus group data demonstrate the acceptability and appropriateness of the workflow, style, measurement tools, and impact of the ARHAT. All stakeholders stated that they could see the ARHAT being used at many different levels and by any population. Dyads specifically mentioned that the ARHAT would allow them to do forward planning and made them think of home modifications in a new light.ConclusionsStakeholders found the ARHAT to be acceptable and appropriate for identifying and addressing functional limitations and barriers in the home environment. This study highlights the importance of considering the workflow, style, measurement tools, and potential impact of home assessment technology early in the developmental process.
| S-EPMC10547935 | biostudies-literature