Haptic-feedback smart glove as a creative human-machine interface (HMI) for virtual/augmented reality applications.
Ontology highlight
ABSTRACT:
SUBMITTER: Zhu M
PROVIDER: S-EPMC7209995 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:With the decrease in the number of cerebral aneurysms treated surgically and the increase of complexity of those treated surgically, there is a need for simulation-based tools to teach future neurosurgeons the operative techniques of aneurysm clipping.To develop and evaluate the usefulness of a new haptic-based virtual reality simulator in the training of neurosurgical residents.A real-time sensory haptic feedback virtual reality aneurysm clipping simulator was developed using the ImmersiveTouch platform. A prototype middle cerebral artery aneurysm simulation was created from a computed tomographic angiogram. Aneurysm and vessel volume deformation and haptic feedback are provided in a 3-dimensional immersive virtual reality environment. Intraoperative aneurysm rupture was also simulated. Seventeen neurosurgery residents from 3 residency programs tested the simulator and provided feedback on its usefulness and resemblance to real aneurysm clipping surgery.Residents thought that the simulation would be useful in preparing for real-life surgery. About two-thirds of the residents thought that the 3-dimensional immersive anatomic details provided a close resemblance to real operative anatomy and accurate guidance for deciding surgical approaches. They thought the simulation was useful for preoperative surgical rehearsal and neurosurgical training. A third of the residents thought that the technology in its current form provided realistic haptic feedback for aneurysm surgery.Neurosurgical residents thought that the novel immersive VR simulator is helpful in their training, especially because they do not get a chance to perform aneurysm clippings until late in their residency programs.
| S-EPMC4340784 | biostudies-literature
Project description:A visuo-haptic augmented reality (VHAR) interface is presented enabling an operator to teleoperate an unmanned aerial vehicle (UAV) equipped with a custom CdZnTe-based spectroscopic gamma-ray detector in outdoor environments. The task is to localize nuclear radiation sources, whose location is unknown to the user, without the close exposure of the operator. The developed detector also enables identification of the localized nuclear sources. The aim of the VHAR interface is to increase the situation awareness of the operator. The user teleoperates the UAV using a 3DOF haptic device that provides an attractive force feedback around the location of the most intense detected radiation source. Moreover, a fixed camera on the ground observes the environment where the UAV is flying. A 3D augmented reality scene is displayed on a computer screen accessible to the operator. Multiple types of graphical overlays are shown, including sensor data acquired by the nuclear radiation detector, a virtual cursor that tracks the UAV and geographical information, such as buildings. Experiments performed in a real environment are reported using an intense nuclear source.
| S-EPMC5677116 | biostudies-other
Project description:We evaluated the use of a part-task simulator with 3D and haptic feedback as a training tool for a common neurosurgical procedure--placement of thoracic pedicle screws.To evaluate the learning retention of thoracic pedicle screw placement on a high-performance augmented reality and haptic technology workstation.Fifty-one fellows and residents performed thoracic pedicle screw placement on the simulator. The virtual screws were drilled into a virtual patient's thoracic spine derived from a computed tomography data set of a real patient.With a 12.5% failure rate, a 2-proportion z test yielded P = .08. For performance accuracy, an aggregate Euclidean distance deviation from entry landmark on the pedicle and a similar deviation from the target landmark in the vertebral body yielded P = .04 from a 2-sample t test in which the rejected null hypothesis assumes no improvement in performance accuracy from the practice to the test sessions, and the alternative hypothesis assumes an improvement.The performance accuracy on the simulator was comparable to the accuracy reported in literature on recent retrospective evaluation of such placements. The failure rates indicated a minor drop from practice to test sessions, and also indicated a trend (P = .08) toward learning retention resulting in improvement from practice to test sessions. The performance accuracy showed a 15% mean score improvement and more than a 50% reduction in standard deviation from practice to test. It showed evidence (P = .04) of performance accuracy improvement from practice to test session.
| S-EPMC3153609 | biostudies-literature
Project description:Gait analysis is a technique that is used to understand movement patterns and, in some cases, to inform the development of rehabilitation protocols. Traditional rehabilitation approaches have relied on expert guided feedback in clinical settings. Such efforts require the presence of an expert to inform the re-training (to evaluate any improvement) and the patient to travel to the clinic. Nowadays, potential opportunities exist to employ the use of digitized "feedback" modalities to help a user to "understand" improved gait technique. This is important as clear and concise feedback can enhance the quality of rehabilitation and recovery. A critical requirement emerges to consider the quality of feedback from the user perspective i.e. how they process, understand and react to the feedback. In this context, this paper reports the results of a Quality of Experience (QoE) evaluation of two feedback modalities: Augmented Reality (AR) and Haptic, employed as part of an overall gait analysis system. The aim of the feedback is to reduce varus/valgus misalignments, which can cause serious orthopedics problems. The QoE analysis considers objective (improvement in knee alignment) and subjective (questionnaire responses) user metrics in 26 participants, as part of a within subject design. Participants answered 12 questions on QoE aspects such as utility, usability, interaction and immersion of the feedback modalities via post-test reporting. In addition, objective metrics of participant performance (angles and alignment) were also considered as indicators of the utility of each feedback modality. The findings show statistically significant higher QoE ratings for AR feedback. Also, the number of knee misalignments was reduced after users experienced AR feedback (35% improvement with AR feedback relative to baseline when compared to haptic). Gender analysis showed significant differences in performance for number of misalignments and time to correct valgus misalignment (for males when they experienced AR feedback). The female group self-reported higher utility and QoE ratings for AR when compared to male group.
| S-EPMC7089541 | biostudies-literature
Project description:With proper guidance, virtual reality (VR) can provide psychiatric therapeutic strategies within a simulated environment. The visuo-haptic-based multimodal feedback VR solution has been developed to improve anxiety symptoms through immersive experience and feedback. A proof-of-concept study was performed to investigate this VR solution. Nine subjects recently diagnosed with panic disorder were recruited, and seven of them eventually completed the trial. Two VR sessions were provided to each subject. Depression, anxiety, and VR sickness were evaluated before and after each session. Although there was no significant effect of the VR sessions on psychiatric symptoms, we could observe a trend of improvement in depression, anxiety, and VR sickness. The VR solution was effective in relieving subjective anxiety, especially in panic disorder without comorbidity. VR sickness decreased over time. This study is a new proof-of-concept trial to evaluate the therapeutic effect of VR solutions on anxiety symptoms using visuo-haptic-based multimodal feedback simultaneously.
| S-EPMC6393753 | biostudies-literature
Project description:BACKGROUND: Virtual reality (VR) is an emerging new modality for laparoscopic skills training; however, most simulators lack realistic haptic feedback. Augmented reality (AR) is a new laparoscopic simulation system offering a combination of physical objects and VR simulation. Laparoscopic instruments are used within an hybrid mannequin on tissue or objects while using video tracking. This study was designed to assess the difference in realism, haptic feedback, and didactic value between AR and VR laparoscopic simulation. METHODS: The ProMIS AR and LapSim VR simulators were used in this study. The participants performed a basic skills task and a suturing task on both simulators, after which they filled out a questionnaire about their demographics and their opinion of both simulators scored on a 5-point Likert scale. The participants were allotted to 3 groups depending on their experience: experts, intermediates and novices. Significant differences were calculated with the paired t-test. RESULTS: There was general consensus in all groups that the ProMIS AR laparoscopic simulator is more realistic than the LapSim VR laparoscopic simulator in both the basic skills task (mean 4.22 resp. 2.18, P < 0.000) as well as the suturing task (mean 4.15 resp. 1.85, P < 0.000). The ProMIS is regarded as having better haptic feedback (mean 3.92 resp. 1.92, P < 0.000) and as being more useful for training surgical residents (mean 4.51 resp. 2.94, P < 0.000). CONCLUSIONS: In comparison with the VR simulator, the AR laparoscopic simulator was regarded by all participants as a better simulator for laparoscopic skills training on all tested features.
| S-EPMC1913183 | biostudies-other
Project description:Haptic devices are in general more adept at mimicking the bulk properties of materials than they are at mimicking the surface properties. This paper describes a haptic glove capable of producing sensations reminiscent of three types of near-surface properties: hardness, temperature, and roughness. To accomplish this mixed mode of stimulation, three types of haptic actuators were combined: vibrotactile motors, thermoelectric devices, and electrotactile electrodes made from a stretchable conductive polymer synthesized in our laboratory. This polymer consisted of a stretchable polyanion which served as a scaffold for the polymerization of poly(3,4-ethylenedioxythiophene) (PEDOT). The scaffold was synthesized using controlled radical polymerization to afford material of low dispersity, relatively high conductivity (0.1 S cm-1), and low impedance relative to metals. The glove was equipped with flex sensors to make it possible to control a robotic hand and a hand in virtual reality (VR). In psychophysical experiments, human participants were able to discern combinations of electrotactile, vibrotactile, and thermal stimulation in VR. Participants trained to associate these sensations with roughness, hardness, and temperature had an overall accuracy of 98%, while untrained participants had an accuracy of 85%. Sensations could similarly be conveyed using a robotic hand equipped with sensors for pressure and temperature.
| S-EPMC7351316 | biostudies-literature
Project description:3D visualization technologies such as virtual reality (VR), augmented reality (AR), and mixed reality (MR) have gained popularity in the recent decade. Digital extended reality (XR) technologies have been adopted in various domains ranging from entertainment to education because of their accessibility and affordability. XR modalities create an immersive experience, enabling 3D visualization of the content without a conventional 2D display constraint. Here, we provide a perspective on XR in current biomedical applications and demonstrate case studies using cell biology concepts, multiplexed proteomics images, surgical data for heart operations, and cardiac 3D models. Emerging challenges associated with XR technologies in the context of adverse health effects and a cost comparison of distinct platforms are discussed. The presented XR platforms will be useful for biomedical education, medical training, surgical guidance, and molecular data visualization to enhance trainees' and students' learning, medical operation accuracy, and the comprehensibility of complex biological systems.
| S-EPMC8324499 | biostudies-literature
Project description:BackgroundCerebral palsy (CP) is the most common developmental motor disorder in children. Individuals with CP demonstrate abnormal muscle tone and motor control. Within the population of children with CP, between 4% and 17% present dystonic symptoms that may manifest as large errors in movement tasks, high variability in movement trajectories, and undesired movements at rest. These symptoms of dystonia typically worsen with physical intervention exercises.ObjectiveThe aim of this study is to establish the effect of haptic feedback in a virtual reality (VR) game intervention on movement outcomes of children with dystonic CP.MethodsThe protocol describes a randomized controlled trial that uses a VR game-based intervention incorporating fully automated robotic haptic feedback. The study consists of face-to-face assessments of movement before, after, and 1 month following the completion of the 6-session game-based intervention. Children with dystonic CP, aged between 7 and 17 years, will be recruited for this study through posted fliers and laboratory websites along with a group of typically developing (TD) children in the same age range. We anticipate to recruit a total of 68 participants, 34 each with CP and TD. Both groups of children will be randomly allocated into an intervention or control group using a blocked randomization method. The primary outcome measure will be the smoothness index of the interaction force with the robot and of the accelerometry signals of sensors placed on the upper limb segments. Secondary outcomes include a battery of clinical tests and a quantitative measure of spasticity. Assessors administering clinical measures will be blinded. All sessions will be administered on-site by research personnel.ResultsThe trial has not started and is pending local institutional review board approval.ConclusionsMovement outcomes will be examined for changes in muscle activation and clinical measures in children with dystonic CP and TD children. Paired t tests will be conducted on movement outcomes for both groups of children independently. Positive and negative results will be reported and addressed.Trial registrationClinicalTrials.gov NCT03744884; https://clinicaltrials.gov/ct2/show/NCT03744884 (Archived by WebCite at http://www.webcitation.org/74RSvmbZP).International registered report identifier (irrid)PRR1-10.2196/11470.
| S-EPMC6682270 | biostudies-literature
Project description:The desire to directly touch and experience virtual objects led to the development of a tactile feedback device. In this paper, a novel soft pneumatic actuator for providing tactile feedback is proposed and demonstrated. The suggested pneumatic actuator does not use an external air compressor but it is operated by internal air pressure generated by an electrostatic force. By using the actuator, we designed a glove to interact with virtual reality. The finger motions are detected by attached flexible piezoelectric sensors and transmitted to a virtual space through Bluetooth for interconnecting with a virtual hand. When the virtual finger touches the virtual object, the actuators are activated and give the tactile feedback to the real fingertip. The glove is made of silicone rubber material and integrated with the sensors and actuators such that users can wear them conveniently with light weight. This device was tested in a virtual chess board program, wherein the user picked up virtual chess pieces successfully.
| S-EPMC6639318 | biostudies-literature