Improvements in the learnability of smartphone haptic interfaces for visually impaired users.
Ontology highlight
ABSTRACT:
SUBMITTER: Gonzalez-Canete FJ
PROVIDER: S-EPMC6844543 | biostudies-literature | 2019
REPOSITORIES: biostudies-literature
Publications
Improvements in the learnability of smartphone haptic interfaces for visually impaired users.
González-Cañete F J FJ López Rodríguez J L JL Galdón P M PM Díaz-Estrella A A
PloS one 20191111 11
We report the results of a study on the learnability of haptic icons used as alerts or notifications in smartphones. The aim was to explore the feasibility of using haptic icons to create assistive technologies for people with visual impairments. We compared the performance and satisfaction of users with different visual capacities (visually impaired vs. sighted) and using different learning processes (with or without a reinforcement learning stage). The reinforcement learning stage improves the ...[more]
Similar Datasets
Project description:We report the results of a study on the learnability of the locations of haptic icons on smartphones. The aim was to study the influence of the use of complex and different vibration patterns associated with haptic icons compared to the use of simple and equal vibrations on commercial location-assistance applications. We studied the performance of users with different visual capacities (visually impaired vs. sighted) in terms of the time taken to learn the icons' locations and the icon recognition rate. We also took into consideration the users' satisfaction with the application developed to perform the study. The experiments concluded that the use of complex and different instead of simple and equal vibration patterns obtains better recognition rates. This improvement is even more noticeable for visually impaired users, who obtain results comparable to those achieved by sighted users.
| S-EPMC8347385 | biostudies-literature
Project description:In the event of visual impairment or blindness, information from other intact senses can be used as substitutes to retrain (and in extremis replace) visual functions. Abilities including reading, mental representation of objects and spatial navigation can be performed using tactile information. Current technologies can convey a restricted library of stimuli, either because they depend on real objects or renderings with low resolution layouts. Digital haptic technologies can overcome such limitations. The applicability of this technology was previously demonstrated in sighted participants. Here, we reasoned that visually-impaired and blind participants can create mental representations of letters presented haptically in normal and mirror-reversed form without the use of any visual information, and mentally manipulate such representations. Visually-impaired and blind volunteers were blindfolded and trained on the haptic tablet with two letters (either L and P or F and G). During testing, they haptically explored on any trial one of the four letters presented at 0°, 90°, 180°, or 270° rotation from upright and indicated if the letter was either in a normal or mirror-reversed form. Rotation angle impacted performance; greater deviation from 0° resulted in greater impairment for trained and untrained normal letters, consistent with mental rotation of these haptically-rendered objects. Performance was also generally less accurate with mirror-reversed stimuli, which was not affected by rotation angle. Our findings demonstrate, for the first time, the suitability of a digital haptic technology in the blind and visually-impaired. Classic devices remain limited in their accessibility and in the flexibility of their applications. We show that mental representations can be generated and manipulated using digital haptic technology. This technology may thus offer an innovative solution to the mitigation of impairments in the visually-impaired, and to the training of skills dependent on mental representations and their spatial manipulation.
| S-EPMC7099598 | biostudies-literature
Project description:SignificanceVisually impaired participants were surprisingly fast in learning a new sensory substitution device, which allows them to detect obstacles within a 3.5-m radius and to find the optimal path in between. Within a few hours of training, participants successfully performed complex navigation as well as with the white cane.PurposeGlobally, millions of people live with vision impairment, yet effective assistive devices to increase their independence remain scarce. A promising method is the use of sensory substitution devices, which are human-machine interfaces transforming visual into auditory or tactile information. The Sound of Vision (SoV) system continuously encodes visual elements of the environment into audio-haptic signals. Here, we evaluated the SoV system in complex navigation tasks, to compare performance with the SoV system with the white cane, quantify training effects, and collect user feedback.MethodsSix visually impaired participants received eight hours of training with the SoV system, completed a usability questionnaire, and repeatedly performed assessments, for which they navigated through standardized scenes. In each assessment, participants had to avoid collisions with obstacles, using the SoV system, the white cane, or both assistive devices.ResultsThe results show rapid and substantial learning with the SoV system, with less collisions and higher obstacle awareness. After four hours of training, visually impaired people were able to successfully avoid collisions in a difficult navigation task as well as when using the cane, although they still needed more time. Overall, participants rated the SoV system's usability favorably.ConclusionsContrary to the cane, the SoV system enables users to detect the best free space between objects within a 3.5-m (up to 10-m) radius and, importantly, elevated and dynamic obstacles. All in all, we consider that visually impaired people can learn to adapt to the haptic-auditory representation and achieve expertise in usage through well-defined training within acceptable time.
| S-EPMC6133230 | biostudies-literature
Project description: Not available
| S-EPMC10697294 | biostudies-literature
Project description:Haptics as a communication medium has been increasingly emphasized across various disciplines. Recent efforts have focused on developing various haptic stimulation technologies; however, most of them suffer from critical drawbacks stemming from their bulk, complexity, large power input, or high cost. Here, we describe a strategy to design portable and affordable refreshable haptic interfaces composed of an array of individually addressable and controllable liquid pouch motor-based haptic units embedded in either rigid or flexible substrates for different application contexts. The pouch motor filled with low boiling fluid, under a controlled manner, expands or contracts by Joule heating or cooling, enabling the haptic pin in contact to be protruded or retracted. Programming the actuation sequence of an array of haptic units enables the haptic interface to apply different stimuli to the skin to convey corresponding information. We finally demonstrate the applications to portable rigid braille displays and flexible epidermal VR devices. This study opens the avenue to the design of ubiquitous refreshable haptic interfaces that is portable, affordable, scalable, and uninjurious.
| S-EPMC9429979 | biostudies-literature
Project description:Congenitally blind infants are not only deprived of visual input but also of visual influences on the intact senses. The important role that vision plays in the early development of multisensory spatial perception1-7 (e.g., in crossmodal calibration8-10 and in the formation of multisensory spatial representations of the body and the world1,2) raises the possibility that impairments in spatial perception are at the heart of the wide range of difficulties that visually impaired infants show across spatial,8-12 motor,13-17 and social domains.8,18,19 But investigations of early development are needed to clarify how visually impaired infants' spatial hearing and touch support their emerging ability to make sense of their body and the outside world. We compared sighted (S) and severely visually impaired (SVI) infants' responses to auditory and tactile stimuli presented on their hands. No statistically reliable differences in the direction or latency of responses to auditory stimuli emerged, but significant group differences emerged in responses to tactile and audiotactile stimuli. The visually impaired infants showed attenuated audiotactile spatial integration and interference, weighted more tactile than auditory cues when the two were presented in conflict, and showed a more limited influence of representations of the external layout of the body on tactile spatial perception.20 These findings uncover a distinct phenotype of multisensory spatial perception in early postnatal visual deprivation. Importantly, evidence of audiotactile spatial integration in visually impaired infants, albeit to a lesser degree than in sighted infants, signals the potential of multisensory rehabilitation methods in early development. VIDEO ABSTRACT.
| S-EPMC8612739 | biostudies-literature
Project description:BACKGROUND:Each year, millions of older adults fall, with more than 1 out of 4 older people experiencing a fall annually, thereby causing a major social and economic impact. Falling once doubles one’s chances of falling again, making fall prediction an important aspect of preventative strategies. In this study, 22 older adults aged between 65 and 85 years were trained in the use of a smartphone-based fall prediction system. The system is designed to continuously assess fall risk by measuring various gait and balance parameters using a smart insole and smartphone, and is also designed to detect falls. The use case of the fall prediction system in question required the users to interact with the smartphone via an app for device syncing, data uploads, and checking system status. OBJECTIVE:The objective of this study was to observe the effect that basic smartphone training could have on the user experience of a group that is not technically proficient with smartphones when using a new connected health system. It was expected that even short rudimentary training could have a large effect on user experience and therefore increase the chances of the group accepting the new technology. METHODS:All participants received training on how to use the system smartphone app; half of the participants (training group) also received extra training on how to use basic functions of the smartphone, such as making calls and sending text messages, whereas the other half did not receive this extra training (no extra training group). Comparison of training group and no extra training group was carried out using metrics such as satisfaction rating, time taken to complete tasks, cues required to complete tasks, and errors made during tasks. RESULTS:The training group fared better in the first 3 days of using the system. There were significant recorded differences in number of cues required and errors committed between the two groups. By the fourth and fifth day of use, both groups were performing at the same level when using the system. CONCLUSIONS:Supplementary basic smartphone training may be critical in trials where a smartphone app–based system for health intervention purposes is being introduced to a population that is not proficient with technology. This training could prevent early technology rejection and increase the engagement of older participants and their overall user experience with the system.
| S-EPMC5945986 | biostudies-literature
Project description:Skin-integrated electronics, also known as electronic skin (e-skin), are rapidly developing and are gradually being adopted in biomedical fields as well as in our daily lives. E-skin capable of providing sensitive and high-resolution tactile sensations and haptic feedback to the human body would open a new e-skin paradigm for closed-loop human-machine interfaces. Here, we report a class of materials and mechanical designs for the miniaturization of mechanical actuators and strategies for their integration into thin, soft e-skin for haptic interfaces. The mechanical actuators exhibit small dimensions of 5 mm diameter and 1.45 mm thickness and work in an electromagnetically driven vibrotactile mode with resonance frequency overlapping the most sensitive frequency of human skin. Nine mini actuators can be integrated simultaneously in a small area of 2 cm × 2 cm to form a 3 × 3 haptic feedback array, which is small and compact enough to mount on a thumb tip. Furthermore, the thin, soft haptic interface exhibits good mechanical properties that work properly during stretching, bending, and twisting and therefore can conformally fit onto various parts of the human body to afford programmable tactile enhancement and Braille recognition with an accuracy rate over 85%.
| S-EPMC8536704 | biostudies-literature
Project description:BackgroundTo describe the development and investigate the accuracy of a novel smartphone-based Contrast Sensitivity (CS) application, the K-CS test.MethodsA total of 67 visually impaired and 50 normal participants were examined monocularly using the novel digital K-CS test and the Pelli-Robson (PR) chart. The K-CS test examines letter contrast sensitivity in logarithmic units, using eight levels of contrast from logCS = ~0,1 to logCS = ~2,1 at two spatial frequencies of 1.5 and 3 cycles per degree (cpd). The K-CS test was compared to the gold standard, PR test and intra-session test repeatability was also examined.ResultsThe K-CS test in normally sighted was found to agree well with the PR, providing comparable mean scores in logCS (±SD) (K-CS = 1.908 ± 0.06 versus PR = 1.93 ± 0.05) at 1.5 cpd and mean (± SD) logCS at 3 cpd (K-CS = 1.83 ± 0.13 versus PR = 1.86 ± 0.07). The mean best corrected visual acuity of visually impaired participants was 0.67 LogMAR (SD = 0.21) and the K-CS was also found to agree well with the Pelli-Robson in this group, with an equivalent mean (±SD) logCS at 1.5 cpd: (K-CS = 1.19 ± 0.27, PR = 1.15 ± 0.31), 3 cpd: K-CS = 1.01 ± 0.33, PR = 0.94 ± 0.34. Regarding the intra-session test repeatability, both the K-CS test and the PR test showed good repeatability in terms of the 95% limits of agreement (LoA): K-CS = ±0.112 at 1.5 cpd and ±0.133 at 3 cpd, PR = ±0.143 at 1.5 cpd and ±0.183 in 3 cpd in visually impaired individuals.ConclusionThe K-CS test provides a quick assessment of the CS both in normally sighted and visually impaired individuals. The K-CS could serve as an alternative tool to assess contrast sensitivity function using a smartphone and provides results that agree well with the commonly used PR test.
| S-EPMC10852338 | biostudies-literature
Project description:How humans visually select where to grasp objects is determined by the physical object properties (e.g., size, shape, weight), the degrees of freedom of the arm and hand, as well as the task to be performed. We recently demonstrated that human grasps are near-optimal with respect to a weighted combination of different cost functions that make grasps uncomfortable, unstable, or impossible, e.g., due to unnatural grasp apertures or large torques. Here, we ask whether humans can consciously access these rules. We test if humans can explicitly judge grasp quality derived from rules regarding grasp size, orientation, torque, and visibility. More specifically, we test if grasp quality can be inferred (i) by using visual cues and motor imagery alone, (ii) from watching grasps executed by others, and (iii) through performing grasps, i.e., receiving visual, proprioceptive and haptic feedback. Stimuli were novel objects made of 10 cubes of brass and wood (side length 2.5 cm) in various configurations. On each object, one near-optimal and one sub-optimal grasp were selected based on one cost function (e.g., torque), while the other constraints (grasp size, orientation, and visibility) were kept approximately constant or counterbalanced. Participants were visually cued to the location of the selected grasps on each object and verbally reported which of the two grasps was best. Across three experiments, participants were required to either (i) passively view the static objects and imagine executing the two competing grasps, (ii) passively view videos of other participants grasping the objects, or (iii) actively grasp the objects themselves. Our results show that, for a majority of tested objects, participants could already judge grasp optimality from simply viewing the objects and imagining to grasp them, but were significantly better in the video and grasping session. These findings suggest that humans can determine grasp quality even without performing the grasp-perhaps through motor imagery-and can further refine their understanding of how to correctly grasp an object through sensorimotor feedback but also by passively viewing others grasp objects.
| S-EPMC7835720 | biostudies-literature