Smartphone-Based Inertial Odometry for Blind Walkers.
Ontology highlight
ABSTRACT:
SUBMITTER: Ren P
PROVIDER: S-EPMC8230905 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Visual inertial odometry (VIO) is the front-end of visual simultaneous localization and mapping (vSLAM) methods and has been actively studied in recent years. In this context, a time-of-flight (ToF) camera, with its high accuracy of depth measurement and strong resilience to ambient light of variable intensity, draws our interest. Thus, in this paper, we present a realtime visual inertial system based on a low cost ToF camera. The iterative closest point (ICP) methodology is adopted, incorporating salient point-selection criteria and a robustness-weighting function. In addition, an error-state Kalman filter is used and fused with inertial measurement unit (IMU) data. To test its capability, the ToF-VIO system is mounted on an unmanned aerial vehicle (UAV) platform and operated in a variable light environment. The estimated flight trajectory is compared with the ground truth data captured by a motion capture system. Real flight experiments are also conducted in a dark indoor environment, demonstrating good agreement with estimated performance. The current system is thus shown to be accurate and efficient for use in UAV applications in dark and Global Navigation Satellite System (GNSS)-denied environments.
| S-EPMC7085618 | biostudies-literature
Project description:Commercial visual-inertial odometry (VIO) systems have been gaining attention as cost-effective, off-the-shelf, six-degree-of-freedom (6-DoF) ego-motion-tracking sensors for estimating accurate and consistent camera pose data, in addition to their ability to operate without external localization from motion capture or global positioning systems. It is unclear from existing results, however, which commercial VIO platforms are the most stable, consistent, and accurate in terms of state estimation for indoor and outdoor robotic applications. We assessed four popular proprietary VIO systems (Apple ARKit, Google ARCore, Intel RealSense T265, and Stereolabs ZED 2) through a series of both indoor and outdoor experiments in which we showed their positioning stability, consistency, and accuracy. After evaluating four popular VIO sensors in challenging real-world indoor and outdoor scenarios, Apple ARKit showed the most stable and high accuracy/consistency, and the relative pose error was a drift error of about 0.02 m per second. We present our complete results as a benchmark comparison for the research community.
| S-EPMC9785098 | biostudies-literature
Project description:Background and objectivesGait can be severely affected by pain, muscle weakness, and aging resulting in lameness. Despite the high incidence of lameness, there are no studies on the features that are useful for classifying lameness patterns. Therefore, we aimed to identify features of high importance for classifying population differences in lameness patterns using an inertial measurement unit mounted above the sacral region.MethodsFeatures computed exhaustively for multidimensional time series consisting of three-axis angular velocities and three-axis acceleration were carefully selected using the Benjamini-Yekutieli procedure, and multiclass classification was performed using LightGBM (Microsoft Corp., Redmond, WA, USA). We calculated the relative importance of the features that contributed to the classification task in machine learning.ResultsThe most important feature was found to be the absolute value of the Fourier coefficients of the second frequency calculated by the one-dimensional discrete Fourier transform for real input. This was determined by the fast Fourier transformation algorithm using data of a single gait cycle of the yaw angular velocity of the pelvic region.ConclusionsUsing an inertial measurement unit worn over the sacral region, we determined a set of features of high importance for classifying differences in lameness patterns based on different factors. This completely new set of indicators can be used to advance the understanding of lameness.
| S-EPMC8483374 | biostudies-literature
Project description:'Turn slightly to the left' the navigational system announces, with the aim of directing a blind user to merge into a corridor. Yet, due to long reaction time, the user turns too late and proceeds into the wrong hallway. Observations of such user behavior in real-world navigation settings motivate us to study the manner in which blind users react to the instructional feedback of a turn-by-turn guidance system. We found little previous work analyzing the extent of the variability among blind users in reaction to different instructional guidance during assisted navigation. To gain insight into how navigational interfaces can be better designed to accommodate the information needs of different users, we conduct a data-driven analysis of reaction variability as defined by motion and timing measures. Based on continuously tracked user motion during real-world navigation with a deployed system, we find significant variability between users in their reaction characteristics. Specifically, the statistical analysis reveals significant variability during the crucial elements of the navigation (e.g., turning and encountering obstacles). With the end-user experience in mind, we identify the need to not only adjust interface timing and content to each user's personal walking pace, but also their individual navigation skill and style. The design implications of our study inform the development of assistive systems which consider such user-specific behavior to ensure successful navigation.
| S-EPMC6708581 | biostudies-literature
Project description:This paper presents an end-to-end learning framework for performing 6-DOF odometry by using only inertial data obtained from a low-cost IMU. The proposed inertial odometry method allows leveraging inertial sensors that are widely available on mobile platforms for estimating their 3D trajectories. For this purpose, neural networks based on convolutional layers combined with a two-layer stacked bidirectional LSTM are explored from the following three aspects. First, two 6-DOF relative pose representations are investigated: one based on a vector in the spherical coordinate system, and the other based on both a translation vector and an unit quaternion. Second, the loss function in the network is designed with the combination of several 6-DOF pose distance metrics: mean squared error, translation mean absolute error, quaternion multiplicative error and quaternion inner product. Third, a multi-task learning framework is integrated to automatically balance the weights of multiple metrics. In the evaluation, qualitative and quantitative analyses were conducted with publicly-available inertial odometry datasets. The best combination of the relative pose representation and the loss function was the translation and quaternion together with the translation mean absolute error and quaternion multiplicative error, which obtained more accurate results with respect to state-of-the-art inertial odometry techniques.
| S-EPMC6749526 | biostudies-other
Project description:Accurate and reliable measurement of the severity of dystonia is essential for the indication, evaluation, monitoring and fine-tuning of treatments. Assessment of dystonia in children and adolescents with dyskinetic cerebral palsy (CP) is now commonly performed by visual evaluation either directly in the doctor's office or from video recordings using standardized scales. Both methods lack objectivity and require much time and effort of clinical experts. Only a snapshot of the severity of dyskinetic movements (i.e., choreoathetosis and dystonia) is captured, and they are known to fluctuate over time and can increase with fatigue, pain, stress or emotions, which likely happens in a clinical environment. The goal of this study was to investigate whether it is feasible to use home-based measurements to assess and evaluate the severity of dystonia using smartphone-coupled inertial sensors and machine learning. Video and sensor data during both active and rest situations from 12 patients were collected outside a clinical setting. Three clinicians analyzed the videos and clinically scored the dystonia of the extremities on a 0-4 scale, following the definition of amplitude of the Dyskinesia Impairment Scale. The clinical scores and the sensor data were coupled to train different machine learning models using cross-validation. The average F1 scores (0.67 ± 0.19 for lower extremities and 0.68 ± 0.14 for upper extremities) in independent test datasets indicate that it is possible to detected dystonia automatically using individually trained models. The predictions could complement standard dyskinetic CP measures by providing frequent, objective, real-world assessments that could enhance clinical care. A generalized model, trained with data from other subjects, shows lower F1 scores (0.45 for lower extremities and 0.34 for upper extremities), likely due to a lack of training data and dissimilarities between subjects. However, the generalized model is reasonably able to distinguish between high and lower scores. Future research should focus on gathering more high-quality data and study how the models perform over the whole day.
| S-EPMC9231145 | biostudies-literature
Project description:Recent studies have shown that honeybees flying through short, narrow tunnels with visually textured walls perform waggle dances that indicate a much greater flight distance than that actually flown. These studies suggest that the bee's "odometer" is driven by the optic flow (image motion) that is experienced during flight. One might therefore expect that, when bees fly to a food source through a varying outdoor landscape, their waggle dances would depend upon the nature of the terrain experienced en route. We trained honeybees to visit feeders positioned along two routes, each 580 m long. One route was exclusively over land. The other was initially over land, then over water and, finally, again over land. Flight over water resulted in a significantly flatter slope of the waggle-duration versus distance regression, compared to flight over land. The mean visual contrast of the scenes was significantly greater over land than over water. The results reveal that, in outdoor flight, the honeybee's odometer does not run at a constant rate; rather, the rate depends upon the properties of the terrain. The bee's perception of distance flown is therefore not absolute, but scene-dependent. These findings raise important and interesting questions about how these animals navigate reliably.
| S-EPMC449896 | biostudies-literature
Project description:Entorhinal grid cells integrate sensory and self-motion inputs to provide a spatial metric of a characteristic scale. One function of this metric may be to help localize the firing fields of hippocampal place cells during formation and use of the hippocampal spatial representation ("cognitive map"). Of theoretical importance is the question of how this metric, and the resulting map, is configured in 3D space. We find here that when the body plane is vertical as rats climb a wall, grid cells produce stable, almost-circular grid-cell firing fields. This contrasts with previous findings when the body was aligned horizontally during vertical exploration, suggesting a role for the body plane in orienting the plane of the grid cell map. However, in the present experiment, the fields on the wall were fewer and larger, suggesting an altered or absent odometric (distance-measuring) process. Several physiological indices of running speed in the entorhinal cortex showed reduced gain, which may explain the enlarged grid pattern. Hippocampal place fields were found to be sparser but unchanged in size/shape. Together, these observations suggest that the orientation and scale of the grid cell map, at least on a surface, are determined by an interaction between egocentric information (the body plane) and allocentric information (the gravity axis). This may be mediated by the different sensory or locomotor information available on a vertical surface and means that the resulting map has different properties on a vertical plane than a horizontal plane (i.e., is anisotropic).
| S-EPMC6410878 | biostudies-literature
Project description:The first microscopic artificial walker equipped with liquid-crystalline elastomer muscle is reported. The walker is fabricated by direct laser writing, is smaller than any known living terrestrial creatures, and is capable of several autonomous locomotions on different surfaces.
| S-EPMC4660875 | biostudies-literature
Project description:BackgroundThe B-B Score is a straightforward kinematic shoulder function score including only two movements (hand to the Back + lift hand as to change a Bulb) that demonstrated sound measurement properties for patients for various shoulder pathologies. However, the B-B Score results using a smartphone or a reference system have not yet been compared. Provided that the measurement properties are comparable, the use of a smartphone would offer substantial practical advantages. This study investigated the concurrent validity of a smartphone and a reference inertial system for the measurement of the kinematic shoulder function B-B Score.MethodsSixty-five patients with shoulder conditions (with rotator cuff conditions, adhesive capsulitis and proximal humerus fracture) and 20 healthy participants were evaluated using a smartphone and a reference inertial system. Measurements were performed twice, alternating between two evaluators. The B-B Score differences between groups, differences between devices, relationship between devices, intra- and inter-evaluator reproducibility were analysed.ResultsThe smartphone mean scores (SD) were 94.1 (11.1) for controls and 54.1 (18.3) for patients (P < 0.01). The difference between devices was non-significant for the control (P = 0.16) and the patient group (P = 0.81). The analysis of the relationship between devices showed 0.97 ICC, -0.6 bias and -13.2 to 12.0 limits of agreement (LOA). The smartphone intra-evaluator ICC was 0.92, the bias 1.5 and the LOA -17.4 to 20.3. The smartphone inter-evaluator ICC was 0.92, the bias 1.5 and the LOA -16.9 to 20.0.ConclusionsThe B-B Score results measured with a smartphone were comparable to those of an inertial system. While single measurements diverged in some cases, the intra- and inter-evaluator reproducibility was excellent and was equivalent between devices. The B-B score measured with a smartphone is straightforward and as efficient as a reference inertial system measurement.
| S-EPMC5358877 | biostudies-literature