Dataset Information

Combination of Simultaneous Artificial Sensory Percepts to Identify Prosthetic Hand Postures: A Case Study.

ABSTRACT: Multiple sources of sensory information are combined to develop hand posture percepts in the intact system, but the combination of multiple artificial somatosensory percepts by human prosthesis users has not been studied. Here, we report on a case study in which a person with transradial amputation identified prosthetic hand postures using artificial somatosensory feedback. He successfully combined five artificial somatosensory percepts to achieve above-chance performance of 95.0% and 75.7% in identifying four and seven postures, respectively. We studied how artificial somatosensation and the extant hand representation are combined in the decision-making process by providing two mappings between the prosthetic sensor and the location of the sensory percept: (1) congruent, and (2) incongruent. The participant's ability to combine and engage with the sensory feedback significantly differed between the two conditions. The participant was only able to successfully generalize prior knowledge to novel postures in the congruent mapping. Further, he learned postures more accurately and quickly in the congruent mapping. Finally, he developed an understanding of the relationships between postures in the congruent mapping instead of simply memorizing each individual posture. These experimental results are corroborated by a Bayesian decision-making model which tracked the participant's learning.

SUBMITTER: Segil JL

PROVIDER: S-EPMC7171192 | biostudies-literature | 2020 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Combination of Simultaneous Artificial Sensory Percepts to Identify Prosthetic Hand Postures: A Case Study.

Segil Jacob L JL Cuberovic Ivana I Graczyk Emily L EL Weir Richard F Ff RFF Tyler Dustin D

Scientific reports 20200420 1

Multiple sources of sensory information are combined to develop hand posture percepts in the intact system, but the combination of multiple artificial somatosensory percepts by human prosthesis users has not been studied. Here, we report on a case study in which a person with transradial amputation identified prosthetic hand postures using artificial somatosensory feedback. He successfully combined five artificial somatosensory percepts to achieve above-chance performance of 95.0% and 75.7% in i ...[more]

PMID: 32313060

Similar Datasets

Project description:BackgroundCurrent commercial prosthetic hand controllers limit patients' ability to fully engage high Degree-of-Freedom (DoF) prosthetic hands. Available feedforward controllers rely on large training data sets for controller setup and a need for recalibration upon prosthesis donning. Recently, an intuitive, proportional, simultaneous, regression-based 3-DoF controller remained stable for several months without retraining by combining chronically implanted electromyography (ciEMG) electrodes with a K-Nearest-Neighbor (KNN) mapping technique. The training dataset requirements for simultaneous KNN controllers increase exponentially with DoF, limiting the realistic development of KNN controllers in more than three DoF. We hypothesize that a controller combining linear interpolation, the muscle synergy framework, and a sufficient number of ciEMG channels (at least two per DoF), can allow stable, high-DoF control.MethodsTwo trans-radial amputee subjects, S6 and S8, were implanted with percutaneously interfaced bipolar intramuscular electrodes. At the time of the study, S6 and S8 had 6 and 8 bipolar EMG electrodes, respectively. A Virtual Reality (VR) system guided users through single and paired training movements in one 3-DoF and four different 4-DoF cases. A linear model of user activity was built by partitioning EMG feature space into regions bounded by vectors of steady state movement EMG patterns. The controller evaluated online EMG signals by linearly interpolating the movement class labels for surrounding trained EMG movements. This yields a simultaneous, continuous, intuitive, and proportional controller. Controllers were evaluated in 3-DoF and 4-DoF through a target-matching task in which subjects controlled a virtual hand to match 80 targets spanning the available movement space. Match Percentage, Time-To-Target, and Path Efficiency were evaluated over a 10-month period based on subject availability.Results and conclusionsIn 3-DoF, S6 and S8 matched most targets and demonstrated stable control after 8 and 10 months, respectively. In 4-DoF, both subjects initially found two of four 4-DoF controllers usable, matching most targets. S8 4-DoF controllers were stable, and showed improving trends over 7-9 months without retraining or at-home practice. S6 4-DoF controllers were unstable after 7 months without retraining. These results indicate that the performance of the controller proposed in this study may remain stable, or even improve, provided initial viability and a sufficient number of EMG channels. Overall, this study demonstrates a controller capable of stable, simultaneous, proportional, intuitive, and continuous control in 3-DoF for up to ten months and in 4-DoF for up to nine months without retraining or at-home use with minimal training times.

Project description:The overarching goal was to resolve a major barrier to real-life prosthesis usability-the rapid degradation of prosthesis control systems, which require frequent recalibrations. Specifically, we sought to develop and test a motor decoder that provides (1) highly accurate, real-time movement response, and (2) unprecedented adaptability to dynamic changes in the amputee's biological state, thereby supporting long-term integrity of control performance with few recalibrations. To achieve that, an adaptive motor decoder was designed to auto-switch between algorithms in real-time. The decoder detects the initial aggregate motoneuron spiking activity from the motor pool, then engages the optimal parameter settings for decoding the motoneuron spiking activity in that particular state. "Clear-box" testing of decoder performance under varied physiological conditions and post-amputation complications was conducted by comparing the movement output of a simulated prosthetic hand as driven by the decoded signal vs. as driven by the actual signal. Pearson's correlation coefficient and Normalized Root Mean Square Error were used to quantify the accuracy of the decoder's output. Our results show that the decoder algorithm extracted the features of the intended movement and drove the simulated prosthetic hand accurately with real-time performance (<10 ms) (Pearson's correlation coefficient >0.98 to >0.99 and Normalized Root Mean Square Error <13-5%). Further, the decoder robustly decoded the spiking activity of multi-speed inputs, inputs generated from reversed motoneuron recruitment, and inputs reflecting substantial biological heterogeneity of motoneuron properties, also in real-time. As the amputee's neuromodulatory state changes throughout the day and the electrical properties and ratio of slower vs. faster motoneurons shift over time post-amputation, the motor decoder presented here adapts to such changes in real-time and is thus expected to greatly enhance and extend the usability of prostheses.

Project description:BackgroundThe human hand can perform a range of manipulation tasks, from holding a pen to holding a hammer. The central nervous system (CNS) uses different strategies in different manipulation tasks based on task requirements. Attempts to compare postures of the hand have been made for use in robotics and animation industries. In this study, we developed an index called the posture similarity index to quantify the similarity between two human hand postures.MethodsTwelve right-handed volunteers performed 70 postures, and lifted and held 30 objects (total of 100 different postures, each performed five times). A 16-sensor electromagnetic tracking system captured the kinematics of individual finger phalanges (segments). We modeled the hand as a 21-DoF system and computed the corresponding joint angles. We used principal component analysis to extract kinematic synergies from this 21-DoF data. We developed a posture similarity index (PSI), that represents the similarity between posture in the synergy (Principal component) space. First, we tested the performance of this index using a synthetic dataset. After confirming that it performs well with the synthetic dataset, we used it to analyze the experimental data. Further, we used PSI to identify postures that are "representative" in the sense that they have a greater overlap (in synergy space) with a large number of postures.ResultsOur results confirmed that PSI is a relatively accurate index of similarity in synergy space both with synthetic data and real experimental data. Also, more special postures than common postures were found among "representative" postures.ConclusionWe developed an index for comparing posture similarity in synergy space and demonstrated its utility by using synthetic dataset and experimental dataset. Besides, we found that "special" postures are actually "special" in the sense that there are more of them in the "representative" postures as identified by our posture similarity index.

Dataset Information

Combination of Simultaneous Artificial Sensory Percepts to Identify Prosthetic Hand Postures: A Case Study.

Publications

Combination of Simultaneous Artificial Sensory Percepts to Identify Prosthetic Hand Postures: A Case Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets