Dataset Information

Immersive augmented reality system for the training of pattern classification control with a myoelectric prosthesis.

ABSTRACT:

Background

Hand amputation can have a truly debilitating impact on the life of the affected person. A multifunctional myoelectric prosthesis controlled using pattern classification can be used to restore some of the lost motor abilities. However, learning to control an advanced prosthesis can be a challenging task, but virtual and augmented reality (AR) provide means to create an engaging and motivating training.

Methods

In this study, we present a novel training framework that integrates virtual elements within a real scene (AR) while allowing the view from the first-person perspective. The framework was evaluated in 13 able-bodied subjects and a limb-deficient person divided into intervention (IG) and control (CG) groups. The IG received training by performing simulated clothespin task and both groups conducted a pre- and posttest with a real prosthesis. When training with the AR, the subjects received visual feedback on the generated grasping force. The main outcome measure was the number of pins that were successfully transferred within 20 min (task duration), while the number of dropped and broken pins were also registered. The participants were asked to score the difficulty of the real task (posttest), fun-factor and motivation, as well as the utility of the feedback.

Results

The performance (median/interquartile range) consistently increased during the training sessions (4/3 to 22/4). While the results were similar for the two groups in the pretest, the performance improved in the posttest only in IG. In addition, the subjects in IG transferred significantly more pins (28/10.5 versus 14.5/11), and dropped (1/2.5 versus 3.5/2) and broke (5/3.8 versus 14.5/9) significantly fewer pins in the posttest compared to CG. The participants in IG assigned (mean?±?std) significantly lower scores to the difficulty compared to CG (5.2?±?1.9 versus 7.1?±?0.9), and they highly rated the fun factor (8.7?±?1.3) and usefulness of feedback (8.5?±?1.7).

Conclusion

The results demonstrated that the proposed AR system allows for the transfer of skills from the simulated to the real task while providing a positive user experience. The present study demonstrates the effectiveness and flexibility of the proposed AR framework. Importantly, the developed system is open source and available for download and further development.

SUBMITTER: Boschmann A

PROVIDER: S-EPMC7860185 | biostudies-literature | 2021 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Immersive augmented reality system for the training of pattern classification control with a myoelectric prosthesis.

Boschmann Alexander A Neuhaus Dorothee D Vogt Sarah S Kaltschmidt Christian C Platzner Marco M Dosen Strahinja S

Journal of neuroengineering and rehabilitation 20210204 1

<h4>Background</h4>Hand amputation can have a truly debilitating impact on the life of the affected person. A multifunctional myoelectric prosthesis controlled using pattern classification can be used to restore some of the lost motor abilities. However, learning to control an advanced prosthesis can be a challenging task, but virtual and augmented reality (AR) provide means to create an engaging and motivating training.<h4>Methods</h4>In this study, we present a novel training framework that in ...[more]

PMID: 33541376

Similar Datasets

Project description:Limb prosthetics, exoskeletons, and neurorehabilitation devices can be intuitively controlled using myoelectric pattern recognition (MPR) to decode the subject's intended movement. In conventional MPR, descriptive electromyography (EMG) features representing the intended movement are fed into a classification algorithm. The separability of the different movements in the feature space significantly affects the classification complexity. Classification complexity estimating algorithms (CCEAs) were studied in this work in order to improve feature selection, predict MPR performance, and inform on faulty data acquisition.CCEAs such as nearest neighbor separability (NNS), purity, repeatability index (RI), and separability index (SI) were evaluated based on their correlation with classification accuracy, as well as on their suitability to produce highly performing EMG feature sets. SI was evaluated using Mahalanobis distance, Bhattacharyya distance, Hellinger distance, Kullback-Leibler divergence, and a modified version of Mahalanobis distance. Three commonly used classifiers in MPR were used to compute classification accuracy (linear discriminant analysis (LDA), multi-layer perceptron (MLP), and support vector machine (SVM)). The algorithms and analytic graphical user interfaces produced in this work are freely available in BioPatRec.NNS and SI were found to be highly correlated with classification accuracy (correlations up to 0.98 for both algorithms) and capable of yielding highly descriptive feature sets. Additionally, the experiments revealed how the level of correlation between the inputs of the classifiers influences classification accuracy, and emphasizes the classifiers' sensitivity to such redundancy.This study deepens the understanding of the classification complexity in prediction of motor volition based on myoelectric information. It also provides researchers with tools to analyze myoelectric recordings in order to improve classification performance.

Project description:BACKGROUND:Digital rectal examination is a difficult examination to learn and teach because of limited opportunities for practice; however, the main challenge is that students and tutors cannot see the finger when it is palpating the anal canal and prostate gland inside the patients. OBJECTIVE:This paper presents an augmented reality system to be used with benchtop models commonly available in medical schools with the aim of addressing the problem of lack of visualization. The system enables visualization of the examining finger, as well as of the internal organs when performing digital rectal examinations. Magnetic tracking sensors are used to track the movement of the finger, and a pressure sensor is used to monitor the applied pressure. By overlaying a virtual finger on the real finger and a virtual model on the benchtop model, students can see through the examination and finger maneuvers. METHODS:The system was implemented in the Unity game engine (Unity Technologies) and uses a first-generation HoloLens (Microsoft Inc) as an augmented reality device. To evaluate the system, 19 participants (9 clinicians who routinely performed digital rectal examinations and 10 medical students) were asked to use the system and answer 12 questions regarding the usefulness of the system. RESULTS:The system showed the movement of an examining finger in real time with a frame rate of 60 fps on the HoloLens and accurately aligned the virtual and real models with a mean error of 3.9 mm. Users found the movement of the finger was realistic (mean 3.9, SD 1.2); moreover, they found the visualization of the finger and internal organs were useful for teaching, learning, and assessment of digital rectal examinations (finger: mean 4.1, SD 1.1; organs: mean 4.6, SD 0.8), mainly targeting a novice group. CONCLUSIONS:The proposed augmented reality system was designed to improve teaching and learning of digital rectal examination skills by providing visualization of the finger and internal organs. The initial user study proved its applicability and usefulness.

Project description:BACKGROUND:Although electromyogram (EMG) pattern recognition (PR) for multifunctional upper limb prosthesis control has been reported for decades, the clinical benefits have rarely been examined. The study purposes were to: 1) compare self-report and performance outcomes of a transradial amputee immediately after training and one week after training of direct myoelectric control and EMG pattern recognition (PR) for a two-degree-of-freedom (DOF) prosthesis, and 2) examine the change in outcomes one week after pattern recognition training and the rate of skill acquisition in two subjects with transradial amputations. METHODS:In this cross-over study, participants were randomized to receive either PR control or direct control (DC) training of a 2 DOF myoelectric prosthesis first. Participants were 2 persons with traumatic transradial (TR) amputations who were 1 DOF myoelectric users. Outcomes, including measures of dexterity with and without cognitive load, activity performance, self-reported function, and prosthetic satisfaction were administered immediately and 1 week after training. Speed of skill acquisition was assessed hourly. One subject completed training under both PR control and DC conditions. Both subjects completed PR training and testing. Outcomes of test metrics were analyzed descriptively. RESULTS:Comparison of the two control strategies in one subject who completed training in both conditions showed better scores in 2 (18%) dexterity measures, 1 (50%) dexterity measure with cognitive load, and 1 (50%) self-report functional measure using DC, as compared to PR. Scores of all other metrics were comparable. Both subjects showed decline in dexterity after training. Findings related to rate of skill acquisition varied considerably by subject. CONCLUSIONS:Outcomes of PR and DC for operating a 2-DOF prosthesis in a single subject cross-over study were similar for 74% of metrics, and favored DC in 26% of metrics. The two subjects who completed PR training showed decline in dexterity one week after training ended. Findings related to rate of skill acquisition varied considerably by subject. This study, despite its small sample size, highlights a need for additional research quantifying the functional and clinical benefits of PR control for upper limb prostheses.

Project description:Virtual reality is a computer-generated simulation of a real or imaginary three-dimensional environment that has entered our lives, particularly for gaming. Lately, it has been permeating into many aspects of our everyday life, such as exercise. It is important to ascertain whether exercise in an immersive virtual reality environment can be accepted from employees and lead to positive outcomes for them. The aim of this exploratory study was to examine the acceptance, future adoption, interest/enjoyment and usability of an immersive virtual reality system for exercise training by office workers during breaks within their working hours. A total of 40 female employees participated in the study with a mean age of 42.58 years (SD 10.77). Participants were requested to complete two sequential 15-min dual task cycling sessions corresponding to two experimental conditions. The first, condition A, involved cycling in a virtual environment, wearing a virtual reality head mounted display, and responding to cognitive tasks by answering multiple choice questions-on a screen, using a joystick. The second, condition B, involved cycling on a static bicycle and simultaneously responding to cognitive tasks by answering multiple choice questions in a real environment. After completion of the two conditions, participants responded to a series of scales regarding each of the experimental conditions and to a semi-structured interview. The results showed that participants noted a significant preference for the immersive virtual reality exercise, condition A, compared to condition B (bike only); and their acceptance, interest/enjoyment, usability and intention for future use were high. The qualitative data showed increased intention for future use, feelings of control and presence and most of the participants did not encounter any difficulties or require extra help to understand the immersive virtual reality system. Overall, exercising during working hours with an immersive virtual reality exercise system was well perceived by office workers and applicable. However, the effects of the immersive virtual reality training system on physical and mental health and the employees' adherence to the exercise program should be tested with a longer intervention program.

Dataset Information

Immersive augmented reality system for the training of pattern classification control with a myoelectric prosthesis.

Background

Methods

Results

Conclusion

Publications

Immersive augmented reality system for the training of pattern classification control with a myoelectric prosthesis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets