Controlling a robotic arm for functional tasks using a wireless head-joystick: A case study of a child with congenital absence of upper and lower limbs.
Ontology highlight
ABSTRACT:
SUBMITTER: Aspelund S
PROVIDER: S-EPMC7406178 | biostudies-literature | 2020
REPOSITORIES: biostudies-literature
Publications
Controlling a robotic arm for functional tasks using a wireless head-joystick: A case study of a child with congenital absence of upper and lower limbs.
Aspelund Sanders S Patel Priya P Lee Mei-Hua MH Kagerer Florian A FA Ranganathan Rajiv R Mukherjee Ranjan R
PloS one 20200805 8
Children with movement impairments needing assistive devices for activities of daily living often require novel methods for controlling these devices. Body-machine interfaces, which rely on body movements, are particularly well-suited for children as they are non-invasive and have high signal-to-noise ratios. Here, we examined the use of a head-joystick to enable a child with congenital absence of all four limbs to control a seven degree-of-freedom robotic arm. Head movements were measured with ...[more]
Similar Datasets
Project description:Most research on power assist suits (PASs) that concerned PAS-human interactions has used human physical reactions as criteria to evaluate the mechanical function, however, with minimal emphasis on human reactions in response to PASs. In this study, we focused on the physiological responses of the upper limbs including muscle activity of the biceps brachii and the triceps brachii, co-activation, force steadiness (CV) and rated perceived exertion (RPE) to various patterns of bilateral assistive force, such as unilateral assistance (L0% & R67% [% = percentage of workload force, L = left arm, R = right arm], L67% & R0%, L0% & R33%, L33% & R0%), symmetrical (L0% & R0%, L33% & R33%, L67% & R67%) and asymmetrical bilateral assistance (L33% & R67%, L67% & R33%), during bilateral isometric force-matching tasks. The results showed a similar muscular response of the two arms to bilateral assistive conditions, and the muscle activity of the arm that was being observed decreased only when the assistive force that applied on itself increased, indicating that both arms may have adopted similar but independent motor control mechanisms to acclimate to the bilateral assistive forces. Comparison between the two unilateral assistances (L0% & R33% and L33% & R0%) and the two asymmetrical bilateral assistances (L33% & R67%, L67% & R33%) showed no significant differences in muscular responses, CV and RPE, indicating that bilateral assistances with bilateral interchanged assistive levels may be equally effective regardless of which arm the higher assistive force is applied to. Comparison between unilateral and symmetrical assistive conditions that have similar overall workloads (L67% & R0%, L33% & R33%, L0% & R67%) showed a lower CV and RPE score at symmetrical assistance compared with unilateral assistance, suggesting that assisting both arms with the same level simultaneously improves task performances compared with applying the assistive force to only one arm.
| S-EPMC7790287 | biostudies-literature
Project description:Brain-computer interface (BCI) technologies aim to provide a bridge between the human brain and external devices. Prior research using non-invasive BCI to control virtual objects, such as computer cursors and virtual helicopters, and real-world objects, such as wheelchairs and quadcopters, has demonstrated the promise of BCI technologies. However, controlling a robotic arm to complete reach-and-grasp tasks efficiently using non-invasive BCI has yet to be shown. In this study, we found that a group of 13 human subjects could willingly modulate brain activity to control a robotic arm with high accuracy for performing tasks requiring multiple degrees of freedom by combination of two sequential low dimensional controls. Subjects were able to effectively control reaching of the robotic arm through modulation of their brain rhythms within the span of only a few training sessions and maintained the ability to control the robotic arm over multiple months. Our results demonstrate the viability of human operation of prosthetic limbs using non-invasive BCI technology.
| S-EPMC5155290 | biostudies-literature
Project description:The supernumerary robotic limb system expands the motor function of human users by adding extra artificially designed limbs. It is important for us to embody the system as if it is a part of one's own body and to maintain cognitive transparency in which the cognitive load is suppressed. Embodiment studies have been conducted with an expansion of bodily functions through a "substitution" and "extension". However, there have been few studies on the "addition" of supernumerary body parts. In this study, we developed a supernumerary robotic limb system that operates in a virtual environment, and then evaluated whether the extra limb can be regarded as a part of one's own body using a questionnaire and whether the perception of peripersonal space changes with a visuotactile crossmodal congruency task. We found that the participants can embody the extra-limbs after using the supernumerary robotic limb system. We also found a positive correlation between the perceptual change in the crossmodal congruency task and the subjective feeling that the number of one's arms had increased (supernumerary limb sensation). These results suggest that the addition of an extra body part may cause the participants to feel that they had acquired a new body part that differs from their original body part through a functional expansion.
| S-EPMC9237069 | biostudies-literature
Project description:Untethered miniature robots have significant poten-tial and promise in diverse minimally invasive medical applications inside the human body. For drug delivery and physical contra-ception applications inside tubular structures, it is desirable to have a miniature anchoring robot with self-locking mechanism at a target tubular region. Moreover, the behavior of this robot should be tracked and feedback-controlled by a medical imaging-based system. While such a system is unavailable, we report a reversible untethered anchoring robot design based on remote magnetic actuation. The current robot prototype's dimension is 7.5 mm in diameter, 17.8 mm in length, and made of soft polyurethane elastomer, photopolymer, and two tiny permanent magnets. Its relaxation and anchoring states can be maintained in a stable manner without supplying any control and actuation input. To control the robot's locomotion, we implement a two-dimensional (2D) ultrasound imaging-based tracking and control system, which automatically sweeps locally and updates the robot's position. With such a system, we demonstrate that the robot can be controlled to follow a pre-defined 1D path with the maximal position error of 0.53 ± 0.05 mm inside a tubular phantom, where the reversible anchoring could be achieved under the monitoring of ultrasound imaging.
| S-EPMC7610639 | biostudies-literature
Project description:BACKGROUND:Effective poststroke motor rehabilitation depends on repeated limb practice with voluntary efforts. An electromyography (EMG)-driven neuromuscular electrical stimulation (NMES)-robot arm was designed for the multi-joint physical training on the elbow, the wrist, and the fingers. OBJECTIVES:To investigate the training effects of the device-assisted approach on subacute stroke patients and to compare the effects with those achieved by the traditional physical treatments. METHOD:This study was a pilot randomized controlled trial with a 3-month follow-up. Subacute stroke participants were randomly assigned into two groups, and then received 20-session upper limb training with the EMG-driven NMES-robotic arm (NMES-robot group, n?=?14) or the time-matched traditional therapy (the control, n?=?10). For the evaluation of the training effects, clinical assessments including Fugl-Meyer Assessment (FMA), Modified Ashworth Score (MAS), Action Research Arm Test (ARAT), and Function Independence Measurement (FIM) were conducted before, after the rehabilitation training, and 3?months later. Session-by-session EMG parameters in the NMES-robot group, including normalized co-contraction Indexes (CI) and EMG activation level of target muscles, were used to monitor the progress in muscular coordination patterns. RESULTS:Significant improvements were obtained in FMA (full score and shoulder/elbow), ARAT, and FIM [P?<?0.001, effect sizes (EFs)?>?0.279] for both groups. Significant improvement in FMA wrist/hand was only observed in the NMES-robot group (P?<?0.001, EFs?=?0.435) after the treatments. Significant reduction in MAS wrist was observed in the NMES-robot group after the training (P?<?0.05, EFs?=?0.145) and the effects were maintained for 3?months. MAS scores in the control group were elevated following training (P?<?0.05, EFs?>?0.24), and remained at an elevated level when assessed 3?months later. The EMG parameters indicated a release of muscle co-contraction in the muscle pairs of biceps brachii and flexor carpi radialis and biceps brachii and triceps brachii, as well as a reduction of muscle activation level in the wrist flexor in the NMES-robot group. CONCLUSION:The NMES-robot-assisted training was effective for early stroke upper limb rehabilitation and promoted independence in the daily living comparable to the traditional physical therapy. It could achieve higher motor outcomes at the distal joints and more effective release in muscle tones than the traditional therapy. CLINICAL TRIAL REGISTRATION:ClinicalTrials.gov, identifier NCT02117089; date of registration: April 10, 2014.
| S-EPMC5591334 | biostudies-literature
Project description:BackgroundCurrent robot-aided training allows for high-intensity training but might hamper the transfer of learned skills to real daily tasks. Many of these tasks, e.g., carrying a cup of coffee, require manipulating objects with complex dynamics. Thus, the absence of somatosensory information regarding the interaction with virtual objects during robot-aided training might be limiting the potential benefits of robotic training on motor (re)learning. We hypothesize that providing somatosensory information through the haptic rendering of virtual environments might enhance motor learning and skill transfer. Furthermore, the inclusion of haptic rendering might increase the task realism, enhancing participants' agency and motivation. Providing arm weight support during training might also enhance learning by limiting participants' fatigue.MethodsWe conducted a study with 40 healthy participants to evaluate how haptic rendering and arm weight support affect motor learning and skill transfer of a dynamic task. The task consisted of inverting a virtual pendulum whose dynamics were haptically rendered on an exoskeleton robot designed for upper limb neurorehabilitation. Participants trained with or without haptic rendering and with or without weight support. Participants' task performance, movement strategy, effort, motivation, and agency were evaluated during baseline, short- and long-term retention. We also evaluated if the skills acquired during training transferred to a similar task with a shorter pendulum.ResultsWe found that haptic rendering significantly increases participants' movement variability during training and the ability to synchronize their movements with the pendulum, which is correlated with better performance. Weight support also enhances participants' movement variability during training and reduces participants' physical effort. Importantly, we found that training with haptic rendering enhances motor learning and skill transfer, while training with weight support hampers learning compared to training without weight support. We did not observe any significant differences between training modalities regarding agency and motivation during training and retention tests.ConclusionHaptic rendering is a promising tool to boost robot-aided motor learning and skill transfer to tasks with similar dynamics. However, further work is needed to find how to simultaneously provide robotic assistance and haptic rendering without hampering motor learning, especially in brain-injured patients. Trial registration https://clinicaltrials.gov/show/NCT04759976.
| S-EPMC8842890 | biostudies-literature
Project description:BackgroundProprioception refers to the perception of motion and position of the body or body segments in space. A wide range of proprioceptive tests exists, although tests dynamically evaluating sensorimotor integration during upper limb movement are scarce. We introduce a novel task to evaluate kinesthetic proprioceptive function during complex upper limb movements using a robotic device. We aimed to evaluate the test-retest reliability of this newly developed Dynamic Movement Reproduction (DMR) task. Furthermore, we assessed reliability of the commonly used Joint Reposition (JR) task of the elbow, evaluated the association between both tasks, and explored the influence of visual information (viewing arm movement or not) on performance during both tasks.MethodsDuring the DMR task, participants actively reproduced movement patterns while holding a handle attached to the robotic arm, with the device encoding actual position throughout movement. In the JR task, participants actively reproduced forearm positions; with the final arm position evaluated using an angle measurement tool. The difference between target movement pattern/position and reproduced movement pattern/position served as measures of accuracy. In study 1 (N = 23), pain-free participants performed both tasks at two test sessions, 24-h apart, both with and without visual information available (i.e., vision occluded using a blindfold). In study 2 (N = 64), an independent sample of pain-free participants performed the same tasks in a single session to replicate findings regarding the association between both tasks and the influence of visual information.ResultsThe DMR task accuracy showed good-to-excellent test-retest reliability, while JR task reliability was poor: measurements did not remain sufficiently stable over testing days. The DMR and JR tasks were only weakly associated. Adding visual information (i.e., watching arm movement) had different performance effects on the tasks: it increased JR accuracy but decreased DMR accuracy, though only when the DMR task started with visual information available (i.e., an order effect).DiscussionThe DMR task's highly standardized protocol (i.e., largely automated), precise measurement and involvement of the entire upper limb kinetic chain (i.e., shoulder, elbow and wrist joints) make it a promising tool. Moreover, the poor association between the JR and DMR tasks indicates that they likely capture unique aspects of proprioceptive function. While the former mainly captures position sense, the latter appears to capture sensorimotor integration processes underlying kinesthesia, largely independent of position sense. Finally, our results show that the integration of visual and proprioceptive information is not straightforward: additional visual information of arm movement does not necessarily make active movement reproduction more accurate, on the contrary, when movement is complex, vision appears to make it worse.
| S-EPMC8101453 | biostudies-literature
Project description:Locomotion and manipulation are two essential skills in robotics but are often divided or decoupled into two separate problems. It is widely accepted that the topological duality between multi-legged locomotion and multi-fingered manipulation shares an intrinsic model. However, a lack of research remains to identify the data-driven evidence for further research. This paper explores a unified formulation of the loco-manipulation problem using reinforcement learning (RL) by reconfiguring robotic limbs with an overconstrained design into multi-legged and multi-fingered robots. Such design reconfiguration allows for adopting a co-training architecture for reinforcement learning towards a unified loco-manipulation policy. As a result, we find data-driven evidence to support the transferability between locomotion and manipulation skills using a single RL policy with a multilayer perceptron or graph neural network. We also demonstrate the Sim2Real transfer of the learned loco-manipulation skills in a robotic prototype. This work expands the knowledge frontiers on loco-manipulation transferability with learning-based evidence applied in a novel platform with overconstrained robotic limbs.
| S-EPMC10452096 | biostudies-literature
Project description:Wireless sensor networks (WSNs) are widely applied in industrial manufacturing systems. By means of centralized control, the real-time requirement and reliability can be provided by WSNs in industrial production. Furthermore, many approaches reserve resources for situations in which the controller cannot perform centralized resource allocation. The controller assigns these resources as it becomes aware of when and where accidents have occurred. However, the reserved resources are limited, and such incidents are low-probability events. In addition, resource reservation may not be effective since the controller does not know when and where accidents will actually occur. To address this issue, we improve the reliability of scheduling for emergency tasks by proposing a method based on a stealing mechanism. In our method, an emergency task is transmitted by stealing resources allocated to regular flows. The challenges addressed in our work are as follows: (1) emergencies occur only occasionally, but the industrial system must deliver the corresponding flows within their deadlines when they occur; (2) we wish to minimize the impact of emergency flows by reducing the number of stolen flows. The contributions of this work are two-fold: (1) we first define intersections and blocking as new characteristics of flows; and (2) we propose a series of distributed routing algorithms to improve the schedulability and to reduce the impact of emergency flows. We demonstrate that our scheduling algorithm and analysis approach are better than the existing ones by extensive simulations.
| S-EPMC5539495 | biostudies-other
Project description:Embedding computational models in the physical world is a critical step towards constraining their behavior and building practical applications. Here we aim to drive a realistic musculoskeletal arm model using a biomimetic cortical spiking model, and make a robot arm reproduce the same trajectories in real time. Our cortical model consisted of a 3-layered cortex, composed of several hundred spiking model-neurons, which display physiologically realistic dynamics. We interconnected the cortical model to a two-joint musculoskeletal model of a human arm, with realistic anatomical and biomechanical properties. The virtual arm received muscle excitations from the neuronal model, and fed back proprioceptive information, forming a closed-loop system. The cortical model was trained using spike timing-dependent reinforcement learning to drive the virtual arm in a 2D reaching task. Limb position was used to simultaneously control a robot arm using an improved network interface. Virtual arm muscle activations responded to motoneuron firing rates, with virtual arm muscles lengths encoded via population coding in the proprioceptive population. After training, the virtual arm performed reaching movements which were smoother and more realistic than those obtained using a simplistic arm model. This system provided access to both spiking network properties and to arm biophysical properties, including muscle forces. The use of a musculoskeletal virtual arm and the improved control system allowed the robot arm to perform movements which were smoother than those reported in our previous paper using a simplistic arm. This work provides a novel approach consisting of bidirectionally connecting a cortical model to a realistic virtual arm, and using the system output to drive a robotic arm in real time. Our techniques are applicable to the future development of brain neuroprosthetic control systems, and may enable enhanced brain-machine interfaces with the possibility for finer control of limb prosthetics.
| S-EPMC4658435 | biostudies-literature