Dataset Information

Reliability, validity and discriminant ability of the instrumental indices provided by a novel planar robotic device for upper limb rehabilitation.

ABSTRACT: BACKGROUND:In the last few years, there has been an increasing interest in the use of robotic devices to objectively quantify motor performance of patients after brain damage. Although these robot-derived measures can potentially add meaningful information about the patient's dexterity, as well as be used as outcome measurements after the rehabilitation treatment, they need to be validated before being used in clinical practice. The present work aims to evaluate the reliability, the validity and the discriminant ability of the metrics provided by a novel robotic device for upper limb rehabilitation. METHODS:Forty-eight patients with sub-acute stroke and 40 age-matched healthy subjects were involved in this study. Clinical evaluation included: Fugl-Meyer Assessment for the upper limb, Action Research Arm Test, and Barthel Index. Robotic evaluation of the upper limb performance consisted of 14 measures of motor ability quantifying the dexterity in performing planar reaching movements. Patients were evaluated twice, one day apart, to assess the reliability of the robotic metrics, using the Intraclass Correlation Coefficient. Validity was assessed by analyzing the correlation of the robotic metrics with the clinical scales, by means of the Spearman's Correlation Coefficient. Finally, the ability of the robotic metrics to distinguish between patients with stroke and healthy subjects was investigated with t-tests and the Effect Size. RESULTS:Reliability was found to be excellent for 12 measures and from moderate to good for the remaining 2. Most of the robotic indices were strongly correlated with the clinical scales, while a few showed a moderate correlation and only one was not correlated with the Barthel Index and weakly correlated with the remain two. Finally, all but one the provided metrics were able to discriminate between the two groups, with large effect sizes for most of them. CONCLUSION:We found that all the robotic indices except one provided by a novel robotic device for upper limb rehabilitation are reliable, sensitive and strongly correlated both with motor and disability clinical scales. Therefore, this device is suitable as evaluation tool for the upper limb motor performance of patients with sub-acute stroke in clinical practice. TRIAL REGISTRATION:NCT02879279 .

SUBMITTER: Germanotta M

PROVIDER: S-EPMC5956822 | biostudies-literature | 2018 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Reliability, validity and discriminant ability of the instrumental indices provided by a novel planar robotic device for upper limb rehabilitation.

Germanotta Marco M Cruciani Arianna A Pecchioli Cristiano C Loreti Simona S Spedicato Albino A Meotti Matteo M Mosca Rita R Speranza Gabriele G Cecchi Francesca F Giannarelli Giorgia G Padua Luca L Aprile Irene I

Journal of neuroengineering and rehabilitation 20180516 1

<h4>Background</h4>In the last few years, there has been an increasing interest in the use of robotic devices to objectively quantify motor performance of patients after brain damage. Although these robot-derived measures can potentially add meaningful information about the patient's dexterity, as well as be used as outcome measurements after the rehabilitation treatment, they need to be validated before being used in clinical practice. The present work aims to evaluate the reliability, the vali ...[more]

PMID: 29769127

Similar Datasets

Project description:BACKGROUND:The majority of stroke survivors experiences significant hand impairments, as weakness and spasticity, with a severe impact on the activity of daily living. To objectively evaluate hand deficits, quantitative measures are needed. The aim of this study is to assess the reliability, the validity and the discriminant ability of the instrumental measures provided by a robotic device for hand rehabilitation, in a sample of patients with subacute stroke. MATERIAL AND METHODS:In this study, 120 patients with stroke and 40 controls were enrolled. Clinical evaluation included finger flexion and extension strength (using the Medical Research Council, MRC), finger spasticity (using the Modified Ashworth Scale, MAS) and motor control and dexterity during ADL performance (by means of the Frenchay Arm Test, FAT). Robotic evaluations included finger flexion and extension strength, muscle tone at rest, and instrumented MAS and Modified Tardieu Scale. Subjects were evaluated twice, one day apart, to assess the test-retest reliability of the robotic measures, using the Intraclass Correlation Coefficient (ICC). To estimate the response stability, the standard errors of measurement and the minimum detectable change (MDC) were also calculated. Validity was assessed by analyzing the correlations between the robotic metrics and the clinical scales, using the Spearman's Correlation Coefficient (r). Finally, we investigated the ability of the robotic measures to distinguish between patients with stroke and healthy subjects, by means of Mann-Whitney U tests. RESULTS:All the investigated measures were able to discriminate patients with stroke from healthy subjects (p < 0.001). Test-retest reliability was found to be excellent for finger strength (in both flexion and extension) and muscle tone, with ICCs higher than 0.9. MDCs were equal to 10.6 N for finger flexion, 3.4 N for finger extension, and 14.3 N for muscle tone. Conversely, test-retest reliability of the spasticity measures was poor. Finally, finger strength (in both flexion and extension) was correlated with the clinical scales (r of about 0.7 with MRC, and about 0.5 with FAT). DISCUSSION:Finger strength (in both flexion and extension) and muscle tone, as provided by a robotic device for hand rehabilitation, are reliable and sensitive measures. Moreover, finger strength is strongly correlated with clinical scales. Changes higher than the obtained MDC in these robotic measures could be considered as clinically relevant and used to assess the effect of a rehabilitation treatment in patients with subacute stroke.

Project description:Background: An association between gaming disorder (GD) and the symptoms of common mental disorders is unraveled yet. In this preregistered study, we quantitatively synthesized reliability, convergent and discriminant validity of GD scales to examine association between GD and other constructs. Methods: Five representative GD instruments (GAS-7, AICA, IGDT-10, Lemmens IGD-9, and IGDS9-SF) were chosen based on recommendations by the previous systematic review study to conduct correlation meta-analyses and reliability generalization. A systematic literature search was conducted through Pubmed, Proquest, Embase, and Google Scholar to identify studies that reported information on either reliability or correlation with related variables. 2,124 studies were full-text assessed as of October 2020, and 184 were quantitatively synthesized. Conventional Hedges two-level meta-analytic method was utilized. Results: The result of reliability generalization reported a mean coefficient alpha of 0.86 (95% CI = 0.85-0.87) and a mean test-retest estimate of 0.86 (95% CI = 0.81-0.89). Estimated effect sizes of correlation between GD and the variables were as follows: 0.33 with depression (k = 45; number of effect sizes), 0.29 with anxiety (k = 37), 0.30 with aggression (k = 19), -0.22 with quality of life (k = 18), 0.29 with loneliness (k = 18), 0.56 with internet addiction (k = 20), and 0.40 with game playtime (k = 53), respectively. The result of moderator analyses, funnel and forest plots, and publication bias analyses were also presented. Discussion and Conclusion: All five GD instruments have good internal consistency and test-retest reliability. Relatively few studies reported the test-retest reliability. The result of correlation meta-analysis revealed that GD scores were only moderately associated with game playtime. Common psychological problems such as depression and anxiety were found to have a slightly smaller association with GD than the gaming behavior. GD scores were strongly correlated with internet addiction. Further studies should adopt a rigorous methodological procedure to unravel the bidirectional relationship between GD and other psychopathologies. Limitations: The current study did not include gray literature. The representativeness of the five tools included in the current study could be questioned. High heterogeneity is another limitation of the study. Systematic Review Registration: [https://www.crd.york.ac.uk/PROSPERO/], identifier [CRD42020219781].

Project description:Stroke is the primary cause of adult disability. To support this large population in recovery, robotic technologies are being developed to assist in the delivery of rehabilitation. This paper presents an automated system for a rehabilitation robotic device that guides stroke patients through an upper-limb reaching task. The system uses a decision theoretic model (a partially observable Markov decision process, or POMDP) as its primary engine for decision making. The POMDP allows the system to automatically modify exercise parameters to account for the specific needs and abilities of different individuals, and to use these parameters to take appropriate decisions about stroke rehabilitation exercises.The performance of the system was evaluated by comparing the decisions made by the system with those of a human therapist. A single patient participant was paired up with a therapist participant for the duration of the study, for a total of six sessions. Each session was an hour long and occurred three times a week for two weeks. During each session, three steps were followed: (A) after the system made a decision, the therapist either agreed or disagreed with the decision made; (B) the researcher had the device execute the decision made by the therapist; (C) the patient then performed the reaching exercise. These parts were repeated in the order of A-B-C until the end of the session. Qualitative and quantitative question were asked at the end of each session and at the completion of the study for both participants.Overall, the therapist agreed with the system decisions approximately 65% of the time. In general, the therapist thought the system decisions were believable and could envision this system being used in both a clinical and home setting. The patient was satisfied with the system and would use this system as his/her primary method of rehabilitation.The data collected in this study can only be used to provide insight into the performance of the system since the sample size was limited. The next stage for this project is to test the system with a larger sample size to obtain significant results.

Project description:INTRODUCTION: The rheumatoid arthritis-specific Work Productivity Survey (WPS-RA) measures the impact of rheumatoid arthritis (RA) and treatment on patient productivity within and outside the home. It contains nine questions addressing employment status, productivity within and outside the home, and daily activities. The objective of this paper was to evaluate the discriminant validity, responsiveness, and reliability of the WPS-RA in patients with active RA. METHODS: Two hundred twenty subjects (mean age was 53.8 years, 83.6% were female, mean disease duration was 9.54 years, mean number of disease-modifying anti-rheumatic drugs failed was 2, and 38.6% were employed outside the home) in a phase III, 24-week, double-blind, placebo-controlled trial completed the WPS-RA at baseline and every 4 weeks until withdrawal/study completion. Validity was evaluated via known groups using baseline data (first and third quartiles of subjects' Health Assessment Questionnaire--Disability Index [HAQ-DI] scores and Short Form-36 health survey [SF-36] scores). To evaluate responsiveness, mean changes in WPS-RA at week 24 were compared between American College of Rheumatology 20% improvement criteria (ACR20) (or HAQ-DI) responders and non-responders. Standardized response mean (SRM) was also used to quantify responsiveness. All group comparisons were conducted using a non-parametric bootstrap-t method. RESULTS: Subjects with lower HAQ-DI or SF-36 scores generally had statistically greater RA-associated losses in productivity within and outside the home compared with subjects with higher scores (25 of 32 evaluations were statistically significant). Smallest differences between groupswere seen in work absenteeism and days with outside help. At week 24, ACR20 and HAQ-DI responders reported large improvements in productivity within and outside the home; non-responders reported mainly a worsening in productivity (P <or= 0.05). Effect size for productivity changes in ACR20 or HAQ-DI responders was moderate to large for six out of eight items (SRM = 0.48 to 1.12). The effect size was small for work absenteeism and days with outside help. (SRM = 0.4 and 0.24, respectively). In non-responders, the magnitude of change was negligible (SRM < 0.1) or small (SRM < 0.3). CONCLUSIONS: The WPS-RA has demonstrated properties of discriminative validity, reliability, and responsiveness for the measurement of productivity within and outside the home in subjects with active RA.

Dataset Information

Reliability, validity and discriminant ability of the instrumental indices provided by a novel planar robotic device for upper limb rehabilitation.

Publications

Reliability, validity and discriminant ability of the instrumental indices provided by a novel planar robotic device for upper limb rehabilitation.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure