Dataset Information

Reliability and validity of digital health metrics for assessing arm and hand impairments in an ataxic disorder.

ABSTRACT:

Objectives

Autosomal recessive spastic ataxia of Charlevoix-Saguenay (ARSACS) is the second most frequent recessive ataxia and commonly features reduced upper limb coordination. Sensitive outcome measures of upper limb coordination are essential to track disease progression and the effect of interventions. However, available clinical assessments are insufficient to capture behavioral variability and detailed aspects of motor control. While digital health metrics extracted from technology-aided assessments promise more fine-grained outcome measures, these have not been validated in ARSACS. Thus, the aim was to document the metrological properties of metrics from a technology-aided assessment of arm and hand function in ARSACS.

Methods

We relied on the Virtual Peg Insertion Test (VPIT) and used a previously established core set of 10 digital health metrics describing upper limb movement and grip force patterns during a pick-and-place task. We evaluated reliability, measurement error, and learning effects in 23 participants with ARSACS performing three repeated assessment sessions. In addition, we documented concurrent validity in 57 participants with ARSACS performing one session.

Results

Eight metrics had excellent test-retest reliability (intraclass correlation coefficient 0.89 ± 0.08), five low measurement error (smallest real difference % 25.4 ± 5.7), and none strong learning effects (systematic change η -0.11 ± 2.5). Significant correlations (ρ 0.39 ± 0.13) with clinical scales describing gross and fine dexterity and lower limb coordination were observed.

Interpretation

This establishes eight digital health metrics as valid and robust endpoints for cross-sectional studies and five metrics as potentially sensitive endpoints for longitudinal studies in ARSACS, thereby promising novel insights into upper limb sensorimotor control.

SUBMITTER: Kanzler CM

PROVIDER: S-EPMC8994987 | biostudies-literature | 2022 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Reliability and validity of digital health metrics for assessing arm and hand impairments in an ataxic disorder.

Kanzler Christoph M CM Lessard Isabelle I Gassert Roger R Brais Bernard B Gagnon Cynthia C Lambercy Olivier O

Annals of clinical and translational neurology 20220227 4

<h4>Objectives</h4>Autosomal recessive spastic ataxia of Charlevoix-Saguenay (ARSACS) is the second most frequent recessive ataxia and commonly features reduced upper limb coordination. Sensitive outcome measures of upper limb coordination are essential to track disease progression and the effect of interventions. However, available clinical assessments are insufficient to capture behavioral variability and detailed aspects of motor control. While digital health metrics extracted from technology ...[more]

PMID: 35224896

Similar Datasets

Project description:Objective: In the field of non-treatable muscular dystrophies, promising new gene and cell therapies are being developed and are entering clinical trials. Objective assessment of therapeutic effects on motor function is mandatory for economical and ethical reasons. Main shortcomings of existing measurements are discontinuous data collection in artificial settings as well as a major focus on walking, neglecting the importance of hand and arm movements for patients' independence. We aimed to create a digital tool to measure muscle function with an emphasis on upper limb motility. Methods: suMus provides a custom-made App running on smartwatches. Movement data are sent to the backend of a suMus web-based platform, from which they can be extracted as CSV data. Fifty patients with neuromuscular diseases assessed the pool of suMus activities in a first orientation phase. suMus performance was hence validated in four upper extremity exercises based on the feedback of the orientation phase. We monitored the arm metrics in a cohort of healthy volunteers using the suMus application, while completing each exercise at low frequency in a metabolic chamber. Collected movement data encompassed average acceleration, rotation rate as well as activity counts. Spearman rank tests correlated movement data with energy expenditure from the metabolic chamber. Results: Our novel application "suMus," sum of muscle activity, collects muscle movement data plus Patient-Related-Outcome-Measures, sends real-time feedback to patients and caregivers and provides, while ensuring data protection, a long-term follow-up of disease course. The application was well received from the patients during the orientation phase. In our pilot study, energy expenditure did not differ between overnight fasted and non-fasted participants. Acceleration ranged from 1.7 ± 0.7 to 3.2 ± 0.5 m/sec2 with rotation rates between 0.9 ± 0.5 and 2.0 ± 3.4 rad/sec. Acceleration and rotation rate as well as derived activity counts correlated with energy expenditure values measured in the metabolic chamber for one exercise (r = 0.58, p < 0.03). Conclusion: In the analysis of slow frequency movements of upper extremities, the integration of the suMus application with smartwatch sensors characterized motion parameters, thus supporting a use in clinical trial outcome measures. Alternative methodologies need to complement indirect calorimetry in validating accelerometer-derived energy expenditure data.

Project description:BackgroundThe Ruff Figural Fluency Test (RFFT) is a valid but time-consuming and labour-intensive cognitive paper-and-pencil test. A digital RFFT was developed that can be conducted independently using an iPad and Apple Pencil and RFFT scores are computed automatically. We investigated the validity and reliability of this digital RFFT.MethodsWe randomly allocated participants to the digital or paper-and-pencil RFFT. After the first test, the other test was performed immediately (cross-over). Participants were invited for a second digital RFFT 1 week later. For the digital RFFT, an (automatic) algorithm and two independent raters (criterion standard) assessed the number of unique designs (UD) and perseverative errors (PE). These raters also assessed the paper-and-pencil RFFT. We used Intraclass correlation coefficients (ICC), sensitivity, specificity, %-agreement, Kappa, and Bland-Altman plots.ResultsWe included 94 participants (mean (SD) age 39.9 (14.8), 73.4% follow-up). Mean (SD) UD and median (IQR) PE of the digital RFFT were 84.2 (26.0) and 4 (2-7.3), respectively. Agreement between manual and automatic scoring of the digital RFFT was high for UD (ICC = 0.99, 95% CI 0.98, 0.99, sensitivity = 0.98; specificity = 0.96) and PE (ICC = 0.99, 95% CI 0.98, 0.99; sensitivity = 0.90, specificity = 1.00), indicating excellent criterion validity. Small but significant differences in UD were found between the automatic and manual scoring (mean difference: - 1.12, 95% CI - 1.92, - 0.33). Digital and paper-and-pencil RFFT had moderate agreement for UD (ICC = 0.73, 95% CI 0.34, 0.87) and poor agreement for PE (ICC = 0.47, 95% CI 0.30, 0.62). Participants had fewer UD on the digital than paper-and-pencil RFFT (mean difference: - 7.09, 95% CI - 11.80, - 2.38). The number of UD on the digital RFFT was associated with higher education (Spearman's r = 0.43, p < 0.001), and younger age (Pearson's r = - 0.36, p < 0.001), showing its ability to discriminate between different age categories and levels of education. Test-retest reliability was moderate (ICC = 0.74, 95% CI 0.61, 0.83).ConclusionsThe automatic scoring of the digital RFFT has good criterion and convergent validity. There was low agreement between the digital RFFT and paper-and-pencil RFFT and moderate test-retest reliability, which can be explained by learning effects. The digital RFFT is a valid and reliable instrument to measure executive cognitive function among the general population and is a feasible alternative to the paper-and-pencil RFFT in large-scale studies. However, its scores cannot be used interchangeably with the paper-and-pencil RFFT scores.

Project description:Introduction:Children with high dental anxiety display uncooperative behavior during dental procedures. Different self-assessment questionnaires are in use to estimate the prevalence of dental fear and anxiety (DFA) in children but they need to be tested for reliability and validity in different populations. Objectives:The aim of this study was to test the reliability and validity of two scales for the assessment of child dental fear and anxiety in a sample of Croatian children. Material and Methods:The sample comprised 202 pairs consisting of children and their mothers (97 boys and 105 girls) aged 5 - 12 years. Two scales were used to assess children's DFA: the Children's Fear Survey Schedule - Dental Subscale (CFSS-DS) and the Modified Child Dental Anxiety Scale - face version (MCDAS-f). The Corah's Dental Anxiety Scale (CDAS) was used in the sample of children's mothers. The average scores of cooperative children and children with behavior management problem (BMP) were compared. Results:Cooperative children displayed significantly lower CFSS-DS scores than children with BMP (M = 28. 46 vs. M = 39. 36; P < 0.001). The average MCDAS-f score was significantly higher in children with BMP than in cooperative children (M = 28. 07 vs. 20. 01; P < 0.001). The CFSS-DS showed high internal consistency (Cronbach's ? = 0. 90), while internal consistency of MCDAS-f was good (? = 0. 73). The maternal CDAS showed good internal consistency (? = 0, 89). The correlations with other self-report measurements of DFS show good validity of all scales. The correlations between CFSS-DS and MCDAS-f were highly significant (r = 0.482; P < 0. 01) as well as the correlations of CFSS-DS and MCDAS-f with CDAS scores (r = 0.223; P < 0. 01 and r = 0.198; P < 0. 01, respectively. Conclusion:The obtained results suggest that both the CFSS-DS scale and the MCDAS-f scale are reliable and valid scales for measuring dental fear and anxiety in children in a sample of Croatian children. The MCDAS-f scale has shown slightly lower internal consistency but it is suitable for use in young children. In addition, the MCDAS-f scale is simple to administer.

Project description:BackgroundAssessing arm and hand sensorimotor impairments that are functionally relevant is essential to optimize the impact of neurorehabilitation interventions. Technology-aided assessments should provide a sensitive and objective characterization of upper limb impairments, but often provide arm weight support and neglect the importance of the hand, thereby questioning their functional relevance. The Virtual Peg Insertion Test (VPIT) addresses these limitations by quantifying arm and hand movements as well as grip forces during a goal-directed manipulation task requiring active lifting of the upper limb against gravity. The aim of this work was to evaluate the ability of the VPIT metrics to characterize arm and hand sensorimotor impairments that are relevant for performing functional tasks.MethodsArm and hand sensorimotor impairments were systematically characterized in 30 chronic stroke patients using conventional clinical scales and the VPIT. For the latter, ten previously established kinematic and kinetic core metrics were extracted. The validity and robustness of these metrics was investigated by analyzing their clinimetric properties (test-retest reliability, measurement error, learning effects, concurrent validity).ResultsTwenty-three of the participants, the ones with mild to moderate sensorimotor impairments and without strong cognitive deficits, were able to successfully complete the VPIT protocol (duration 16.6 min). The VPIT metrics detected impairments in arm and hand in 90.0% of the participants, and were sensitive to increased muscle tone and pathological joint coupling. Most importantly, significant moderate to high correlations between conventional scales of activity limitations and the VPIT metrics were found, thereby indicating their functional relevance when grasping and transporting objects, and when performing dexterous finger manipulations. Lastly, the robustness of three out of the ten VPIT core metrics in post-stroke individuals was confirmed.ConclusionsThis work provides evidence that technology-aided assessments requiring goal-directed manipulations without arm weight support can provide an objective, robust, and clinically feasible way to assess functionally relevant sensorimotor impairments in arm and hand in chronic post-stroke individuals with mild to moderate deficits. This allows for a better identification of impairments with high functional relevance and can contribute to optimizing the functional benefits of neurorehabilitation interventions.

Dataset Information

Reliability and validity of digital health metrics for assessing arm and hand impairments in an ataxic disorder.

Objectives

Methods

Results

Interpretation

Publications

Reliability and validity of digital health metrics for assessing arm and hand impairments in an ataxic disorder.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets