Reliability and Validity of a New Diagnostic Device for Quantifying Hemiparetic Arm Impairments: An Exploratory Study.
Ontology highlight
ABSTRACT: Objective
To assess test-retest reliability and validity of a new diagnostic device, the Shoulder Elbow Perturbator, to quantify muscle weakness, abnormal synergy, (muscle activity-related) spasticity, and changes in viscoelastic joint properties of the elbow.Subjects
Stroke patients, adults with cerebral palsy and healthy controls.Methods
Test-retest reliability was evaluated using intra-class correlations (ICC) and assessment of measurement error. The device's validity was evaluated by demonstrating differences between patients and healthy controls, and correlations of spasticity and abnormal synergy outcomes using the clinical Modified Tardieu Scale, the Fugl-Meyer Assessment, and the Test of Arm Selective Control.Results
Reliability was excellent, with an ICC > 0.75 for synergy and ICCs > 0.90 for all other impairments, with relatively small measurement errors. Validity was confirmed by group differences between patients and healthy controls for muscle weakness, spasticity, and viscoelastic joint properties, but not for abnormal synergy. Correlation analysis with clinical scales confirmed validity for spasticity, while, for synergy, correlations were found in the patients with stroke, but not those with cerebral palsy.Conclusion
This new diagnostic device is a reliable and valid instrument to assess multiple upper limb impairments in patients with neurological conditions, supporting its use in clinical practice. Further studies are needed to confirm these findings.
SUBMITTER: Van der Velden LL
PROVIDER: S-EPMC9131203 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:ObjectiveThe diagnosis of neurocysticercosis (NCC) remains problematic because of the heterogeneity of its clinical, immunological, and imaging characteristics. Our aim was to develop and assess a new set of diagnostic criteria for NCC, which might allow for the accurate detection of, and differentiation between, parenchymal and extraparenchymal disease.MethodsA group of Latin American NCC experts developed by consensus a new set of diagnostic criteria for NCC. A multicenter, retrospective study was then conducted to validate it. The reference standard for diagnosis of active NCC was the disappearance or reduction of cysts after anthelmintic treatment. In total, three pairs of independent neurologists blinded to the diagnosis evaluated 93 cases (with NCC) and 93 controls (without NCC) using the new diagnostic criteria. Mixed-effects logistic regression models were used to estimate sensitivity and specificity.ResultsInter-rater reliability (kappa) of diagnosis among evaluators was 0.60. For diagnosis of NCC versus no NCC, the new criteria had a sensitivity of 93.2% and specificity of 81.4%. For parenchymal NCC, the new criteria had a sensitivity of 89.8% and specificity of 80.7% and for extraparenchymal NCC, the new criteria had a sensitivity of 65.9% and specificity of 94.9%.InterpretationThese criteria have acceptable reliability and validity and could be a new tool for clinicians and researchers. An advantage of the new criteria is that they consider parasite location (ie, parenchymal or extraparenchymal), which is an important factor determining the clinical, immunological, and radiological presentation of the disease, and importantly, its treatment and prognosis. Ann Neurol 2016;80:434-442.
| S-EPMC5053253 | biostudies-literature
Project description:OBJECTIVES:To examine the inter-rater reliability of the thumb localizing test (TLT) and its validity against quantitative measures of proprioception. METHODS:The TLT was assessed by two raters in a standardized manner in 40 individuals with hemiparetic stroke. Inter-rater reliability was examined with weighted Kappa. For the quantitative measures, a bimanual matching task in a planar robotic device was performed. Without vision, each participant moved the unaffected hand to the perceived mirrored location of the affected hand, which was passively moved by the robot. Three measures were taken after 54 trials: Variability, trial-to-trial variability of the mirrored-matched locations; Area, the ratio of the area enclosed by the active hand relative to the passive hand; and Shift, systematic shifts between the passive and active hands. The correlation between the TLT and each robotic measure was examined with Spearman's rank correlation coefficient. RESULTS:The overall weighted kappa of the TLT was 0.84 (P<0.001). The TLT correlated highly with Area (r = -0.71, P<0.001) and moderately with Variability (r = 0.40, P = 0.011). No significant correlation was found between the TLT and Shift. CONCLUSIONS:The TLT had a high inter-rater reliability, and was validated against quantitative measures of proprioception reflecting the perceived area of movement and variability of the limb location.
| S-EPMC7380647 | biostudies-literature
Project description:Since July 2022, obstetrical disseminated intravascular coagulation (DIC) in Japan has been diagnosed based on the new criteria (tentative version), which assesses the main underlying disease, fibrinogen level, and fibrin/fibrinogen degradation products or D-dimer level. In June 2024, the tentative version underwent minor revision and the final version was released. The previous Japanese criteria assessed underlying disease, clinical symptoms, and various laboratory findings. This study aimed to prove the effectiveness, reliability, and validity of the new criteria (final version). We analyzed 212 women with singleton pregnancies who delivered after 22 gestational weeks and experienced blood loss ≥ 1000 mL during vaginal delivery or ≥ 2000 mL during cesarean section. Those with missing laboratory findings before receiving blood transfusion at delivery were excluded. In the obstetrical DIC group, the frequency of fibrinogen levels < 150 mg/dL was significantly higher than in the control group (90% vs. 5%, p < 0.0001), as was the frequency of scores ≥ 8 according to the previous Japanese criteria (100% vs. 10%, p < 0.0001). Cronbach alpha was 0.757 and Spearman's rank-order correlation was 0.558 between the new and previous criteria. In conclusion, we proved the effectiveness, reliability, and validity of the Japanese new criteria (final version) to diagnose obstetrical DIC.
| S-EPMC11291721 | biostudies-literature
Project description:Background:Objective assessments of sedentary behavior and physical activity (PA) by using accelerometer-based wearable devices are ever expanding, given their importance in the global context of health maintenance. This study aimed to determine the reliability and validity of a new accelerometer-based analyzer (Fibion) for detecting different PAs and estimating energy expenditure (EE) during a simulated free-living day. Methods:The study consisted of two parts: a reliability (n = 18) and a validity (n = 19) test. Reliability was assessed by a 45 min protocol of repeated sitting, standing, and walking (i.e., 3 × 15 min, repeated twice), using both Fibion and ActiGraph. Validity was assessed by a 12 h continuous sequence tasks of different types (sitting, standing, walking, and cycling) and intensities (light [LPA], moderate [MPA], and vigorous [VPA]) of PA. Two Fibion devices were worn on the thigh (FT) and in the pocket (FP), respectively and were compared with criteria measures, such as direct observation (criterion 1) and oxygen consumption by a portable gas analyzer, K4b2 (criterion 2). Results:FT (intra-class correlation coefficients (ICCs): 0.687-0.806) provided similar reliability as the Actigraph (ICCs: 0.661-0.806) for EE estimation. However, the measurement error (ME) of FT compared to the actual time records indicated an underestimation of duration by 5.1 ± 1.2%, 3.8 ± 0.3% and 14.9 ± 2.6% during sitting, walking, and standing, respectively. During the validity test, FT but not FP showed a moderate agreement but lager variance with the criteria (1 and 2) in assessing duration of sitting, long sitting, LPA, MPA, and VPA (p > 0.05, ICCs: 0.071-0.537), as well as for EE estimation of standing, LPA, MPA, and VPA (p > 0.05, ICCs: 0.673-0.894). Conclusions:FT provided similar reliability to that of the Actigraph. However, low correlations between subsequent measurements of both devices indicated large random MEs, which were somewhat diminished during the simulated 12 h real-life test. Furthermore, FT may accurately determine the types, intensities of PA and EE during prolonged periods with substantial changes in postures, indicating that the location of the accelerometer is essential. Further study with a large cohort is needed to confirm the usability of Fibion, especially for detecting the low-intensity PAs.
| S-EPMC6186411 | biostudies-literature
Project description:This study aimed to determine the intra- and inter-device accuracy and reliability of wearable athletic tracking devices, under controlled laboratory conditions. A total of nineteen portable accelerometers (Catapult OptimEye S5) were mounted to an aluminum bracket, bolted directly to an Unholtz Dickie 20K electrodynamic shaker table, and subjected to a series of oscillations in each of three orthogonal directions (front-back, side to side, and up-down), at four levels of peak acceleration (0.1g, 0.5g, 1.0g, and 3.0g), each repeated five times resulting in a total of 60 tests per unit, for a total of 1140 records. Data from each accelerometer was recorded at a sampling frequency of 100Hz. Peak accelerations recorded by the devices, Catapult PlayerLoad™, and calculated player load (using Catapult's Cartesian formula) were used for the analysis. The devices demonstrated excellent intradevice reliability and mixed interdevice reliability. Differences were found between devices for mean peak accelerations and PlayerLoad™ for each direction and level of acceleration. Interdevice effect sizes ranged from a mean of 0.54 (95% CI: 0.34-0.74) (small) to 1.20 (95% CI: 1.08-1.30) (large) and ICCs ranged from 0.77 (95% CI: 0.62-0.89) (very large) to 1.0 (95% CI: 0.99-1.0) (nearly perfect) depending upon the magnitude and direction of the applied motion. When compared to the player load determined using the Cartesian formula, the Catapult reported PlayerLoad™ was consistently lower by approximately 15%. These results emphasize the need for industry wide standards in reporting validity, reliability and the magnitude of measurement errors. It is recommended that device reliability and accuracy are periodically quantified.
| S-EPMC5805236 | biostudies-literature
Project description:BackgroundComplicated grief (CG) has been recently included in the DSM-5, under the term "persistent complex bereavement disorder," as a condition requiring further study. To our knowledge, no psychometric data on any structured clinical interview for CG (SCI-CG) is available to date. In this manuscript, we introduce the SCI-CG, a 31-item "SCID-like" clinician-administered instrument to assess the presence of CG symptoms.MethodsParticipants were 281 treatment-seeking adults with CG (77.9% [n = 219] women, mean age = 52.4, standard deviation [SD] = 17.8) who were assessed with the SCI-CG and measures of depression, posttraumatic stress, anxiety, functional impairment.ResultsThe SCI-CG exhibited satisfactory internal consistency (α = .78), good test-retest reliability (interclass correlation [ICC] 0.68, 95% CI [0.60-0.75]), and excellent interrater reliability (ICC = 0.95, 95% CI [0.89-0.98]). Exploratory factor analyses revealed that a five-factor structure, explaining 50.3% of the total variance, was the best fit for the data.ConclusionsThe clinician-rated SCI-CG demonstrates good internal consistency, reliability, and convergent validity in treatment-seeking individuals with CG and therefore can be a useful tool to assess CG. Although diagnostic criteria for CG have yet to be adequately validated, the SCI-CG may facilitate this process. The SCI-CG can now be used as a validated instrument in research and clinical practice.
| S-EPMC4565180 | biostudies-literature
Project description:IntroductionPlantar flexor weakness is an identified prospective factor for developing Achilles tendinopathy. Various authors have reported relationships between symptoms and weakness of this muscle group. Despite this relationship, many clinicians and researchers fail to examine Plantar flexor strength due to the cumbersome, stationary and expensive nature of an isokinetic dynamometer (IKD), known as the "Gold Standard". This study examined the validity and reliability of a fast, easy and portable device for assessing plantarflexion.MethodsValidity between the Cybex NORM® by Humac and the C-Station by Fysiometer was explored using Pearson correlation coefficient. Participants were randomly selected to start in the Cybex NORM® or the FysioMeter C-Station. Intra-rater reliability on the C-station was investigated by test-retest two days apart using Intraclass Correlation Coefficient (ICC). All testing involved isometric maximal force of the soleus muscle with the knee at 90 degrees flexion.Results40 healthy university students were recruited for the validity part, while 65 healthy university students were recruited for the reliability part of the study. The mean peak torque on the IKD was 198.55Nm (SD 94.45) versus 1443.88 (412.82)N on the C-Station. The results of the Pearson correlation revealed an r-value of r = 0.72 with a 95%CI 0.52-0.84. The test re-test reliability was calculated as an ICC of 0.91 with a (95%CI 0.86-0.94).ConclusionsThe C-Station by Fysiometer appears to provide valid measures and have excellent reliability for Plantar flexor isometric strength. It would appear suitable for both clinical and research work.
| S-EPMC10065227 | biostudies-literature
Project description:A decrease in ankle dorsiflexion causes changes in biomechanics, and different instruments have been used for ankle dorsiflexion testing under static conditions. Consequently, the industry of inertial sensors has developed easy-to-use devices, which measure dynamic ankle dorsiflexion and provide additional parameters such as velocity, acceleration, or movement deviation. Therefore, the aims of this study were to analyze the concurrent validity and test-retest reliability of an inertial device for measuring dynamic weight-bearing ankle dorsiflexion. Sixteen participants were tested using an inertial device (WIMU) and a digital inclinometer. Ankle dorsiflexion from left and right ankle repetitions was used for validity analysis, whereas test-retest reliability was analyzed by comparing measurements from the first and second days. The standard error of the measurement (SEM) between the instruments was very low for both ankle measurements (SEM < 0.6°). No significant differences between instruments were found for the left ankle measurement (p > 0.05) even though a significant systematic bias (~1.77°) was found for the right ankle (d = 0.79). R2 was very close to 1 in the left and right ankles (R2 = 0.85-0.89) as well as the intraclass correlation coefficient (ICC > 0.95). Test-retest reliability analysis showed that systematic bias was below 1° for both instruments, even though a systematic bias (~1.50°) with small effect size was found in the right ankle (d = 0.49) with WIMU. The ICC was very close to 1 and the coefficient of variation (CV) was lower than 4% in both instruments. Thus, WIMU is a valid and reliable inertial device for measuring dynamic weight-bearing ankle dorsiflexion.
| S-EPMC7014375 | biostudies-literature
Project description:The aim of this study was to test the validity and reliability of the inertial device WIMU (Realtrack Systems SL, Almería, Spain) for the assessment of the vertical jump, counter movement jump (CMJ) and squat jump (SJ). Fifteen soccer players were evaluated in two identical sessions separated by one week. In each session, participants performed three jumps of each type. The flight time was quantified by the inertial device WIMU and by a force platform (Twin Plates; Globus Sport and Health Technologies LLC, Codogné, Italy) at the same time. For the analysis of reliability of the flight time of the CMJ and the SJ, the intraclass correlation coefficient was used. The calculation of the concurrent validity was performed by using the Pearson correlation coefficient (r). This analysis was complemented with the realization of the Bland-Altman plots. For the analysis of reliability, the coefficient of variation and the standard error of the means were calculated. The analysis presented a high validity and reliability of the device. The results show the inertial device WIMU (Realtrack Systems SL, Almería, Spain) as a useful tool for measuring the jump capacity of the athletes, presenting immediate results in real time, on any type of surface and in a simple way since it does not need cables.
| S-EPMC5933316 | biostudies-literature
Project description:Training prescription and monitoring of team-sport athletes rely on accurate quantification of player movement. Our aim was to determine the sensitivity, reliability and construct validity of measures derived from a wearable device incorporating Global Positioning System (GPS) and accelerometer technology to quantify the peak periods of rugby competition. Match movement data were collected from 30 elite and 30 sub-elite rugby union players across respective competitive seasons. Accelerometer and GPS measures were analysed using a rolling average to identify peak movement for epochs ranging from 5 to 600 seconds. General linear mixed modelling was used to quantify the effects of playing position and match-half on the peak movement and variabilities within and between players represented reliability of each measure. Mean positional differences and match-half changes were assessed via standardisation and magnitude-based decisions. Sensitivity of measures was quantified via evaluation of ("signal") and typical error of measurement ("noise"). GPS and accelerometer measures had poor sensitivity for quantifying peak movement across all epochs and both levels of rugby union competition (noise 4× to 5× the signal). All measures displayed correspondingly low reliability across most epochs and both levels of competition (ICC<0.50). Construct validity was evident in mean differences between playing positions and match halves that were consistent with expected activity profiles in rugby union. However, it was clear from the pattern of differences across epoch durations and levels of competition that GPS and accelerometer measures provided different information about player movement. The poor sensitivity and low reliability of GPS and accelerometer measures of peak movement imply that rugby union players need to be monitored across many matches to obtain adequate precision for assessing individuals. Although all measures displayed construct validity, accelerometers provided meaningful information additional to that of GPS. We recommend using accelerometers alongside GPS to monitor and prescribe match respresentative training.
| S-EPMC7371171 | biostudies-literature