Test-retest reliability of the HEXACO-100-And the value of multiple measurements for assessing reliability.
Ontology highlight
ABSTRACT:
SUBMITTER: Henry S
PROVIDER: S-EPMC8757920 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Evaluation of neurodegenerative disease progression may be assisted by quantification of the volume of structures in the human brain using magnetic resonance imaging (MRI). Automated segmentation software has improved the feasibility of this approach, but often the reliability of measurements is uncertain. We have established a unique dataset to assess the repeatability of brain segmentation and analysis methods. We acquired 120 T1-weighted volumes from 3 subjects (40 volumes/subject) in 20 sessions spanning 31 days, using the protocol recommended by the Alzheimer's Disease Neuroimaging Initiative (ADNI). Each subject was scanned twice within each session, with repositioning between the two scans, allowing determination of test-retest reliability both within a single session (intra-session) and from day to day (inter-session). To demonstrate the application of the dataset, all 3D volumes were processed using FreeSurfer v5.1. The coefficient of variation of volumetric measurements was between 1.6% (caudate) and 6.1% (thalamus). Inter-session variability exceeded intra-session variability for lateral ventricle volume (P<0.0001), indicating that ventricle volume in the subjects varied between days.
| S-EPMC4411010 | biostudies-literature
Project description:In the last decade, many studies have used automated processes to analyze magnetic resonance imaging (MRI) data such as cortical thickness, which is one indicator of neuronal health. Due to the convenience of image processing software (e.g., FreeSurfer), standard practice is to rely on automated results without performing visual inspection of intermediate processing. In this work, structural MRIs of 40 healthy controls who were scanned twice were used to determine the test-retest reliability of FreeSurfer-derived cortical measures in four groups of subjects-those 25 that passed visual inspection (approved), those 15 that failed visual inspection (disapproved), a combined group, and a subset of 10 subjects (Travel) whose test and retest scans occurred at different sites. Test-retest correlation (TRC), intraclass correlation coefficient (ICC), and percent difference (PD) were used to measure the reliability in the Destrieux and Desikan-Killiany (DK) atlases. In the approved subjects, reliability of cortical thickness/surface area/volume (DK atlas only) were: TRC (0.82/0.88/0.88), ICC (0.81/0.87/0.88), PD (0.86/1.19/1.39), which represent a significant improvement over these measures when disapproved subjects are included. Travel subjects' results show that cortical thickness reliability is more sensitive to site differences than the cortical surface area and volume. To determine the effect of visual inspection on sample size required for studies of MRI-derived cortical thickness, the number of subjects required to show group differences was calculated. Significant differences observed across imaging sites, between visually approved/disapproved subjects, and across regions with different sizes suggest that these measures should be used with caution.
| S-EPMC4545736 | biostudies-literature
Project description:IntroductionThe Haemophilia Activities List (HAL) is a preferred instrument to measure self-reported limitations in activities in persons with haemophilia (PWH). Information on reliability and interpretability of HAL scores is lacking.AimTo examine the test-retest reliability and smallest detectable change (SDC) of the HAL in adult PWH.MethodsFifty adult (≥18 years) persons with mild to severe haemophilia completed the HAL (42 items, 7 domains, optimum 100) at baseline (T0) and 3-4 weeks later (T1). The intraclass correlation coefficient (ICC) and SDC were calculated for sum and component scores.ResultsFifty persons with haemophilia were included (median age 49 years; 92% haemophilia A; 70% severe haemophilia). The median (interquartile ranges) HAL sum score was 77 (62 to 99) at T0 and 81 (64 to 98) at T1. Reliability was good with ICCs for sum and component scores >0.9. The SDC for the sum score was 10.2, for the upper extremity component score 9.2, for the basic lower extremity component score 16.7 and for the complex lower extremity component score 13.4.ConclusionThe HAL has a good reliability for the sum and component scores. Score changes of the normalized sum HAL score greater than the SDC 10.2 indicate that the change was not a result of measurement error.
| S-EPMC7898911 | biostudies-literature
Project description:Objective(i) To develop the Pharmacy Value-Added Services Questionnaire (PVASQ) using emerging themes generated from interviews. (ii) To establish reliability and validity of questionnaire instrument.MethodsUsing an extended Theory of Planned Behavior as the theoretical model, face-to-face interviews generated salient beliefs of pharmacy value-added services. The PVASQ was constructed initially in English incorporating important themes and later translated into the Malay language with forward and backward translation. Intention (INT) to adopt pharmacy value-added services is predicted by attitudes (ATT), subjective norms (SN), perceived behavioral control (PBC), knowledge and expectations. Using a 7-point Likert-type scale and a dichotomous scale, test-retest reliability (N=25) was assessed by administrating the questionnaire instrument twice at an interval of one week apart. Internal consistency was measured by Cronbach's alpha and construct validity between two administrations was assessed using the kappa statistic and the intraclass correlation coefficient (ICC). Confirmatory Factor Analysis, CFA (N=410) was conducted to assess construct validity of the PVASQ.ResultsThe kappa coefficients indicate a moderate to almost perfect strength of agreement between test and retest. The ICC for all scales tested for intra-rater (test-retest) reliability was good. The overall Cronbach' s alpha (N=25) is 0.912 and 0.908 for the two time points. The result of CFA (N=410) showed most items loaded strongly and correctly into corresponding factors. Only one item was eliminated.ConclusionsThis study is the first to develop and establish the reliability and validity of the Pharmacy Value-Added Services Questionnaire instrument using the Theory of Planned Behavior as the theoretical model. The translated Malay language version of PVASQ is reliable and valid to predict Malaysian patients' intention to adopt pharmacy value-added services to collect partial medicine supply.
| S-EPMC4582746 | biostudies-literature
Project description:Structural magnetic resonance (MR) connectomics holds promise for the diagnosis, outcome prediction, and treatment monitoring of many common neurodevelopmental, psychiatric, and neurodegenerative disorders for which there is currently no clinical utility for MR imaging (MRI). Before computational network metrics from the human connectome can be applied in a clinical setting, their precision and their normative intersubject variation must be understood to guide the study design and the interpretation of longitudinal data. In this work, the reproducibility of commonly used graph theoretic measures is investigated, as applied to the structural connectome of healthy adult volunteers. Two datasets are examined, one consisting of 10 subjects scanned twice at one MRI facility and one consisting of five subjects scanned once each at two different facilities using the same imaging platform. Global graph metrics are calculated for unweighed and weighed connectomes, and two levels of granularity of the connectome are evaluated: one based on the 82-node cortical and subcortical parcellation from FreeSurfer and one based on an atlas-free parcellation of the gray-white matter boundary consisting of 1000 cortical nodes. The consistency of the unweighed and weighed edges and the module assignments are also computed for the 82-node connectomes. Overall, the results demonstrate good-to-excellent test-retest reliability for the entire connectome-processing pipeline, including the graph analytics, in both the intrasite and intersite datasets. These findings indicate that measurements of computational network metrics derived from the structural connectome have sufficient precision to be tested as potential biomarkers for diagnosis, prognosis, and monitoring of interventions in neurological and psychiatric diseases.
| S-EPMC3634151 | biostudies-literature
Project description:The spatial accuracy of transcranial magnetic stimulation (TMS) may be as small as a few millimeters. Despite such great potential, navigated TMS (nTMS) mapping is still underused for the assessment of motor plasticity, particularly in clinical settings. Here, we investigate the within-limb somatotopy gradient as well as absolute and relative reliability of three hand muscle cortical representations (MCRs) using a comprehensive grid-based sulcus-informed nTMS motor mapping. We enrolled 22 young healthy male volunteers. Two nTMS mapping sessions were separated by 5-10 days. Motor evoked potentials were obtained from abductor pollicis brevis (APB), abductor digiti minimi, and extensor digitorum communis. In addition to individual MRI-based analysis, we studied normalized MNI MCRs. For the reliability assessment, we calculated intraclass correlation and the smallest detectable change. Our results revealed a somatotopy gradient reflected by APB MCR having the most lateral location. Reliability analysis showed that the commonly used metrics of MCRs, such as areas, volumes, centers of gravity (COGs), and hotspots had a high relative and low absolute reliability for all three muscles. For within-limb TMS somatotopy, the most common metrics such as the shifts between MCR COGs and hotspots had poor relative reliability. However, overlaps between different muscle MCRs were highly reliable. We, thus, provide novel evidence that inter-muscle MCR interaction can be reliably traced using MCR overlaps while shifts between the COGs and hotspots of different MCRs are not suitable for this purpose. Our results have implications for the interpretation of nTMS motor mapping results in healthy subjects and patients with neurological conditions.
| S-EPMC8090785 | biostudies-literature
Project description:BACKGROUND:The DePaul Symptom Questionnaire (DSQ) was developed to provide a structured approach for collecting standardized symptomatology and health history information to allow researchers and clinicians to determine whether a patient meets the diagnostic criteria for myalgic encephalomyelitis/chronic fatigue syndrome (ME/CFS), myalgic encephalomyelitis (ME), and/or chronic fatigue syndrome (CFS). PURPOSE:The purpose of this study was to examine the test-retest reliability of the DSQ. METHODS:Test-retest reliability of the measure was examined with a sample of 26 adults self-identifying as having either ME/CFS, ME and/or CFS and 25 adults who did not self-identify as having these illnesses and were otherwise healthy controls. RESULTS:Overall, the majority of items on the DSQ exhibited good to excellent test-retest reliability, with Pearson's or kappa correlation coefficients that were 0.70 or higher. CONCLUSIONS:Thus, the present study suggests that the DSQ is a reliable diagnostic measure that can provide a standardized way of examining illness constructs and symptomatology among patients who identify as having ME/CFS, ME and/or CFS.
| S-EPMC4788471 | biostudies-other
Project description:BackgroundReliable clinical tests capable of measuring resistance are important tools for rehabilitation. One alternative that has recently increased in popularity is the use of elastic tubes, which stand out for being easy to handle, low cost, practical, and feasible.ObjectiveAnalyze the test-retest reliability of the knee extensors muscle fatigue resistance test (FRT) with elastic tubes.MethodsA total of 116 healthy young males, aged between 18 and 30 years old, participated in the study. Participants performed three pre-test stages: orientation, load presentation, and familiarization with equipment, lasting two weeks. Subsequently, they performed the FRT on two occasions (test and retest), with an interval of seven days. The reliability analyzes were performed using the intraclass correlation coefficient (ICC) with 95% confidence interval and typical measurement error (TME), also expressed as coefficient of variation (CV%).ResultsThe findings regarding the reliability of the test demonstrated satisfactory values (time: ICC = 0.66; 95%CI [0.50; 0.76]; CV(%) = 9.34; repetition: ICC = 0.61; 95%CI [0.46; 0.73], CV(%) = 13.66; rhythm: ICC = 0.52; 95%CI [0.35; 0.67], CV(%) = 10.29.ConclusionFrom the findings presented, it is concluded that the proposed clinical test with elastic tubes demonstrates evidence of acceptable values.
| S-EPMC6118382 | biostudies-literature
Project description:BackgroundNeurocognitive testing is an important concussion evaluation tool, but for neurocognitive tests to be useful, their psychometric properties must be well established. Test-retest reliability of computerized neurocognitive tests can influence their clinical utility. The reliability for a commonly used computerized neurocognitive test, CNS Vital Signs, is not well established. The purpose of this study was to examine test-retest reliability and reliable change indices for CNS Vital Signs in a healthy, physically active college population.HypothesisCNS Vital Signs yields acceptable test-retest reliability, with greater reliability between the second and third test administration compared with between the first and second administration.Study designCohort study.Level of evidenceLevel 3.MethodsForty healthy, active volunteers (16 men, 24 women; mean age, 21.05 ± 2.17 years) reported to a clinical laboratory for 3 sessions, 1 week apart. At each session, participants were administered CNS Vital Signs. Outcomes included standard scores for the following CNS Vital Signs domains: verbal memory, visual memory, psychomotor speed, cognitive flexibility, complex attention, processing speed, reaction time, executive functioning, and reasoning.ResultsParticipants performed significantly better on the second session and/or third session than they did on the first testing session on 6 of 9 neurocognitive domains. Pearson r test-retest correlations between sessions ranged from 0.11 to 0.87. Intraclass correlation coefficients ranged from 0.10 to 0.86.ConclusionClinicians should consider using reliable change indices to account for practice effects, identify meaningful score changes due to pathology, and inform clinical decisions.Clinical relevanceThis study highlights the importance of clinicians understanding the psychometric properties of computerized neurocognitive tests when using them in the management of sport-related concussion. If CNS Vital Signs is administered twice within a small time frame (such as 1 week), athletes should be expected to improve between the first and second administration.
| S-EPMC4547115 | biostudies-literature
Project description:Blind individuals are particularly dependent on their hearing for defining space. It has been found that both children and adults with visual impairments can struggle with complex spatial tasks that require a metric representation of space. Nonetheless the variability of methods employed to assess spatial abilities in absence of vision is wide, especially in the case of visually impaired children. For this reason, it would be necessary to define a battery of tests that appropriately assess different aspects of spatial perception and to investigate its reliability in order to provide a standard assessment of spatial abilities not only in experimental but also in clinical settings. The aim of this study is to determine the test-retest reliability of a battery of six spatial tasks (BSP, Blind Spatial Perception) and provide the first gold standard for assessing spatial cognition deficits in visually impaired children. Thirty visually impaired children aged 6-17 participated in two identical sessions, at a distance of 10 weeks, in which they performed six spatial tasks: auditory bisection, auditory localization, auditory distance discrimination, auditory reaching, proprioceptive reaching, and general mobility. Test-retest reliability was assessed using the test-retest scatter plots, intra-class correlation coefficient (ICC), and coefficient of variation (CV). The results showed good-to-excellent reliability for all six tests, with average ICC values ranging from 0.77 to 0.89 and average CV values ranging from 3.44% to 15.27%. In conclusion, the newly proposed battery (BSP) results as a reliable tool to identify spatial impairments in visually impaired children.
| S-EPMC6472727 | biostudies-literature