Dataset Information

The total deviation index estimated by tolerance intervals to evaluate the concordance of measurement devices.

ABSTRACT:

Background

In an agreement assay, it is of interest to evaluate the degree of agreement between the different methods (devices, instruments or observers) used to measure the same characteristic. We propose in this study a technical simplification for inference about the total deviation index (TDI) estimate to assess agreement between two devices of normally-distributed measurements and describe its utility to evaluate inter- and intra-rater agreement if more than one reading per subject is available for each device.

Methods

We propose to estimate the TDI by constructing a probability interval of the difference in paired measurements between devices, and thereafter, we derive a tolerance interval (TI) procedure as a natural way to make inferences about probability limit estimates. We also describe how the proposed method can be used to compute bounds of the coverage probability.

Results

The approach is illustrated in a real case example where the agreement between two instruments, a handle mercury sphygmomanometer device and an OMRON 711 automatic device, is assessed in a sample of 384 subjects where measures of systolic blood pressure were taken twice by each device. A simulation study procedure is implemented to evaluate and compare the accuracy of the approach to two already established methods, showing that the TI approximation produces accurate empirical confidence levels which are reasonably close to the nominal confidence level.

Conclusions

The method proposed is straightforward since the TDI estimate is derived directly from a probability interval of a normally-distributed variable in its original scale, without further transformations. Thereafter, a natural way of making inferences about this estimate is to derive the appropriate TI. Constructions of TI based on normal populations are implemented in most standard statistical packages, thus making it simpler for any practitioner to implement our proposal to assess agreement.

SUBMITTER: Escaramis G

PROVIDER: S-EPMC2859350 | biostudies-literature | 2010 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The total deviation index estimated by tolerance intervals to evaluate the concordance of measurement devices.

Escaramís Geòrgia G Ascaso Carlos C Carrasco Josep L JL

BMC medical research methodology 20100408

<h4>Background</h4>In an agreement assay, it is of interest to evaluate the degree of agreement between the different methods (devices, instruments or observers) used to measure the same characteristic. We propose in this study a technical simplification for inference about the total deviation index (TDI) estimate to assess agreement between two devices of normally-distributed measurements and describe its utility to evaluate inter- and intra-rater agreement if more than one reading per subject ...[more]

PMID: 20377875

Similar Datasets

Project description:The Gait Deviation Index (GDI) is a dimensionless multivariate measure of overall gait pathology represented as a single score that indicates the gait deviation from a normal gait average. It is calculated using kinematic data recorded during a three-dimensional gait analysis and an orthonormal vectorial basis with 15 gait features that was originally obtained using singular value decomposition and feature analysis on a dataset of children with cerebral palsy. Ever since, it has been used as an outcome measure to study gait in several conditions, including spinal cord injury (SCI). Nevertheless, the validity of implementing the GDI in a population with SCI has not been studied yet. We investigate the application of these mathematical methods to derive a similar metric but with a dataset of adults with SCI (SCI-GDI). The new SCI-GDI is compared with the original GDI to evaluate their differences and assess the need for a specific GDI for SCI and with the WISCI II to evaluate its sensibility. Our findings show that a 21-feature basis is necessary to account for most of the variance in gait patterns in the SCI population and to provide high-quality reconstructions of the gait curves included in the dataset and in foreign data. Furthermore, using only the first 15 features of our SCI basis, the fidelity of the reconstructions obtained in our population is higher than that when using the basis of the original GDI. The results showed that the SCI-GDI discriminates most levels of the WISCI II scale, except for levels 12 and 18. Statistically significant differences were found between both indexes within each WISCI II level except for 12, 20, and the control group (p < 0.05). In all levels, the average GDI value was greater than the average SCI-GDI value, but the difference between both indexes is larger in data with greater impairment and it reduces progressively toward a normal gait pattern. In conclusion, the implementation of the original GDI in SCI may lead to overestimation of gait function, and our new SCI-GDI is more sensitive to larger gait impairment than the GDI. Further validation of the SCI-GDI with other scales validated in SCI is needed.

Dataset Information

The total deviation index estimated by tolerance intervals to evaluate the concordance of measurement devices.

Background

Methods

Results

Conclusions

Publications

The total deviation index estimated by tolerance intervals to evaluate the concordance of measurement devices.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets