Dataset Information

A framework for the meta-analysis of Bland-Altman studies based on a limits of agreement approach.

ABSTRACT: Bland-Altman method comparison studies are common in the medical sciences and are used to compare a new measure to a gold-standard (often costlier or more invasive) measure. The distribution of these differences is summarized by two statistics, the 'bias' and standard deviation, and these measures are combined to provide estimates of the limits of agreement (LoA). When these LoA are within the bounds of clinically insignificant differences, the new non-invasive measure is preferred. Very often, multiple Bland-Altman studies have been conducted comparing the same two measures, and random-effects meta-analysis provides a means to pool these estimates. We provide a framework for the meta-analysis of Bland-Altman studies, including methods for estimating the LoA and measures of uncertainty (i.e., confidence intervals). Importantly, these LoA are likely to be wider than those typically reported in Bland-Altman meta-analyses. Frequently, Bland-Altman studies report results based on repeated measures designs but do not properly adjust for this design in the analysis. Meta-analyses of Bland-Altman studies frequently exclude these studies for this reason. We provide a meta-analytic approach that allows inclusion of estimates from these studies. This includes adjustments to the estimate of the standard deviation and a method for pooling the estimates based upon robust variance estimation. An example is included based on a previously published meta-analysis. Copyright © 2017 John Wiley & Sons, Ltd.

SUBMITTER: Tipton E

PROVIDER: S-EPMC5585060 | biostudies-literature | 2017 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A framework for the meta-analysis of Bland-Altman studies based on a limits of agreement approach.

Tipton Elizabeth E Shuster Jonathan J

Statistics in medicine 20170629 23

Bland-Altman method comparison studies are common in the medical sciences and are used to compare a new measure to a gold-standard (often costlier or more invasive) measure. The distribution of these differences is summarized by two statistics, the 'bias' and standard deviation, and these measures are combined to provide estimates of the limits of agreement (LoA). When these LoA are within the bounds of clinically insignificant differences, the new non-invasive measure is preferred. Very often, ...[more]

PMID: 28664537

Similar Datasets

Project description:BACKGROUND/OBJECTIVES:Bland-Altman methods for assessing the agreement between two measures are highly cited. However, these methods may often not be used to assess agreement, and when used, they are not always presented or interpreted correctly. Our objective was to evaluate the use and the quality of reporting of Bland-Altman analyses in studies that compare self-reported with measured weight and height. METHODS:We evaluated the use of Bland-Altman methods in 394 published articles that compared self-reported and measured weight and height data for adolescents or adults. Six reporting criteria were developed: assessment of the normality of the distribution of differences, a complete and correctly labeled Bland-Altman plot displaying the mean difference and limits of agreement (LOA), numerical values and confidence intervals, standard errors, or standard deviations for mean difference, numerical values of LOA, confidence intervals for LOA, and prespecified criteria for acceptable LOA. RESULTS:Only 72/394 (18%) studies comparing self-reported with measured weight and height or BMI used some form of Bland-Altman analyses. No study using Bland-Altman analyses satisfied more than four of the six criteria. Of the 72 studies, 64 gave mean differences along with confidence intervals or standard deviations, 55 provided complete Bland-Altman plots that were appropriately labeled and described, 37 provided numerical values for LOA, 4 reported that they examined the normality of the distribution of differences, 3 provided confidence intervals for LOA, and 3 had prespecified criteria for agreement. CONCLUSIONS:Bland-Altman methods appear to be infrequently used in studies comparing measured with self-reported weight, height, or BMI, and key information is missing in many of those that do use Bland-Altman methods. Future directions would be defining acceptable LOA values and improving the reporting and application of Bland-Altman methods in studies of self-reported anthropometry.

Dataset Information

A framework for the meta-analysis of Bland-Altman studies based on a limits of agreement approach.

Publications

A framework for the meta-analysis of Bland-Altman studies based on a limits of agreement approach.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure