Dataset Information

Distinct Inflammation Biomarkers in Healthy Individuals and Patients with Schizophrenia: A Reliability Testing of Multiplex Cytokine Immunoassay by Bland-Altman Analysis.

ABSTRACT:

Objective

Since the inflammatory process has been implicated in the pathophysiology of psychiatric disorder, an important issue emerging is to assess the test-retest reliability of cytokine measurement in healthy individuals and patients with schizophrenia. The objective of the present study was to investigate the test-retest reliability of bead-based multiplex immunoassay technology (BMIT) for cytokine measurement by using a Bland-Altman plot (BAP).

Methods

Twenty healthy individuals and twenty patients with schizophrenia were enrolled, and a 17-plex cytokine assay was used to measure inflammatory biomarkers at baseline and two weeks later. The test-retest reliability was examined by BAP, 95% limits of agreement (LOA), intraclass correlation coefficient (ICC), and coefficient of repeatability (CoR).

Results

In the healthy controls, only interleukin (IL)-2, IL-13, IL-10, IL-17, and macrophage inflammatory protein-1? showed excellent ICC. The BAP with 95% LOA determined that 13 cytokines showed acceptable 95% LOA for a 2-week test-retest reliability, and only IL-1?, IL-12 and tumor necrosis factor (TNF)-? had significant test-retest bias. The CoR of cytokines varied significantly, ranging from 1.72 to 218.1. Compared with healthy controls, patients with schizophrenia showed significantly higher levels of IL-5, IL-13, and TNF-? and significantly lower levels of IL-4, IL-12, and interferon-gamma (IFN-?). Of these six cytokines, IL-12 and TNF-? were considered suboptimal reliability.

Conclusion

The findings from ICC and CoR implied that the test-retest reliability of BMIT for cytokine measurement were suboptimal. However, the BAP with 95% LOA confirmed that BMIT can reliably distinguish schizophrenia from healthy individuals in cytokine measurement, while significant within-subject variation and between-group overlapping were evident in cytokine expression.

SUBMITTER: Yeh TC

PROVIDER: S-EPMC6710413 | biostudies-literature | 2019 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Distinct Inflammation Biomarkers in Healthy Individuals and Patients with Schizophrenia: A Reliability Testing of Multiplex Cytokine Immunoassay by Bland-Altman Analysis.

Yeh Ta-Chuan TC Chu Hsuan-Te HT Tsai Chia-Kuang CK Chang Hsin-An HA Yang Fu-Chi FC Huang San-Yuan SY Liang Chih-Sung CS

Psychiatry investigation 20190730 8

<h4>Objective</h4>Since the inflammatory process has been implicated in the pathophysiology of psychiatric disorder, an important issue emerging is to assess the test-retest reliability of cytokine measurement in healthy individuals and patients with schizophrenia. The objective of the present study was to investigate the test-retest reliability of bead-based multiplex immunoassay technology (BMIT) for cytokine measurement by using a Bland-Altman plot (BAP).<h4>Methods</h4>Twenty healthy individ ...[more]

PMID: 31352771

Similar Datasets

Project description:Precise monitoring of the rapidly changing immune status during the course of a disease requires multiplex analysis of cytokines from frequently sampled human blood. However, the current lack of rapid, multiplex, and low volume assays makes immune monitoring for clinical decision-making (e.g., critically ill patients) impractical. Without such assays, immune monitoring is even virtually impossible for infants and neonates with infectious diseases and/or immune mediated disorders as access to their blood in large quantities is prohibited. Localized surface plasmon resonance (LSPR)-based microfluidic optical biosensing is a promising approach to fill this technical gap as it could potentially permit real-time refractometric detection of biomolecular binding on a metallic nanoparticle surface and sensor miniaturization, both leading to rapid and sample-sparing analyte analysis. Despite this promise, practical implementation of such a microfluidic assay for cytokine biomarker detection in serum samples has not been established primarily due to the limited sensitivity of LSPR biosensing. Here, we developed a high-throughput, label-free, multiarrayed LSPR optical biosensor device with 480 nanoplasmonic sensing spots in microfluidic channel arrays and demonstrated parallel multiplex immunoassays of six cytokines in a complex serum matrix on a single device chip while overcoming technical limitations. The device was fabricated using easy-to-implement, one-step microfluidic patterning and antibody conjugation of gold nanorods (AuNRs). When scanning the scattering light intensity across the microarrays of AuNR ensembles with dark-field imaging optics, our LSPR biosensing technique allowed for high-sensitivity quantitative cytokine measurements at concentrations down to 5-20 pg/mL from a 1 μL serum sample. Using the nanoplasmonic biosensor microarray device, we demonstrated the ability to monitor the inflammatory responses of infants following cardiopulmonary bypass (CPB) surgery through tracking the time-course variations of their serum cytokines. The whole parallel on-chip assays, which involved the loading, incubation, and washing of samples and reagents, and 10-fold replicated multianalyte detection for each sample using the entire biosensor arrays, were completed within 40 min.

Project description:Reliable quantification in biological systems of endogenous low- and high-molecular substances, drugs and their metabolites, is of particular importance in diagnosis and therapy, and in basic and clinical research. The analytical characteristics of analytical approaches have many differences, including in core features such as accuracy, precision, specificity, and limits of detection (LOD) and quantitation (LOQ). Several different mathematic approaches were developed and used for the comparison of two analytical methods applied to the same chemical compound in the same biological sample. Generally, comparisons of results obtained by two analytical methods yields different quantitative results. Yet, which mathematical approach gives the most reliable results? Which mathematical approach is best suited to demonstrate agreement between the methods, or the superiority of an analytical method A over analytical method B? The simplest and most frequently used method of comparison is the linear regression analysis of data observed by method A (y) and the data observed by method B (x): y = α + βx. In 1986, Bland and Altman indicated that linear regression analysis, notably the use of the correlation coefficient, is inappropriate for method-comparison. Instead, Bland and Altman have suggested an alternative approach, which is generally known as the Bland-Altman approach. Originally, this method of comparison was applied in medicine, for instance, to measure blood pressure by two devices. The Bland-Altman approach was rapidly adapted in analytical chemistry and in clinical chemistry. To date, the approach suggested by Bland-Altman approach is one of the most widely used mathematical approaches for method-comparison. With about 37,000 citations, the original paper published in the journal The Lancet in 1986 is among the most frequently cited scientific papers in this area to date. Nevertheless, the Bland-Altman approach has not been really set on a quantitative basis. No criteria have been proposed thus far, in which the Bland-Altman approach can form the basis on which analytical agreement or the better analytical method can be demonstrated. In this article, the Bland-Altman approach is re-valuated from a quantitative bioanalytical perspective, and an attempt is made to propose acceptance criteria. For this purpose, different analytical methods were compared with Gold Standard analytical methods based on mass spectrometry (MS) and tandem mass spectrometry (MS/MS), i.e., GC-MS, GC-MS/MS, LC-MS and LC-MS/MS. Other chromatographic and non-chromatographic methods were also considered. The results for several different endogenous substances, including nitrate, anandamide, homoarginine, creatinine and malondialdehyde in human plasma, serum and urine are discussed. In addition to the Bland-Altman approach, linear regression analysis and the Oldham-Eksborg method-comparison approaches were used and compared. Special emphasis was given to the relation of difference and mean in the Bland-Altman approach. Currently available guidelines for method validation were also considered. Acceptance criteria for method agreement were proposed, including the slope and correlation coefficient in linear regression, and the coefficient of variation for the percentage difference in the Bland-Altman and Oldham-Eksborg approaches.

Project description:ObjectiveThis study aims to propose a comprehensive alternative to the Bland-Altman plot method, addressing its limitations and providing a statistical framework for evaluating the equivalences of measurement techniques. This involves introducing an innovative three-step approach for assessing accuracy, precision, and agreement between techniques, which enhances objectivity in equivalence assessment. Additionally, the development of an R package that is easy to use enables researchers to efficiently analyze and interpret technique equivalences.MethodsInferential statistics support for equivalence between measurement techniques was proposed in three nested tests. These were based on structural regressions with the goal to assess the equivalence of structural means (accuracy), the equivalence of structural variances (precision), and concordance with the structural bisector line (agreement in measurements obtained from the same subject), using analytical methods and robust approach by bootstrapping. To promote better understanding, graphical outputs following Bland and Altman's principles were also implemented.ResultsThe performance of this method was shown and confronted by five data sets from previously published articles that used Bland and Altman's method. One case demonstrated strict equivalence, three cases showed partial equivalence, and one showed poor equivalence. The developed R package containing open codes and data are available for free and with installation instructions at Harvard Dataverse at https://doi.org/10.7910/DVN/AGJPZH.ConclusionAlthough easy to communicate, the widely cited and applied Bland and Altman plot method is often misinterpreted, since it lacks suitable inferential statistical support. Common alternatives, such as Pearson's correlation or ordinal least-square linear regression, also fail to locate the weakness of each measurement technique. It may be possible to test whether two techniques have full equivalence by preserving graphical communication, in accordance with Bland and Altman's principles, but also adding robust and suitable inferential statistics. Decomposing equivalence into three features (accuracy, precision, and agreement) helps to locate the sources of the problem when fixing a new technique.

Project description:BACKGROUND/OBJECTIVES:Bland-Altman methods for assessing the agreement between two measures are highly cited. However, these methods may often not be used to assess agreement, and when used, they are not always presented or interpreted correctly. Our objective was to evaluate the use and the quality of reporting of Bland-Altman analyses in studies that compare self-reported with measured weight and height. METHODS:We evaluated the use of Bland-Altman methods in 394 published articles that compared self-reported and measured weight and height data for adolescents or adults. Six reporting criteria were developed: assessment of the normality of the distribution of differences, a complete and correctly labeled Bland-Altman plot displaying the mean difference and limits of agreement (LOA), numerical values and confidence intervals, standard errors, or standard deviations for mean difference, numerical values of LOA, confidence intervals for LOA, and prespecified criteria for acceptable LOA. RESULTS:Only 72/394 (18%) studies comparing self-reported with measured weight and height or BMI used some form of Bland-Altman analyses. No study using Bland-Altman analyses satisfied more than four of the six criteria. Of the 72 studies, 64 gave mean differences along with confidence intervals or standard deviations, 55 provided complete Bland-Altman plots that were appropriately labeled and described, 37 provided numerical values for LOA, 4 reported that they examined the normality of the distribution of differences, 3 provided confidence intervals for LOA, and 3 had prespecified criteria for agreement. CONCLUSIONS:Bland-Altman methods appear to be infrequently used in studies comparing measured with self-reported weight, height, or BMI, and key information is missing in many of those that do use Bland-Altman methods. Future directions would be defining acceptable LOA values and improving the reporting and application of Bland-Altman methods in studies of self-reported anthropometry.

Dataset Information

Distinct Inflammation Biomarkers in Healthy Individuals and Patients with Schizophrenia: A Reliability Testing of Multiplex Cytokine Immunoassay by Bland-Altman Analysis.

Objective

Methods

Results

Conclusion

Publications

Distinct Inflammation Biomarkers in Healthy Individuals and Patients with Schizophrenia: A Reliability Testing of Multiplex Cytokine Immunoassay by Bland-Altman Analysis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets