Dataset Information

Analytical validation of a multi-biomarker algorithmic test for prediction of progressive kidney function decline in patients with early-stage kidney disease

ABSTRACT:

Background

The KidneyIntelX™ test applies a machine learning algorithm that incorporates plasma biomarkers and clinical variables to produce a composite risk score to predict a progressive decline in kidney function in patients with type 2 diabetes (T2D) and early-stage chronic kidney disease (CKD). The following studies describe the analytical validation of the KidneyIntelX assay including impact of observed methodologic variability on the composite risk score.

Methods

Analytical performance studies of sensitivity, precision, and linearity were performed on three biomarkers assayed in multiplexed format: kidney injury molecule-1 (KIM-1), soluble tumor necrosis factor receptor-1 (sTNFR-1) and soluble tumor necrosis factor receptor-2 (sTNFR-2) based on Clinical Laboratory Standards Institute (CLSI) guidelines. Analytical variability across twenty (20) experiments across multiple days, operators, and reagent lots was assessed to examine the impact on the reproducibility of the composite risk score. Analysis of cross-reactivity and interfering substances was also performed.

Results

Assays for KIM-1, sTNFR-1 and sTNFR-2 demonstrated acceptable sensitivity. Mean within-laboratory imprecision coefficient of variation (CV) was established as less than 9% across all assays in a multi-lot study. The linear range of the assays was determined as 12–5807 pg/mL, 969–23,806 pg/mL and 4256–68,087 pg/mL for KIM-1, sTNFR-1 and sTNFR-2, respectively. The average risk score CV% was less than 5%, with 98% concordance observed for assignment of risk categories. Cross-reactivity between critical assay components in a multiplexed format did not exceed 1.1%.

Conclusions

The set of analytical validation studies demonstrated robust analytical performance across all three biomarkers contributing to the KidneyIntelX risk score, meeting or exceeding specifications established during characterization studies. Notably, reproducibility of the composite risk score demonstrated that expected analytical laboratory variation did not impact the assigned risk category, and therefore, the clinical validity of the reported results.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12014-021-09332-y.

SUBMITTER: Connolly P

PROVIDER: S-EPMC8597271 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Introduction: Sepsis is a complex immunological response to infection characterized by early hyperinflammation followed by severe and protracted immunosuppression, suggesting that a multi-marker approach has the greatest clinical utility for early detection, within a clinical environment focused on SIRS differentiation. Pre-clinical research using an equine sepsis model identified a panel of gene expression biomarkers that define the early aberrant immune activation. Thus, the primary objective was to apply these gene expression biomarkers to distinguish patients with sepsis from those who had undergone major open surgery and had clinical outcomes consistent with systemic inflammation due to physical trauma and wound healing. Methods: This was a multi-centre, prospective clinical trial conducted across 4 tertiary critical care settings in Australia. Sepsis patients were recruited if they met the 1992 Consensus Statement criteria and had clinical evidence of systemic infection based on microbiology diagnoses (n=27). Participants in the post-surgical (PS) group were recruited pre-operatively and blood samples collected within 24 hours following surgery (n=38). Healthy controls (HC) included hospital staff with no known concurrent illnesses (n=20). Each participant had minimally 5ml of PAXgene blood collected for leucocyte RNA isolation and gene expression analyses. Affymetrix array and multiplex tandem (MT)-PCR studies were conducted to evaluate transcriptional profiles in circulating white blood cells applying a set of 42 molecular markers that had been identified a priori. A LogitBoost algorithm was used to create a machine learning diagnostic rule to predict sepsis outcomes. Results: Based on preliminary microarray analyses comparing HC and sepsis groups. A panel of 42-gene expression markers were identified that represented key innate and adaptive immune function, cell cycling, WBC differentiation, extracellular remodelling and immune modulation pathways. Comparisons against GEO data confirmed the definitive separation of the sepsis cohort. Quantitative PCR results suggest the capacity for this test to differentiate severe systemic inflammation from HC is 92%. AUC ROC curve findings demonstrated sepsis prediction within a mixed inflammatory population, was between 86 - 92%. Conclusions: This novel molecular biomarker test has a clinically relevant sensitivity and specificity profile, and has the capacity for early detection of sepsis via the monitoring of critical care patients. GEO Note: Data made available represents the preliminary microarray investigation performed on Human U133 Plus 2.0 GeneChips (Affymetrix), assaying 41 patient samples (Sepsis n=10, Post-Surgical n=11, Control n=20).

Project description:BackgroundEndoPredict (EP) is a clinically validated multianalyte gene expression test to predict distant metastasis in ER-positive, HER2-negative breast cancer treated with endocrine therapy alone. The test is based on the combined analysis of 12 genes in formalin-fixed, paraffin-embedded (FFPE) tissue by reverse transcription-quantitative real-time PCR (RT-qPCR). Recently, it was shown that EP is feasible for reliable decentralized assessment of gene expression. The aim of this study was the analytical validation of the performance characteristics of the assay and its verification in a molecular-pathological routine laboratory.MethodsGene expression values to calculate the EP score were assayed by one-step RT-qPCR using RNA from FFPE tumor tissue. Limit of blank, limit of detection, linear range, and PCR efficiency were assessed for each of the 12 PCR assays using serial samples dilutions. Different breast cancer samples were used to evaluate RNA input range, precision and inter-laboratory variability.ResultsPCR assays were linear up to Cq values between 35.1 and 37.2. Amplification efficiencies ranged from 75% to 101%. The RNA input range without considerable change of the EP score was between 0.16 and 18.5 ng/μl. Analysis of precision (variation of day, day time, instrument, operator, reagent lots) resulted in a total noise (standard deviation) of 0.16 EP score units on a scale from 0 to 15. The major part of the total noise (SD 0.14) was caused by the replicate-to-replicate noise of the PCR assays (repeatability) and was not associated with different operating conditions (reproducibility). Performance characteristics established in the manufacturer's laboratory were verified in a routine molecular pathology laboratory. Comparison of 10 tumor samples analyzed in two different laboratories showed a Pearson coefficient of 0.995 and a mean deviation of 0.15 score units.ConclusionsThe EP test showed reproducible performance characteristics with good precision and negligible laboratory-to-laboratory variation. This study provides further evidence that the EP test is suitable for decentralized testing in specialized molecular pathological laboratories instead of a reference laboratory. This is a unique feature and a technical advance in comparison with existing RNA-based prognostic multigene expression tests.