Model Re-Estimation: An Alternative for Poor Predictive Performance during External Evaluations? Example of Gentamicin in Critically Ill Patients.
Ontology highlight
ABSTRACT: Background
An external evaluation is crucial before clinical applications; however, only a few gentamicin population pharmacokinetic (PopPK) models for critically ill patients included it in the model development. In this study, we aimed to evaluate gentamicin PopPK models developed for critically ill patients.Methods
The evaluated models were selected following a literature review on aminoglycoside PopPK models for critically ill patients. The data of patients were retrospectively collected from two Quebec hospitals, the external evaluation and model re-estimation were performed with NONMEM® (v7.5) and the population bias and imprecisions were estimated. Dosing regimens were simulated using the best performing model.Results
From the datasets of 39 and 48 patients from the two Quebec hospitals, none of the evaluated models presented acceptable values for bias and imprecision. Following model re-estimations, all models showed an acceptable predictive performance. An a priori dosing nomogram was developed with the best performing re-estimated model and was consistent based on recommended dosing regimens.Conclusion
Due to the poor predictive performance during the external evaluations, the latter must be prioritized during model development. Model re-estimation may be an alternative to developing a new model, especially when most known models display similar covariates.
SUBMITTER: Duong A
PROVIDER: S-EPMC9315759 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundAccurate measurement of pulmonary oxygenation is important for classification of disease severity and quantification of outcomes in clinical studies. Currently, tension-based methods such as P/F ratio are in widespread use, but are known to be less accurate than content-based methods. However, content-based methods require invasive measurements or sophisticated equipment that are rarely used in clinical practice. We devised two new methods to infer shunt fraction from a single arterial blood gas sample: (1) a non-invasive effective shunt (ES) fraction calculated using a rearrangement of the indirect Fick equation, standard constants, and a procedural inversion of the relationship between content and tension and (2) inferred values from a database of outputs from an integrated mathematical model of gas exchange (DB). We compared the predictive validity-the accuracy of predictions of PaO2 following changes in FIO2-of each measure in a retrospective database of 78,159 arterial blood gas (ABG) results from critically ill patients.ResultsIn a formal test set comprising 9,635 pairs of ABGs, the median absolute error (MAE) values for the four measures were as follows: alveolar-arterial difference, 7.30 kPa; PaO2/FIO2 ratio, 2.41 kPa; DB, 2.13 kPa; and ES, 1.88 kPa. ES performed significantly better than other measures (p < 10-10 in all comparisons). Further exploration of the DB method demonstrated that obtaining two blood gas measurements at different FIO2 provides a more precise description of pulmonary oxygenation.ConclusionsEffective shunt can be calculated using a computationally efficient procedure using routinely collected arterial blood gas data and has better predictive validity than other analytic methods. For practical assessment of oxygenation in clinical research, ES should be used in preference to other indices. ES can be calculated at http://baillielab.net/es .
| S-EPMC6701711 | biostudies-literature
Project description:BACKGROUND:The Dutch Pediatric Formulary (DPF) increasingly bases its guidelines on model-based dosing simulations from pharmacokinetic studies. This resulted in nationwide dose changes for vancomycin, gentamicin, and tobramycin in 2015. OBJECTIVE:We aimed to evaluate target attainment of these altered, model-based doses in critically ill neonates and children. METHODS:This was a retrospective cohort study in neonatal intensive care unit (NICU) and pediatric ICU (PICU) patients receiving vancomycin, gentamicin, or tobramycin between January 2015 and March 2017 in two university hospitals. The first therapeutic drug monitoring concentration for each patient was collected, as was clinical and dosing information. Vancomycin and tobramycin target trough concentrations were 10-15 and???1 mg/L, respectively. Target gentamicin trough and peak concentrations were?<?1 and 8-12 mg/L, respectively. RESULTS:In total, 482 patients were included (vancomycin [PICU] n?=?62, [NICU] n?=?102; gentamicin [NICU] n?=?97; tobramycin [NICU] n?=?221). Overall, median trough concentrations were within the target range for all cohorts but showed large interindividual variability, causing nontarget attainment. Trough concentrations were outside the target range in 66.1%, 60.8%, 14.7%, and 23.1% of patients in these four cohorts, respectively. Gentamicin peak concentrations were outside the range in 69% of NICU patients (term neonates 87.1%, preterm infants 57.1%). Higher creatinine concentrations were associated with higher vancomycin and tobramycin trough concentrations. CONCLUSION:This study illustrates the need to validate model-based dosing advice in the real-world setting as both sub- and supratherapeutic concentrations of vancomycin, gentamicin, and tobramycin were very prevalent. Our data underline the necessity for further individualization by addressing the high interindividual variability to improve target attainment.
| S-EPMC7383037 | biostudies-literature
Project description:BackgroundSepsis is a global health priority. Interventions to reduce the burden of sepsis need to be both effective and cost-effective. We performed a systematic review of the literature on health economic evaluations of sepsis treatments in critically ill adult patients and summarised the evidence for cost-effectiveness.MethodsWe systematically searched MEDLINE, Embase, and the Cochrane Library using thesaurus (e.g. MeSH) and free-text terms related to sepsis and economic evaluations. We included all articles that reported, in any language, an economic evaluation of an intervention for the management of sepsis in critically ill adult patients. Data extracted included study details, intervention details, economic evaluation methodology, and outcomes. Included studies were appraised for reporting quality using the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) checklist.ResultsWe identified 50 records representing 46 economic evaluations for a variety of interventions including antibiotics (n = 5), fluid therapy (n = 2), early goal-directed therapy and other resuscitation protocols (n = 8), immunoglobulins (n = 2), and interventions no longer in clinical use such as monoclonal antibodies (n = 7) and drotrecogin alfa (n = 13). Twelve (26%) evaluations were of excellent reporting quality. Incremental cost-effectiveness ratios (ICERs) ranged from dominant (lower costs and higher effectiveness) for early goal-directed therapy, albumin, and a multifaceted sepsis education program to dominated (higher costs and lower effectiveness) for polymerase chain reaction assays (LightCycler SeptiFast testing MGRADE®, SepsiTest™, and IRIDICA BAC BSI assay). ICERs varied widely across evaluations, particularly in subgroup analyses.ConclusionsThere is wide variation in the cost-effectiveness of sepsis interventions. There remain important gaps in the literature, with no economic evaluations identified for several interventions routinely used in sepsis. Given the high economic and social burden of sepsis, high-quality economic evaluations are needed to increase our understanding of the cost-effectiveness of these interventions in routine clinical practice and to inform decision makers.Trial registrationPROSPERO CRD42018095980.
| S-EPMC6950865 | biostudies-literature
Project description:Background: Systemic inflammation is a whole body reaction that can have an infection-positive (i.e. sepsis) or infection-negative origin. It is important to distinguish between septic and non-septic presentations early and reliably, because this has significant therapeutic implications for critically ill patients. We hypothesized that a molecular classifier based on a small number of RNAs expressed in peripheral blood could be discovered that would: 1) determine which patients with systemic inflammation had sepsis; 2) be robust across independent patient cohorts; 3) be insensitive to disease severity; and 4) provide diagnostic utility. The overall goal of this study was to identify and validate such a molecular classifier. Methods and Findings: We conducted an observational, non-interventional study of adult patients recruited from tertiary intensive care units (ICU). Biomarker discovery was conducted with an Australian cohort (n = 105) consisting of sepsis patients and post -surgical patients with infection-negative systemic inflammation. Using this cohort, a four-gene classifier consisting of a combination of CEACAM4, LAMP1, PLA2G7 and PLAC8 RNA biomarkers was identified. This classifier, designated SeptiCyte® Lab, was externally validated using RT-qPCR and receiver operating characteristic (ROC) curve analysis in five cohorts (n = 345) from the Netherlands. Cohort 1 (n=59) consisted of unambiguous septic cases and infection-negative systemic inflammation controls; SeptiCyte® Lab gave an area under curve (AUC) of 0.96 (95% CI: 0.91-1.00). ROC analysis of a more heterogeneous group of patients (Cohorts 2-5; 249 patients after excluding 37 patients with infection likelihood possible) gave an AUC of 0.89 (95% CI: 0.85-0.93). Disease severity, as measured by Sequential Organ Failure Assessment (SOFA) score or the Acute Physiology and Chronic Health Evaluation (APACHE) IV score, was not a significant confounding variable. The diagnostic utility o f SeptiCyte® Lab was evaluated by comparison to various clinical and laboratory parameters that would be available to a clinician within 24 hours of ICU admission. SeptiCyte® Lab was significantly better at differentiating sepsis from infection-negative systemic inflammation than all tested parameters, both singly and in various logistic combinations. SeptiCyte® Lab more than halved the diagnostic error rate compared to PCT in all tested cohorts or cohort combinations. Conclusions: SeptiCyte® Lab is a rapid molecular assay that may be clinically useful in the management of ICU patients with systemic inflammation. SIRS and Sepsis ICU patients, admission samples Retrospective, mutli-site sutdy using retrospective physician adjudication as a comparator
2015-10-24 | E-GEOD-74224 | biostudies-arrayexpress
Project description:BackgroundDiaphragm dysfunction develops frequently in ventilated intensive care unit (ICU) patients. Both disuse atrophy (ventilator over-assist) and high respiratory muscle effort (ventilator under-assist) seem to be involved. A strong rationale exists to monitor diaphragm effort and titrate support to maintain respiratory muscle activity within physiological limits. Diaphragm electromyography is used to quantify breathing effort and has been correlated with transdiaphragmatic pressure and esophageal pressure. The neuromuscular efficiency index (NME) can be used to estimate inspiratory effort, however its repeatability has not been investigated yet. Our goal is to evaluate NME repeatability during an end-expiratory occlusion (NMEoccl) and its use to estimate the pressure generated by the inspiratory muscles (Pmus).MethodsThis is a prospective cohort study, performed in a medical-surgical ICU. A total of 31 adult patients were included, all ventilated in neurally adjusted ventilator assist (NAVA) mode with an electrical activity of the diaphragm (EAdi) catheter in situ. At four time points within 72 h five repeated end-expiratory occlusion maneuvers were performed. NMEoccl was calculated by delta airway pressure (?Paw)/?EAdi and was used to estimate Pmus. The repeatability coefficient (RC) was calculated to investigate the NMEoccl variability.ResultsA total number of 459 maneuvers were obtained. At time T?=?0 mean NMEoccl was 1.22?±?0.86 cmH2O/?V with a RC of 82.6%. This implies that when NMEoccl is 1.22 cmH2O/?V, it is expected with a probability of 95% that the subsequent measured NMEoccl will be between 2.22 and 0.22 cmH2O/?V. Additional EAdi waveform analysis to correct for non-physiological appearing waveforms, did not improve NMEoccl variability. Selecting three out of five occlusions with the lowest variability reduced the RC to 29.8%.ConclusionsRepeated measurements of NMEoccl exhibit high variability, limiting the ability of a single NMEoccl maneuver to estimate neuromuscular efficiency and therefore the pressure generated by the inspiratory muscles based on EAdi.
| S-EPMC6161422 | biostudies-literature
Project description:BackgroundNonosmotic sodium storage has been reported in animals, healthy individuals and patients with hypertension, hyperaldosteronism and end-stage kidney disease. Sodium storage has not been studied in ICU patients, who frequently receive large amounts of sodium chloride-containing fluids. The objective of our study was to estimate sodium that cannot be accounted for by balance studies in critically ill patients. Chloride was also studied. We used multiple scenarios and assumptions for estimating sodium and chloride balances.MethodsWe retrospectively analyzed patients admitted to the ICU after cardiothoracic surgery with complete fluid, sodium and chloride balance data for the first 4 days of ICU treatment. Balances were obtained from meticulously recorded data on intake and output. Missing extracellular osmotically active sodium (MES) was calculated by subtracting the expected change in plasma sodium from the observed change in plasma sodium derived from balance data. The same method was used to calculate missing chloride (MEC). To address considerable uncertainties on the estimated extracellular volume (ECV) and perspiration rate, various scenarios were used in which the size of the ECV and perspiration were varied.ResultsA total of 38 patients with 152 consecutive ICU days were analyzed. In our default scenario, we could not account for 296 ± 35 mmol of MES in the first four ICU days. The range of observed MES in the five scenarios varied from 111 ± 27 to 566 ± 41 mmol (P < 0.001). A cumulative value of 243 ± 46 mmol was calculated for MEC in the default scenario. The range of cumulative MEC was between 62 ± 27 and 471 ± 56 mmol (P = 0.001 and P = 0.003). MES minus MEC varied from 1 ± 51 to 123 ± 33 mmol in the five scenarios.ConclusionsOur study suggests considerable disappearance of osmotically active sodium in critically ill patients and is the first to also suggest rather similar disappearance of chloride from the extracellular space. Various scenarios for insensible water loss and estimated size for the ECV resulted in considerable MES and MEC, although these estimates showed a large variation. The mechanisms and the tissue compartments responsible for this phenomenon require further investigation.
| S-EPMC6179979 | biostudies-literature
Project description:Patients supported by mechanical ventilation require frequent invasive blood gas samples to monitor and adjust the level of support. We developed a transparent and novel blood gas estimation model to provide continuous monitoring of blood pH and arterial CO2 in between gaps of blood draws, using only readily available noninvasive data sources in ventilated patients. The model was trained on a derivation dataset (1,883 patients, 12,344 samples) from a tertiary pediatric intensive care center, and tested on a validation dataset (286 patients, 4030 samples) from the same center obtained at a later time. The model uses pairwise non-linear interactions between predictors and provides point-estimates of blood gas pH and arterial CO2 along with a range of prediction uncertainty. The model predicted within Clinical Laboratory Improvement Amendments of 1988 (CLIA) acceptable blood gas machine equivalent in 74% of pH samples and 80% of PCO2 samples. Prediction uncertainty from the model improved estimation accuracy by 15% by identifying and abstaining on a minority of high-uncertainty samples. The proposed model estimates blood gas pH and CO2 accurately in a large percentage of samples. The model's abstention recommendation coupled with ranked display of top predictors for each estimation lends itself to real-time monitoring of gaps between blood draws, and the model may help users determine when a new blood draw is required and delay blood draws when not needed.
| S-EPMC9198060 | biostudies-literature
Project description:INTRODUCTION:Multiple studies have shown that diaphragmatic ultrasound can better predict the outcome of weaning in adults. However, there are few studies focusing on children, leading to a lack of sufficient clinical evidence for the application of diaphragmatic ultrasound in children. The purpose of this study was to investigate the predictive value of diaphragm ultrasound for weaning outcomes in critically ill children. METHODS:The study included 50 cases whose mechanical ventilation (MV) time was > 48 h, and all eligibles were divided into either the weaning success group (n = 39) or the weaning failure group (n = 11). Diaphragm thickness, diaphragmatic excursion (DE), and diaphragmatic thickening fraction (DTF) were measured in the zone of apposition. The maximum inspiratory pressure (PImax) was also recorded. RESULTS:The ventilatory treatment time (P = 0.002) and length of PICU stay (P = 0.013) in the weaning failure group was longer than the success group. Cut-off values of diaphragmatic measures associated with successful weaning were ≥ 21% for DTF with a sensitivity of 0.82 and a specificity of 0.81, whereas it was ≥0.86 cm H2O/kg for PImax with a sensitivity of 0.51 and a specificity of 0.82. The linear correlation analysis showed that DTF had a significant positive correlation with PImax in children (P = 0.003). CONCLUSIONS:Diaphragm ultrasound has potential value in predicting the weaning outcome of critically ill children. DTF and PImax presented better performance than other diaphragmatic parameters. However, DE has limited value in predicting weaning outcomes of children with MV. TRIAL REGISTRATION:Current Controlled Trials ChiCTR1800020196, (Dec 2018).
| S-EPMC6937936 | biostudies-literature
Project description:BACKGROUND:A common postoperative complication found among patients who are critically ill is delirium, which has a high mortality rate. A predictive model is needed to identify high-risk patients in order to apply strategies which will prevent and/or reduce adverse outcomes. OBJECTIVES:To identify the incidence of, and the risk factors for, postoperative delirium (POD) in surgical intensive care unit (SICU) patients, and to determine predictive scores for the development of POD. METHODS:This study enrolled adults aged over 18 years who had undergone an operation within the preceding week and who had been admitted to a SICU for a period that was expected to be longer than 24 h. The CAM - ICU score was used to determine the occurrence of delirium. RESULTS:Of the 250 patients enrolled, delirium was found in 61 (24.4%). The independent risk factors for delirium that were identified by a multivariate analysis comprised age, diabetes mellitus, severity of disease (SOFA score), perioperative use of benzodiazepine, and mechanical ventilation. A predictive score (age + (5 × SOFA) + (15 × Benzodiazepine use) + (20 × DM) + (20 × mechanical ventilation) + (20 × modified IQCODE > 3.42)) was created. The area under the receiver operating characteristic (ROC) curve (AUC) was 0.84 (95% CI: 0.786 to 0.897). The cut point of 125 demonstrated a sensitivity of 72.13% and a specificity of 80.95%, and the hospital mortality rate was significantly greater among the delirious than the non-delirious patients (25% vs. 6%, p < 0.01). CONCLUSIONS:POD was experienced postoperatively by a quarter of the surgical patients who were critically ill. A risk score utilizing 6 variables was able to predict which patients would develop POD. The identification of high-risk patients following SICU admission can provide a basis for intervention strategies to improve outcomes. TRIAL REGISTRATION:Thai Clinical Trials Registry TCTR20181204006 . Date registered on December 4, 2018. Retrospectively registered.
| S-EPMC6425578 | biostudies-literature
Project description:Unnecessary antibiotic regimens in the intensive care unit (ICU) are associated with adverse patient outcomes and antimicrobial resistance. Bacterial infections (BI) are both common and deadly in ICUs, and as a result, patients with a suspected BI are routinely started on broad-spectrum antibiotics prior to having confirmatory microbiologic culture results or when an occult BI is suspected, a practice known as empiric antibiotic therapy (EAT). However, EAT guidelines lack consensus and existing methods to quantify patient-level BI risk rely largely on clinical judgement and inaccurate biomarkers or expensive diagnostic tests. As a consequence, patients with low risk of BI often are continued on EAT, exposing them to unnecessary side effects. Augmenting current intuition-based practices with data-driven predictions of BI risk could help inform clinical decisions to shorten the duration of unnecessary EAT and improve patient outcomes. We propose a novel framework to identify ICU patients with low risk of BI as candidates for earlier EAT discontinuation. For this study, patients suspected of having a community-acquired BI were identified in the Medical Information Mart for Intensive Care III (MIMIC-III) dataset and categorized based on microbiologic culture results and EAT duration. Using structured longitudinal data collected up to 24-, 48-, and 72-hours after starting EAT, our best models identified patients at low risk of BI with AUROCs up to 0.8 and negative predictive values >93%. Overall, these results demonstrate the feasibility of forecasting BI risk in a critical care setting using patient features found in the electronic health record and call for more extensive research in this promising, yet relatively understudied, area.
| S-EPMC7530142 | biostudies-literature