Dataset Information

Confounding adjustment performance of ordinal analysis methods in stroke studies.

ABSTRACT: BACKGROUND:In stroke studies, ordinal logistic regression (OLR) is often used to analyze outcome on the modified Rankin Scale (mRS), whereas the non-parametric Mann-Whitney measure of superiority (MWS) has also been suggested. It is unclear how these perform comparatively when confounding adjustment is warranted. AIMS:Our aim is to quantify the performance of OLR and MWS in different confounding variable settings. METHODS:We set up a simulation study with three different scenarios; (1) dichotomous confounding variables, (2) continuous confounding variables, and (3) confounding variable settings mimicking a study on functional outcome after stroke. We compared adjusted ordinal logistic regression (aOLR) and stratified Mann-Whitney measure of superiority (sMWS), and also used propensity scores to stratify the MWS (psMWS). For comparability, OLR estimates were transformed to a MWS. We report bias, the percentage of runs that produced a point estimate deviating by more than 0.05 points (point estimate variation), and the coverage probability. RESULTS:In scenario 1, there was no bias in both sMWS and aOLR, with similar point estimate variation and coverage probabilities. In scenario 2, sMWS resulted in more bias (0.04 versus 0.00), and higher point estimate variation (41.6% versus 3.3%), whereas coverage probabilities were similar. In scenario 3, there was no bias in both methods, point estimate variation was higher in the sMWS (6.7%) versus aOLR (1.1%), and coverage probabilities were 0.98 (sMWS) versus 0.95 (aOLR). With psMWS, bias remained 0.00, with less point estimate variation (1.5%) and a coverage probability of 0.95. CONCLUSIONS:The bias of both adjustment methods was similar in our stroke simulation scenario, and the higher point estimate variation in the MWS improved with propensity score based stratification. The stratified MWS is a valid alternative for adjusted OLR only when the ratio of number of strata versus number of observations is relatively low, but propensity score based stratification extends the application range of the MWS.

SUBMITTER: Zonneveld TP

PROVIDER: S-EPMC7162480 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Confounding adjustment performance of ordinal analysis methods in stroke studies.

Zonneveld Thomas P TP Aigner Annette A Groenwold Rolf H H RHH Algra Ale A Nederkoorn Paul J PJ Grittner Ulrike U Kruyt Nyika D ND Siegerink Bob B

PloS one 20200416 4

<h4>Background</h4>In stroke studies, ordinal logistic regression (OLR) is often used to analyze outcome on the modified Rankin Scale (mRS), whereas the non-parametric Mann-Whitney measure of superiority (MWS) has also been suggested. It is unclear how these perform comparatively when confounding adjustment is warranted.<h4>Aims</h4>Our aim is to quantify the performance of OLR and MWS in different confounding variable settings.<h4>Methods</h4>We set up a simulation study with three different sc ...[more]

PMID: 32298347

Similar Datasets

Project description:ObjectivesTo adjust for confounding in observational data, researchers use propensity score matching (PSM), but more advanced methods might be required when dealing with longitudinal data and time-varying treatments as PSM might not include possible changes that occurred over time. This study aims to explore which confounding adjustment methods have been used in longitudinal observational data to estimate a treatment effect and identify potential inappropriate use of PSM.DesignMapping review.Data sourcesWe searched PubMed, from inception up to January 2021, for studies in which a treatment was evaluated using longitudinal observational data.Eligibility criteriaMethodological, non-medical and cost-effectiveness papers were excluded, as were non-English studies and studies that did not study a treatment effect.Data extraction and synthesisStudies were categorised based on time of treatment: at baseline (interventions performed at start of follow-up) or time-varying (interventions received asynchronously during follow-up) and sorted based on publication year, time of treatment and confounding adjustment method. Cumulative time series plots were used to investigate the use of different methods over time. No risk-of-bias assessment was performed as it was not applicable.ResultsIn total, 764 studies were included that met the eligibility criteria. PSM (165/201, 82%) and inverse probability weighting (IPW; 154/502, 31%) were most common for studies with a treatment at baseline (n=201) and time-varying treatment (n=502), respectively. Of the 502 studies with a time-varying treatment, 123 (25%) used PSM with baseline covariates, which might be inappropriate. In the past 5 years, the proportion of studies with a time-varying treatment that used PSM over IPW increased.ConclusionsPSM is the most frequently used method to correct for confounding in longitudinal observational data. In studies with a time-varying treatment, PSM was potentially inappropriately used in 25% of studies. Confounding adjustment methods designed to deal with a time-varying treatment and time-varying confounding are available, but were only used in 45% of the studies with a time-varying treatment.

Dataset Information

Confounding adjustment performance of ordinal analysis methods in stroke studies.

Publications

Confounding adjustment performance of ordinal analysis methods in stroke studies.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets