Assessing baseline dependency of anchor-based minimal important change (MIC): don't stratify on the baseline score!
Ontology highlight
ABSTRACT: Purpose
The minimal important change (MIC) of a patient-reported outcome measure (PROM) is often suspected to be baseline dependent, typically in the sense that patients who are in a poorer baseline health condition need greater improvement to qualify as minimally important. Testing MIC baseline dependency is commonly performed by creating two or more subgroups, stratified on the baseline PROM score. This study's purpose was to show that this practice produces biased subgroup MIC estimates resulting in spurious MIC baseline dependency, and to develop alternative methods to evaluate MIC baseline dependency.Methods
Datasets with PROM baseline and follow-up scores and transition ratings were simulated with and without MIC baseline dependency. Mean change MICs, ROC-based MICs, predictive MICs, and adjusted MICs were estimated before and after stratification on the baseline score. Three alternative methods were developed and evaluated. The methods were applied in a real data example for illustration.Results
Baseline stratification resulted in biased subgroup MIC estimates and the false impression of MIC baseline dependency, due to redistribution of measurement error. Two of the alternative methods require a second baseline measurement with the same PROM or another correlated PROM. The third method involves the construction of two parallel tests based on splitting the PROM's item set. Two methods could be applied to the real data.Conclusion
MIC baseline dependency should not be tested in subgroups based on stratification on the baseline PROM score. Instead, one or more of the suggested alternative methods should be used.
SUBMITTER: Terluin B
PROVIDER: S-EPMC8481187 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:We define the minimal important change (MIC) as a threshold for a minimal within-person change over time above which patients perceive themselves importantly changed. There is a lot of confusion about the concept of MIC, particularly about the concepts of minimal important change and minimal detectable change, which questions the validity of published MIC values. The aims of this study were: (1) to clarify the concept of MIC and how to use it; (2) to provide practical guidance for estimating methodologically sound MIC values; and (3) to improve the applicability of PROMIS by summarizing the available evidence on plausible PROMIS MIC values. We discuss the concept of MIC and how to use it and provide practical guidance for estimating MIC values. In addition, we performed a systematic review in PubMed on MIC values of any PROMIS measure from studies using recommended approaches. A total of 50 studies estimated the MIC of a PROMIS measure, of which 19 studies used less appropriate methods. MIC values of the remaining 31 studies ranged from 0.1 to 12.7 T-score points. We recommend to use the predictive modeling method, possibly supplemented with the vignette-based method, in future MIC studies. We consider a MIC value of 2-6 T-score points for PROMIS measures reasonable to assume at this point. For surgical interventions a higher MIC value might be appropriate. We recommend more high-quality studies estimating MIC values for PROMIS.
| S-EPMC8481206 | biostudies-literature
Project description:The Minimal Clinically Important Difference (MCID) assesses what change on a measurement tool can be considered minimal clinically relevant. Although the recall period can influence questionnaire scores, it is unclear if it influences the MCID. This study is the first to examine longitudinally the impact of the recall period of an anchor question and its design on the MCID of COPD health status tools using the COPD Assessment Test (CAT), Clinical COPD Questionnaire (CCQ) and the St. George's Respiratory Questionnaire (SGRQ).Moderate to very severe COPD patients without respiratory co-morbidities were recruited during 3-week Pulmonary Rehabilitation (PR). CAT, CCQ and SGRQ were completed at baseline, discharge, 3, 6, 9 and 12 months. A 15-point Global Rating of Change scale (GRC) was completed at each follow-up. A five-point GRC was used as second anchor at 12 months. Mean change scores of a subset of patients indicating a minimal improvement on each of the anchor questions were considered the MCID. The MCID estimates over different time periods were compared with one another by evaluating the degree of overlap of Confidence Intervals (CI) adjusted for dependency.In total 451 patients were included (57.9?±?6.6 years, 65% male, 50/39/11% GOLD II/III/IV), of which 309 completed follow-up. Baseline health status scores were 20.2?±?7.3 (CAT), 2.9?±?1.2 (CCQ) and 50.7?±?17.3 (SGRQ). MCID estimates for improvement ranged -?3.1 to -?1.4 for CAT, -?0.6 to -?0.3 for CCQ, and?-?10.3 to -?7.6 for SGRQ. Absolute higher - though not significant - MCIDs were observed for CAT and CCQ directly after PR. Significantly absolute lower MCID estimates were observed for CAT (difference?-?1.4: CI -2.3 to -?0.5) and CCQ (difference?-?0.2: CI -0.3 to -0.1) using a five-point GRC.The recall period of a 15-point anchor question seemed to have limited impact on the MCID for improvement of CAT, CCQ and SGRQ during PR; although a 3-week MCID estimate directly after PR might lead to absolute higher values. However, the design of the anchor question was likely to influence the MCID of CAT and CCQ.RIMTCORE trial # DRKS00004609 and #12107 (Ethik-Kommission der Bayerischen Landesärztekammer).
| S-EPMC6019834 | biostudies-other
Project description:Spontaneous miscarriage is one of the most common complications of pregnancy. Even though some risk factors are well documented, there is a paucity of risk scoring tools during preconception. In the S-PRESTO cohort study, Asian women attempting to conceive, aged 18-45 years, were recruited. Multivariable logistic regression model coefficients were used to determine risk estimates for age, ethnicity, history of pregnancy loss, body mass index, smoking status, alcohol intake and dietary supplement intake; from these we derived a risk score ranging from 0 to 17. Miscarriage before 16 weeks of gestation, determined clinically or via ultrasound. Among 465 included women, 59 had miscarriages and 406 had pregnancy ≥ 16 weeks of gestation. Higher rates of miscarriage were observed at higher risk scores (5.3% at score ≤ 3, 17.0% at score 4-6, 40.0% at score 7-8 and 46.2% at score ≥ 9). Women with scores ≤ 3 were defined as low-risk level (< 10% miscarriage); scores 4-6 as intermediate-risk level (10% to < 40% miscarriage); scores ≥ 7 as high-risk level (≥ 40% miscarriage). The risk score yielded an area under the receiver-operating-characteristic curve of 0.74 (95% confidence interval 0.67, 0.81; p < 0.001). This novel scoring tool allows women to self-evaluate their miscarriage risk level, which facilitates lifestyle changes to optimize modifiable risk factors in the preconception period and reduces risk of spontaneous miscarriage.
| S-EPMC8187346 | biostudies-literature
Project description:To evaluate the internal consistency, validity, responsiveness, and minimal important difference of the Functional Status Score for the ICU, a physical function measure designed for the ICU.Clinimetric analysis.Five international datasets from the United States, Australia, and Brazil.Eight hundred nineteen ICU patients.None.Clinimetric analyses were initially conducted separately for each data source and time point to examine generalizability of findings, with pooled analyses performed thereafter to increase power of analyses. The Functional Status Score for the ICU demonstrated good to excellent internal consistency. There was good convergent and discriminant validity, with significant and positive correlations (r = 0.30-0.95) between Functional Status Score for the ICU and other physical function measures, and generally weaker correlations with nonphysical measures (|r| = 0.01-0.70). Known group validity was demonstrated by significantly higher Functional Status Score for the ICU scores among patients without ICU-acquired weakness (Medical Research Council sum score, ? 48 vs < 48) and with hospital discharge to home (vs healthcare facility). Functional Status Score for the ICU at ICU discharge predicted post-ICU hospital length of stay and discharge location. Responsiveness was supported via increased Functional Status Score for the ICU scores with improvements in muscle strength. Distribution-based methods indicated a minimal important difference of 2.0-5.0.The Functional Status Score for the ICU has good internal consistency and is a valid and responsive measure of physical function for ICU patients. The estimated minimal important difference can be used in sample size calculations and in interpreting studies comparing the physical function of groups of ICU patients.
| S-EPMC5292321 | biostudies-literature
Project description:BackgroundThe 6-minute walk test (6MWT) is a commonly used metric for measuring change in mobility after knee arthroplasty, however, what is considered an improvement after surgery has not been defined. The determination of important change in an outcome assessment tool is controversial and may require more than one approach. This study, nested within a combined randomised and observational trial, aimed to define a minimal important improvement threshold for the 6MWT in a knee arthroplasty cohort through a triangulation of methods including patient-perceived anchor-based thresholds and distribution-based thresholds.MethodsIndividuals with osteoarthritis performed a 6MWT pre-arthroplasty then at 10 and 26 weeks post-surgery. Each rated their perceived improvement in mobility post-surgery on a 7-point transition scale anchored from "much better" to "much worse". Based on these responses the cohort was dichotomised into 'improved' and 'not improved'. The thresholds for patient-perceived improvements were then identified using two receiver operating curve methods producing sensitivity and specificity indices. Distribution-based change thresholds were determined using two methods utilising effect size (ES). Agreement between the anchor- and distribution-based methods was assessed using kappa.ResultsOne hundred fifty-eight from 166 participants in the randomised cohort and 222 from 243 in the combined randomised and observational cohort were included at 10 and 26 weeks, respectively. The slightly or more patient-perceived improvement threshold at 26 weeks (an absolute improvement of 26 m) was the only one to demonstrate sensitivity and specificity results both better than chance. At 10- and 26-weeks, the ES based on the mean change score divided by the baseline standard deviation (SD), was an absolute change of 24.5 and 37.9 m, respectively. The threshold based on a moderate ES (a 0.5 SD of the baseline score) was a change of 55.0 and 55.4 m at 10- and 26-weeks, respectively. The level of agreement between the 26-week anchor-based and distribution-based minimal absolute changes was very good (k = 0.88 (95 % CI 0.81 0.95)).ConclusionA valid threshold of improvement for the 6MWT can only be proposed for changes identified from baseline to 26 weeks post-surgery. The level of agreement between anchor- and distribution-based methods indicates that a true minimal or more threshold of meaningful improvement following surgery is likely within the ranges proposed by the triangulation of all four methods, that is, 26 to 55 m.
| S-EPMC5022203 | biostudies-literature
Project description:Glycosylphosphatidylinositol-anchored proteins (GPI-APs) play various roles in cell-cell and cell-environment interactions. GPI is synthesized in the endoplasmic reticulum (ER) from phosphatidylinositol (PI) through step-wise reactions including transfers of monosaccharides and preassembled GPI is transferred en bloc to proteins. Cellular PI contains mostly diacyl glycerol and unsaturated fatty acid in the sn-2 position, whereas mammalian GPI-APs have mainly 1-alkyl-2-acyl PI and almost exclusively stearic acid, a saturated chain, at the sn-2 position. The latter characteristic is the result of fatty acid remodeling occurring in the Golgi, generating GPI-anchors compatible with raft membrane. The former characteristic is the result of diacyl to alkyl-acyl change occurring in the third GPI intermediate, glucosaminyl-inositolacylated-PI (GlcN-acyl-PI). Here we investigated the origin of the sn-1 alkyl-chain in GPI-APs. Using cell lines defective in the peroxisomal alkyl-phospholipid biosynthetic pathway, we demonstrated that generation of alkyl-containing GPI is dependent upon the peroxisomal pathway. We further demonstrated that in cells defective in the peroxisome pathway, the chain composition of the diacyl glycerol moiety in GlcN-acyl-PI is different from those in the first intermediate N-acetylglucosaminyl-PI and cellular PI, indicating that not only diacyl to alkyl-acyl change but also diacyl to diacyl change occurs in GlcN-acyl-PI. We therefore propose a biosynthetic step within GlcN-acyl-PI in which the diacyl glycerol (or diacyl phosphatidic acid) part is replaced by diradyl glycerol (or diradyl phosphatidic acid). These results highlight cooperation of three organelles, the ER, the Golgi, and the peroxisome, in the generation of the lipid portion of GPI-APs.
| S-EPMC2764918 | biostudies-literature
Project description:The minimal important difference (MID) is essential for interpreting the results of randomised controlled trials (RCTs). Despite a number of RCTs in patients with malignant pleural effusions (MPEs) which use the visual analogue scale for dyspnea (VASD) as an outcome measure, the MID has not been established.Patients with suspected MPE undergoing a pleural procedure recorded their baseline VASD and their post-procedure VASD (24 hours after the pleural drainage), and in parallel assessed their breathlessness on a 7 point Likert scale.The mean decrease in VASD in patients with a MPE reporting a 'small but just worthwhile decrease' in their dyspnea (i.e. equivalent to the MID) was 19mm (95% CI 14-24mm). The mean drainage volume required to produce a change in VASD of 19mm was 760ml.The mean MID for the VASD in patients with a MPE undergoing a pleural procedure is 19mm (95% CI 14-24mm). Thus choosing an improvement of 19mm in the VASD would be justifiable in the design and analysis of future MPE studies.
| S-EPMC4398419 | biostudies-literature
Project description:BackgroundCisplatin is a popular antineoplastic agent used to treat cervical cancer in women from low and middle-income countries. Cisplatin treatment is associated with ototoxicity, often resulting in hearing loss. In light of this, it is crucial to conduct baseline audiological assessments prior to treatment initiation in order to evaluate the extent of cisplatin-associated-ototoxicity. Additionally, the identification of inherent risk factors and hearing patterns in specific patient cohorts is needed, especially in South Africa, a middle-income country characterized by the quadruple burden of disease (Human Immunodeficiency Virus (HIV), Tuberculosis (TB), Diabetes and Hypertension).MethodsThis study aimed to describe a profile of risk factors and hearing in a cohort of females with cervical cancer before cisplatin treatment commenced. A descriptive study design that included 82 cervical cancer patients, who underwent audiological evaluation prescribed for ototoxicity monitoring was conducted.ResultsAll participants (n = 82) presented with risk factors (diabetes, hypertension, HIV, and antiretroviral therapy) for cisplatin ototoxicity and/or pre-existing sensorineural hearing loss. High-frequency tinnitus was the most common otological symptom experienced by 25 (31%) participants. Fifty-nine (72%) participants presented with normal hearing, twenty-two (27%) with a sensorineural hearing loss, and 36% were diagnosed with mild hearing loss. Abnormal Distortion Product Otoacoustic Emissions (DPOAE) findings were obtained bilaterally in two participants (2.4%), in the right ear only of another two (2.4%) participants and the left ear of three participants (3.7%). Most participants (94%) had excellent word recognition scores, demonstrating an excellent ability to recognize words within normal conversational levels under optimal listening conditions. Age was significantly associated with hearing loss at all thresholds. Among the co-morbidities, an HIV positive status significantly triggered hearing loss, especially at higher frequencies.ConclusionThis study demonstrated that South African females with cervical cancer present with various co-morbidities, which may predispose them to develop cisplatin-associated -ototoxic hearing loss. Identification of these co-morbidities and hearing loss is essential for the accurate monitoring of cisplatin toxicities. Appropriate management of these patients is pivotal to reduce the adverse effects that hearing impairment can have on an individual's quality of life and to facilitate informed decision-making regarding the commencement of cisplatin chemotherapy.
| S-EPMC8056627 | biostudies-literature
Project description:Dr. Athina Markou sought treatments for a common neural substrate shared by depression and drug dependence. Antagonists of corticotropin-releasing factor (CRF) receptors, a target of interest to her, have not reached the clinic despite strong preclinical rationale and sustained translational efforts.We explore potential causes for the failure of CRF1 antagonists and review recent findings concerning CRF-CRF1 systems in psychopathology.Potential causes for negative outcomes include (1) poor safety and efficacy of initial drug candidates due to bad pharmacokinetic and physicochemical properties, (2) specificity problems with preclinical screens, (3) the acute nature of screens vs. late-presenting patients, (4) positive preclinical results limited to certain models and conditions with dynamic CRF-CRF1 activation not homologous to tested patients, (5) repeated CRF1 activation-induced plasticity that reduces the importance of ongoing CRF1 agonist stimulation, and (6) therapeutic silencing which may need to address CRF2 receptor or CRF-binding protein molecules, constitutive CRF1 activity, or molecules that influence agonist-independent activity or to target structural regions other than the allosteric site bound by all drug candidates. We describe potential markers of activation towards individualized treatment, human genetic, and functional data that still implicate CRF1 systems in emotional disturbance, sex differences, and suggestive clinical findings for CRF1 antagonists in food craving and CRF-driven HPA-axis overactivation.The therapeutic scope of selective CRF1 antagonists now appears narrower than had been hoped. Yet, much remains to be learned about CRF's role in the neurobiology of dysphoria and addiction and the potential for novel anti-CRF therapies therein.
| S-EPMC5420464 | biostudies-literature
Project description:OBJECTIVE:This article reviews and compares four commonly used approaches to assess patient responsiveness with a treatment or therapy (return to normal (RTN), minimal important difference (MID), minimal clinically important improvement (MCII), OMERACT-OARSI [Outcome Measures in Rheumatology-Osteoarthris Reseach Society International] (OO)) and demonstrates how each of the methods can be formulated in a multilevel modelling (MLM) framework. DESIGN:Cohort study. SETTING:A cohort of patients undergoing total hip and knee replacement were recruited from a single UK National Health Service hospital. POPULATION:400 patients from the Arthroplasty Pain Experience cohort study undergoing total hip (n=210) and knee (n=190) replacement who completed the Intermittent and Constant Osteoarthritis Pain questionnaire prior to surgery and then at 3, 6 and 12 months after surgery. PRIMARY OUTCOMES:The primary outcome was defined as a response to treatment following total hip or knee replacement. We compared baseline scores, change scores and proportion of individuals defined as 'responders' using traditional and MLM approaches with patient responsiveness. RESULTS:Using existing approaches, baseline and change scores are underestimated, and the variance of baseline and change scores overestimated in comparison with MLM approaches. MLM increases the proportion of individuals defined as responding in RTN, MID and OO criteria compared with existing approaches. Using MLM with the MCII criteria reduces the number of individuals identified as responders. CONCLUSION:MLM improves the estimation of the SD of baseline and change scores by explicitly incorporating measurement error into the model and avoiding regression to the mean when making individual predictions. Using refined definitions of responsiveness may lead to a reduction in misclassification when attempting to predict who does and does not respond to an intervention and clarifies the similarities between existing methods.
| S-EPMC5577889 | biostudies-other