The Meaning and Reliability of Minimal Important Differences (MIDs) for Clinician-Reported Outcome Measures (ClinROMs) in Dermatology—A Scoping Review
Ontology highlight
ABSTRACT:
SUBMITTER: Speeckaert R
PROVIDER: S-EPMC9321211 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BACKGROUND:The Roland Morris Disability Questionnaire (RMDQ), visual analog scale (VAS) of pain intensity, and numerical rating scale (NRS) are among the most commonly used outcome measures in trials of interventions for low back pain. Their use in paper form is well established. Few data are available on the metric properties of electronic counterparts. OBJECTIVE:The goal of our research was to establish responsiveness, minimally important change (MIC) thresholds, reliability, and minimal detectable change at a 95% level (MDC95) for electronic versions of the RMDQ, VAS, and NRS as delivered via iOS and Android apps and Web browser. METHODS:We recruited adults with low back pain who visited osteopaths. We invited participants to complete the eRMDQ, eVAS, and eNRS at baseline, 1 week, and 6 weeks along with a health transition question at 1 and 6 weeks. Data from participants reporting recovery were used in MIC and responsiveness analyses using receiver operator characteristic (ROC) curves and areas under the ROC curves (AUCs). Data from participants reporting stability were used for analyses of reliability (intraclass correlation coefficient [ICC] agreement) and MDC95. RESULTS:We included 442 participants. At 1 and 6 weeks, ROC AUCs were 0.69 (95% CI 0.59 to 0.80) and 0.67 (95% CI 0.46 to 0.87) for the eRMDQ, 0.69 (95% CI 0.58 to 0.80) and 0.74 (95% CI 0.53 to 0.95) for the eVAS, and 0.73 (95% CI 0.66 to 0.80) and 0.81 (95% CI 0.69 to 0.92) for the eNRS, respectively. Associated MIC thresholds were estimated as 1 (0 to 2) and 2 (-1 to 5), 13 (9 to 17) and 7 (-12 to 26), and 2 (1 to 3) and 1 (0 to 2) points, respectively. Over a 1-week period in participants categorized as "stable" and "about the same" using the transition question, ICCs were 0.87 (95% CI 0.66 to 0.95) and 0.84 (95% CI 0.73 to 0.91) for the eRMDQ with MDC95 of 4 and 5, 0.31 (95% CI -0.25 to 0.71) and 0.61 (95% CI 0.36 to 0.77) for the eVAS with MDC95 of 39 and 34, and 0.52 (95% CI 0.14 to 0.77) to 0.67 (95% CI 0.51 to 0.78) with MDC95 of 4 and 3 for the eNRS. CONCLUSIONS:The eRMDQ was reliable with borderline adequate responsiveness. The eNRS was responsive with borderline reliability. While the eVAS had adequate responsiveness, it did not have an attractive reliability profile. Thus, the eNRS might be preferred over the eVAS for measuring pain intensity. The observed electronic outcome measures' metric properties are within the ranges of values reported in the literature for their paper counterparts and are adequate for measuring changes in a low back pain population.
| S-EPMC6231814 | biostudies-other
Project description:ImportancePatient-reported outcome measures (PROMs) allow clinicians and researchers to assess health-related information from a patient's perspective. These measures have been used more frequently over the last several decades, but an associated minimal clinically important difference (MCID) is needed to optimize their utility. This narrative review identified the top 100 most-cited otolaryngology-related PROM development and validation publications and assessed the presence and characteristics of the PROMs' associated MCID.ObservationsIn this narrative review, a literature search in Scopus and Web of Science was conducted on June 29, 2022, using keywords related to PROM development and validation studies in otolaryngology and reference lists. Studies that met the definition of a PROM and assessed an otolaryngologic disorder or study population were included for full-text review. After full-text review of 188 articles, the top 100 most-cited PROM development and validation publications, resulting in 106 total PROMs, were chosen for review. A total of 39 (37%) of the identified PROMs had an associated MCID. Of those reporting an MCID, 14 (35.9%) used an anchor-based method, 12 (30.8%) used a distribution-based method, 10 (25.6%) used both, and 3 (7.7%) did not specify or used neither method. Rhinology had the greatest number of PROMs with an associated MCID (16 of 24, 66%), and pediatrics had the fewest (1 of 13, 7.7%). The median number of citations of PROMs with an MCID was higher than those without an MCID.Conclusions and relevanceThe majority of the most-cited PROMs in otolaryngology lack an associated MCID. These data indicated that there are a multitude of PROMs that have been cited hundreds of times and used for decades without the ability to identify whether a particular change in score on the instrument is clinically meaningful. There is a need to determine and validate MCIDs for commonly used PROMs to aid clinical research and trial interpretation.
| S-EPMC10729312 | biostudies-literature
Project description:BackgroundCough and sputum are highly prevalent in patients with chronic obstructive pulmonary disease (COPD). Pulmonary rehabilitation (PR) has shown to be effective in managing these symptoms. However, the interpretation of the magnitude of PR effects is hindered by the lack of minimal clinically important differences (MCIDs).PurposeThis study established MCIDs for the Leicester cough questionnaire (LCQ) and the cough and sputum assessment questionnaire (CASA-Q), in patients with COPD after PR.Patients and methodsAn observational prospective study was conducted in patients with COPD who participated in a 12-weeks community-based PR program. Anchor- (mean change, receiver operating characteristic curves and linear regression analysis) and distribution-based methods [0.5*standard deviation; standard error of measurement (SEM); 1.96*SEM; minimal detectable change and effect size] were used to compute the MCIDs. The anchors used were: i) patients and physiotherapists global rating of change scale, ii) COPD assessment test, iii) St. George's respiratory questionnaire and iv) occurrence of an exacerbation during PR. Pooled MCIDs were computed using the arithmetic weighted mean (2/3 for anchor- and 1/3 for distribution-based methods).ResultsForty-nine patients with COPD (81.6% male, 69.8±7.4years, FEV150.4±19.4%predicted) were used in the analysis. The pooled MCIDs were 1.3 for LCQ and for CASA-Q domains were: 10.6 - cough symptoms; 10.1 - cough impact; 9.5 - sputum symptoms and 7.8 - sputum impact.ConclusionThe MCIDs found in this study are potential estimates to interpret PR effects on cough and sputum, and may contribute to guide interventions.
| S-EPMC6996113 | biostudies-literature
Project description:BACKGROUND:Retinoblastoma is a childhood retinal cancer with lifelong consequences such as vision loss and increased risk of second cancer. Patient-reported outcome measures (PROMs) are instruments that measure outcomes related to health directly reported by patients. The purpose of this study was to determine the scope, characteristics and quality of PROMs used in retinoblastoma and related fields of pediatric ophthalmology and pediatric oncology. METHODS:Databases MEDLINE and Embase were searched for studies in the English language that reported on PROMs used in retinoblastoma, pediatric oncology, or pediatric ophthalmology; grey literature and studies reporting on developmental PROM phases were excluded. PROMs were grouped by the construct measured and domains assessed, and classified as condition-specific or generic. A subsequent search was then conducted in MEDLINE and Embase for studies assessing measurement properties of the identified PROMs. PROMs with associated studies were assessed for their methodologic quality using the COnsensus-based standard for the Selection of health Measurement INstruments (COSMIN) strategy. RESULTS:Among 110 eligible studies uncovered by the database searches, 143 PROMs were identified: one retinoblastoma-specific, 56 ophthalmology- and 86 oncology-related. The most common construct measured was 'health-related quality of life' and the most common domain assessed was emotional well-being. Of the 143 PROMs, 100 had associated validation studies; the one retinoblastoma-specific PROM was not validated. Quality assessment revealed 34/100 PROMs received a score of sufficient quality in both subcategories of 'overall content validity'; 3/100 received a score of sufficient quality in both subcategories of 'internal structure'; 0/100 received a score of sufficient quality in all three subcategories of 'remaining measurement properties'. The Patient-Reported Outcome Measure Information System (PROMIS) Pediatric Profile-25 was the highest-scoring PROM identified, meeting COSMIN standards for 2/3 measurement property categories (and 5/7 subcategories). Eleven additional PROMs were identified which had sufficient scores in 1/3 measurement property categories (and 5/7 subcategories). CONCLUSION:The study identified several PROMs from the pediatric ophthalmology and pediatric oncology literature that could be relevant to the retinoblastoma population, but many have limits to their validation. Future development of a retinoblastoma-specific PROM, performed in partnership with retinoblastoma patients to support optimal content validity, could first focus on the selection and definition of the optimal construct to measure, followed potentially by adaptation and further validation of the relevant PROMs with strong methodologic quality identified in this study.
| S-EPMC7415058 | biostudies-literature
Project description:Within current literature and practice, the category of patient-reported outcome (PRO) measures has been expanded into the broader category of clinical outcome assessments (COAs), which includes the subcategory of PRO, as well as clinician-reported outcome (ClinRO), observer-reported outcome (ObsRO), and performance outcome (PerfO) measure subcategories. However, despite this conceptual expansion, recommendations associated with translation, cultural adaptation, and linguistic validation of COAs remain focused on PRO measures, which has created a gap in specific process recommendations for the remaining types. This lack of recommendations has led to inconsistent approaches being implemented, leading to uncertainty in the scientific community regarding suitable methods. To address this gap, the ISOQOL Translation and Cultural Adaptation Special Interest Group (TCA-SIG) has developed recommendations specific to each of the three COA types currently lacking such documentation to support a standardized approach to their translation, cultural adaptation, and linguistic validation. The recommended process utilized to translate ObsRO, ClinRO and PerfO measures from one language to another aligns closely with the industry standard process for PRO measures. The substantial differences between respondent categories across COA types require targeted approaches to the cognitive interviewing procedures utilized within the linguistic validation process, including the use of patients for patient-facing text in ClinRO measures, and the need to interview the targeted observers for ObsROs measures.
| S-EPMC7642163 | biostudies-literature
Project description:BackgroundMost antithrombotic medication users are older adults. Patient-reported outcome measures are commonly used in clinical research on antithrombotic medication, such as the diagnosis of intracranial hemorrhage.ObjectivesTo determine the reliability of patient-reported intracranial hemorrhage, anticoagulant and platelet aggregation inhibitor use in the older adult population.Patients/methodsWe conducted a secondary analysis of a prospective, observational cohort study of older adults who presented to the emergency department with a fall. The primary outcome was diagnosis of intracranial bleeding. We compared patient-reported intracranial bleeding to structured chart review with adjudication. We also compared patient-reported use of antiplatelet and anticoagulant medication to physician-reported medication use supplemented with structured chart review. We calculated the diagnostic accuracy of the patient-reported outcomes using our comparators as the reference standard.ResultsExact agreement for patient-reported intracranial bleeds was 95%, with a Cohen's kappa of 0.30 (95% confidence interval [CI], 0.15-0.45). The sensitivity was 36.7% (95% CI, 20.6%-56.1%) and specificity 97.2% (95% CI, 95.8%-98.1%). For anticoagulant medication use, exact agreement was 87%, Cohen's kappa 0.66 (95% CI, 0.63-0.72), sensitivity 84.0% (95% CI, 79.3%-83.8%), and specificity 87.6% (95% CI, 85.1%-89.7%). For antiplatelet medication use, exact agreement was 77%, Cohen's kappa 0.50 (95% CI, 0.44-0.55), sensitivity 68.7% (95% CI, 64.0%-73.1%), and specificity 81.2% (95% CI, 78.0-83.8%).ConclusionsPatient-reported outcome and exposure data were unreliable in this study. Our findings have a bearing on future research study design.
| S-EPMC8117814 | biostudies-literature
Project description:BackgroundPatient reported outcome measures (PROMs) and minimal clinically important differences (MCIDs) are included in Canada's Common Drug Review (CDR) process to approve new drugs. Often, the measures report on the health-related quality of life (HRQoL), but can also describe the symptoms, efficacy and harms important to patients. They can be generic or population/condition specific, validated or not. We examined the frequency, availability and accessibility of validated, specific PROMs and MCIDs reported in the CDR reports.MethodsWe searched the Canadian Agency for Drugs and Technologies in Health (CADTH) on-line database for completed Common Drug Review, Clinical Review Reports (CDR-CRR) between November 2013 and February 2017. Two independent reviewers examined the reports and references for PROMs and MCIDs. Both reviewers separately categorized the PROMs and MICDs according to purpose, validation, availability and funding received. Discrepancies were rectified by consensus with a third investigator.ResultsOne-hundred and five unique PROMs were extracted from 39 CDR-CRR, 57% with a HRQoL component. 91/105 (87%) referenced a validation study and 62/105 (59%) referenced a validation study in the study population of interest. Fifty-seven MCID references were extracted from 39 CDR-CRR. 34/57 (60%) were specific to the study population of interest, and 36% had a HRQoL component. 50% of PROM and 53% of MCID references were publicly available.ConclusionsPROMs and MCIDs referenced in CDR-CRR show similar trends. The majority are validated, but not necessarily in the study population of interest. Continued critical examination is required to evaluate new drugs specific to the population of interest.
| S-EPMC6322322 | biostudies-literature
Project description:BackgroundMinimal important difference (MID) is a concept used inconsistently and arbitrarily in tendinopathy research. Our aim was to determine the MIDs for the most commonly used tendinopathy outcome measures using data-driven approaches.MethodsRecently published systematic reviews of randomised controlled trials (RCTs) on tendinopathy management were identified and used for extraction of eligible studies through a literature search. Each eligible RCT was used to obtain information on MID where this was used and it also contributed data for the calculation of the baseline pooled standard deviation (SD) for each tendinopathy (shoulder, lateral elbow, patellar and Achilles). The rule of "half SD" was used for the computation of MIDs for patient-reported pain (visual analogue scale, VAS 0-10, single-item questionnaire) and function (multi-item questionnaires) and the rule of "one standard error of measurement (SEM)" was additionally used for the multi-item functional outcome measures.ResultsA total of 119 RCTs were included for the 4 tendinopathies. MID was defined and used by 58 studies (49%) and there were significant inconsistencies amongst studies where the same outcome measure was used as MID. From our data-driven methods the following suggested MIDs were obtained: a) Shoulder tendinopathy, pain VAS (combined) 1.3 points, Constant-Murley score 6.9 (half SD) and 7.0 (one SEM) points; b) lateral elbow tendinopathy, pain VAS (combined) 1.0 point, Disabilities of Arm, Shoulder and Hand questionnaire 8.9 (half SD) and 4.1 (one SEM) points; c) Patellar tendinopathy, pain VAS (combined) 1.2 points, Victorian Institute of Sport Assessment - Patella (VISA-P) 7.3 (half SD) and 6.6 points (one SEM); d) Achilles tendinopathy, pain VAS (combined) 1.1 points, VISA-Achilles (VISA-A) 8.2 (half SD) and 7.8 points (one SEM). The rules of half SD and one SEM produced very similar MIDs except for DASH due to its very high internal consistency. MIDs were also calculated for different pain settings for each tendinopathy.ConclusionsOur computed MIDs can be used in tendinopathy research to increase consistency. Clearly defined MIDs should be used with consistency in tendinopathy management studies in the future.
| S-EPMC9979571 | biostudies-literature
Project description:BACKGROUND:Eyebrow and eyelash hair loss and nail damage-in addition to scalp hair loss-are important signs/symptoms of alopecia areata (AA) to patients and deserve assessment in AA clinical trials. OBJECTIVES:Our objective was to develop clinician-reported outcome (ClinRO) and patient-reported outcome (PRO) measures and accompanying photoguides to aid in the assessment of AA-related eyebrow, eyelash and nail signs/symptoms. METHODS:Iterative rounds of qualitative, semi-structured interviews were conducted with US expert dermatologists and North American patients with AA. Patients with eyebrow, eyelash and nail involvement were purposefully sampled. Interview transcripts were qualitatively analyzed. RESULTS:Dermatologists (n?=?10) described eyebrow and eyelash loss as concerning for affected patients and, along with nail appearance, as deserving assessment. Dermatologist data informed the development of single item, 4-point Likert-type ClinRO and PRO measures of current eyebrow loss, eyelash loss and nail appearance and a PRO measure of eye irritation. Patients (n?=?45, age 15-72 years) confirmed the importance and relevance of these signs/symptoms. Interim revision resulted in measures that were understood by and relevant to patients. Dermatologists (n?=?5) and patients (n?=?10, age 21-54 years) participated in the development of the eyebrow, eyelash and nail photoguides and confirmed that they included photos that appropriately represented different severity levels and were helpful to derive and standardize ratings across raters. CONCLUSIONS:The ClinRO and PRO measures for eyebrow, eyelash and nail appearance, with their accompanying photoguides and the PRO Measure for Eye Irritation provide clear and meaningful assessments of outcomes important to patients with AA.
| S-EPMC7473969 | biostudies-literature
Project description:OBJECTIVE:Patient-reported outcome scales determine response to treatment. The minimal clinically important difference of these scales is a measure of responsiveness: the smallest change in a score associated with a clinically important change to the patient. This study sought to summarize the literature on minimal clinically important difference for the most commonly reported shoulder outcome scales. DESIGN:A literature search of PubMed and EMBASE databases identified 193 citations, 27 of which met the inclusion/exclusion criteria. RESULTS:For rotator cuff tears, a minimal clinically important difference range of 9-26.9 was reported for American Shoulder and Elbow Surgeons, 8 or 10 for Constant, and 282.6-588.7 for the Western Ontario Rotator Cuff Index. For patients who underwent arthroplasty, a minimal clinically important difference range of 6.3-20.9 was reported for American Shoulder and Elbow Surgeons, 5.7-9.4 for Constant, and 14.1-20.6 for the Shoulder Pain and Disability Index. For proximal humeral fractures, a minimal clinically important difference range of 5.4-11.6 was reported for Constant and 8.1-13.0 for Disability of the Arm, Shoulder, and Hand. CONCLUSIONS:A wide range of minimal clinically important difference values was reported for each patient population and instrument. In the future, a uniform outcome instrument and minimal clinically important difference will be useful to measure clinically meaningful change across practices and the spectrum of shoulder diagnoses.
| S-EPMC6649681 | biostudies-literature