Dataset Information

An analysis of the construct validity and responsiveness of the ICECAP-SCM capability wellbeing measure in a palliative care hospice setting.

ABSTRACT:

Background

For outcome measures to be useful in health and care decision-making, they need to have certain psychometric properties. The ICECAP-Supportive Care Measure (ICECAP-SCM), a seven attribute measure (1. Choice, 2. Love and affection, 3. Physical suffering, 4. Emotional suffering, 5. Dignity, 6. Being supported, 7. Preparation) developed for use in economic evaluation of end-of-life interventions, has face validity and is feasible to use. This study aimed to assess the construct validity and responsiveness of the ICECAP-SCM in hospice inpatient and outpatient settings.

Methods

A secondary analysis of data collated from two studies, one focusing on palliative care day services and the other on constipation management, undertaken in the same national hospice organisation across three UK hospices, was conducted. Other quality of life and wellbeing outcome measures used were the EQ-5D-5L, McGill Quality of Life Questionnaire - Expanded (MQOL-E), Patient Health Questionnaire-2 (PHQ-2) and Palliative Outcomes Scale Symptom list (POS-S). The construct validity of the ICECAP-SCM was assessed, following hypotheses generation, by calculating correlations between: (i) its domains and the domains of other outcome measures, (ii) its summary score and the other measures' domains, (iii) its summary score and the summary scores of the other measures. The responsiveness of the ICECAP-SCM was assessed using anchor-based methods to understand change over time. Statistical analysis consisted of Spearman and Pearson correlations for construct validity and paired t-tests for the responsiveness analysis.

Results

Sixty-eight participants were included in the baseline analysis. Five strong correlations were found with ICECAP-SCM attributes and items on the other measures: four with the Emotional suffering attribute (Anxiety/depression on EQ-5D-5L, Psychological and Burden on MQOL-E and Feeling down, depressed or hopeless on PHQ-2), and one with Physical suffering (Weakness or lack of energy on POS-S). ICECAP-SCM attributes and scores were most strongly associated with the MQOL-E measure (0.73 correlation coefficient between summary scores). The responsiveness analysis (n = 36) showed the ICECAP-SCM score was responsive to change when anchored to changes on the MQOL-E over time (p < 0.05).

Conclusions

This study provides initial evidence of construct validity and responsiveness of the ICECAP-SCM in hospice settings and suggests its potential for use in end-of-life care research.

SUBMITTER: Myring G

PROVIDER: S-EPMC9264696 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ObjectivesEconomic evaluations often use preference-based value sets (tariffs) for health-related quality of life to quantify health effects. For wellbeing at the end of life, issues beyond health-related quality of life may be important. Therefore, the ICECAP Supportive Care Measure (ICECAP-SCM), based on the capability approach, was developed. A validated German ICECAP-SCM version was published recently. However, tariffs for the German ICECAP-SCM are not available. Therefore, the aim was to determine tariffs for the ICECAP-SCM based on preferences of the German general population.MethodsAn online sample of 2996 participants completed a best-worst scaling (BWS) and a discrete choice experiment (DCE). BWSs required participants to choose the best and worst statement within the same capability state, whereas DCEs required participants to trade-off between two capability states. First, BWS and DCE data were analyzed separately. Subsequently, combined data were analyzed using scale-adjusted conditional logit latent class models. Models were selected based on the stability of solutions and the Bayesian information criterion.ResultsThe two latent class model was identified to be optimal for the BWS, DCE, and combined data, and was used to derive tariffs for the ICECAP-SCM capability states. BWS data captured differences in ICECAP-SCM scale levels, whereas DCE data additionally explained interactions between the seven ICECAP-SCM attributes.DiscussionThe German ICECAP-SCM tariffs can be used in addition to health-related quality of life to quantify effectiveness in economic evaluations. The tariffs based on BWS data were similar for Germany and the UK, whereas the tariffs based on combined data varied. We would recommend to use tariffs based on combined data in German evaluations. However, only results on BWS data are comparable between Germany and the UK, so that tariffs based on BWS data should be used when comparing results between Germany and the UK.

Project description:BackgroundCurrently, there are no outcome measures assessing the ability of people with non-specific low back pain to self-manage their illness. Inspired by the 'Patient Enablement Instrument', we developed the Patient Enablement Instrument for Back Pain (PEI-BP). The aim of this study was to describe the development of the Patient Enablement Instrument for Back Pain (PEI-BP) and investigate content validity, construct validity, internal consistency, test-retest reliability, measurement error, responsiveness and floor and ceiling effects.MethodsThe PEI-BP consists of 6 items that are rated on a 0-10 Numeric Rating Scale. Measurement properties were evaluated using the COSMIN taxonomy and were based on three cohorts from primary care with low back pain: The content validity cohort (N = 14) which participated in semi-structured interviews, the GLA:D® Back cohort (N = 272) and the test-retest cohort (N = 37) which both completed self-reported questionnaires. For construct validity and responsiveness, enablement was compared to disability (Oswestry Disability Index), back pain beliefs (Brief Illness Perception Questionnaire), fear avoidance (Fear-Avoidance Beliefs Questionnaire-physical activity), mental health (SF-36), educational level and number of previous episodes of low back pain.ResultsThe PEI-BP was found to have acceptable content validity, construct validity, reliability (internal consistency, test-retest reliability and measurement error) and responsiveness. The Smallest Detectable Change was 10.1 points illustrating that a patient would have to change more than 1/6 of the scale range for it to be a true change. A skewed distribution towards the high scores were found at baseline indicating a potentially problematic ceiling effect in the current population.ConclusionsThe PEI-BP can be considered a valid and reliable tool to measure enablement on people seeking care for non-specific LBP. Further testing of the PEI-BP in populations with more severe LBP is recommended.Trial registrationNot applicable.

Project description:ObjectivesThe aim of the present study was to investigate the construct validity, responsiveness and reliability of the Feline Grimace Scale (FGS) in kittens.MethodsA total of 36 healthy female kittens (aged 10 weeks to 6 months) were included in a prospective, randomized, blinded study. Video recordings of all kittens were made before and 1 and 2 h after ovariohysterectomy using an opioid-free injectable anesthetic protocol with or without multimodal analgesia. Additional recordings were taken before and 1 h after administration of rescue analgesia (buprenorphine 0.02 mg/kg IM) to painful kittens. Screenshots of facial images were collected from the video recordings for FGS scoring. Four observers blinded to treatment groups and time points scored 111 randomized images twice with a 5-week interval using the FGS. Five action units (AUs) were scored (ear position, orbital tightening, muzzle tension, whiskers position and head position; 0-2 each). Construct validity, responsiveness, and inter- and intra-rater reliability were evaluated using linear models with Benjamini-Hochberg correction, Wilcoxon signed-rank test and single intraclass correlation coefficients (ICCsingle), respectively (P <0.05).ResultsFGS total ratio scores were higher at 1 and 2 h after ovariohysterectomy (median [interquartile range, IQR]: 0.30 [0.20-0.40] and 0.30 [0.20-0.40], respectively) than at baseline (median [IQR]: 0.10 [0.00-0.30]) (P <0.001). FGS total ratio scores were lower after the administration of rescue analgesia (median [IQR] before and after rescue analgesia) 0.40 [0.20-0.50] and 0.20 [0.10-0.38], respectively (P <0.001). Inter-rater ICCsingle was 0.68 for the FGS total ratio scores and 0.35-0.70 for all AUs considered individually. Intra-rater ICCsingle was 0.77-0.91 for the FGS total ratio scores and 0.55-1.00 for all AUs considered individually.Conclusions and relevanceThe FGS is a valid and responsive acute pain-scoring instrument with moderate inter-rater reliability and good to excellent intra-rater reliability in kittens.

Project description:Background Validity is the ability of an instrument to measure what it claims to measure. It means the degree to which the empirical evidence supports the trustworthiness of interpretations based on the calculated scores. The hematological malignancy (HM) specific patient reported outcome measure (HM-PRO), is a newly developed instrument for use in daily clinical practice as well as in research. This study, provides the evidence for construct validity of the HM-PRO, specifically focusing on the convergent and divergent validity compared to the other established instruments used in hematology. Methods This validation study adopted a prospective cross-sectional design where a heterogeneous group of patients diagnosed with different HMs and different disease state were recruited. A total of 905 patients were recruited from seven secondary care hospitals in the UK and online through five patient organizations. Patients were asked to complete the HM-PRO and other cancer specific PRO’s, FACT-G and EORTC QLQ C-30. Data analysis was performed using IBM SPSS 23 statistical software. Results A total of 486 males (53.7%) and 419 females (46.3%), with a mean age of 64.3 (± 12.4) years and mean time since diagnosis of 4.6 ( ± 5.2) were recruited. The total score of Part A of the HM-PRO highly correlated with the five functional scales of the EORTC QLQ-C30 (Physical = ?0.71, Role = ?0.72, Emotional = ?0.64, Cognitive = ?0.58, Social = ?0.74—p < 0.001). With respect to correlation with FACT-G, the total score of Part A of the HM-PRO highly correlated with Physical (?0.74), Emotional (?0.57), Functional (?0.66) domains and overall score of FACT-G (?0.74). Similarly, the total score of Part B of the HM-PRO highly correlated with three symptoms scales of EORTC QLQ-C30 (Fatigue scale = ?0.74, Nausea and Vomiting = ?0.52, Pain = ?0.59—p < 0.001) and individual symptom items (Dyspnea = 0.51, Insomnia= 0.43, Appetite loss = 0.54—p < 0.001). Conclusion The construct validity evidence presented in this research is a testimony to the HM-PRO’s ability to measure HRQoL issues which it intends to measure. This is of utmost importance when a PRO is used in routine clinical practice so that the interpretation of the scores or response to an individual item is understood by the clinicians/nurses as intended by the patients.

Project description:BackgroundFew measures capture the complex symptoms and concerns of those receiving palliative care.AimTo validate the Integrated Palliative care Outcome Scale, a measure underpinned by extensive psychometric development, by evaluating its validity, reliability and responsiveness to change.DesignConcurrent, cross-cultural validation study of the Integrated Palliative care Outcome Scale - both (1) patient self-report and (2) staff proxy-report versions. We tested construct validity (factor analysis, known-group comparisons, and correlational analysis), reliability (internal consistency, agreement, and test-retest reliability), and responsiveness (through longitudinal evaluation of change).Setting/participantsIn all, 376 adults receiving palliative care, and 161 clinicians, from a range of settings in the United Kingdom and Germany.ResultsWe confirm a three-factor structure (Physical Symptoms, Emotional Symptoms and Communication/Practical Issues). Integrated Palliative care Outcome Scale shows strong ability to distinguish between clinically relevant groups; total Integrated Palliative care Outcome Scale and Integrated Palliative care Outcome Scale subscale scores were higher - reflecting more problems - in those patients with 'unstable' or 'deteriorating' versus 'stable' Phase of Illness (F = 15.1, p < 0.001). Good convergent and discriminant validity to hypothesised items and subscales of the Edmonton Symptom Assessment System and Functional Assessment of Cancer Therapy-General is demonstrated. The Integrated Palliative care Outcome Scale shows good internal consistency (α = 0.77) and acceptable to good test-retest reliability (60% of items kw > 0.60). Longitudinal validity in form of responsiveness to change is good.ConclusionThe Integrated Palliative care Outcome Scale is a valid and reliable outcome measure, both in patient self-report and staff proxy-report versions. It can assess and monitor symptoms and concerns in advanced illness, determine the impact of healthcare interventions, and demonstrate quality of care. This represents a major step forward internationally for palliative care outcome measurement.