Calibration and Validation of a PREMIUM-DT Item Bank to Measure the Experience of Drug Therapy for Patients with Severe Mental Illness.
Ontology highlight
ABSTRACT:
SUBMITTER: Fernandes S
PROVIDER: S-EPMC9331305 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:ObjectiveSince the implementation of value-based healthcare, there has been a growing emphasis on utilizing patient-reported experience measures (PREMs) to enhance the quality of care. However, the current PREMs are primarily generic and static, whereas healthcare is constantly evolving and encompasses a wide variety of aspects that impact care quality. To continuously improve care requires a dynamic PREM. The aim of this study was to propose an item bank for the establishment of a dynamic and care-specific patient-reported evaluation.MethodsIn co-creation with patients, a mixed methods study was conducted involving: (1) an explorative review of the literature, (2) a focus group analysis with (ex-)patients, (3) qualitative analyses to formulate themes, and (4) a quantitative selection of items by patients and experts through prioritization.ResultsEight existing PREMs were evaluated. After removing duplicates, 141 items were identified. Through qualitative analyses of the focus group in which the patient journey was discussed, eight themes were formulated: "Organization of healthcare," "Competence of healthcare professionals," "Communication," "Information & services," "Patient empowerment," "Continuity & informal care," "Environment," and "Technology." Seven patients and eleven professionals were asked to prioritize what they considered the most important items. From this, an item bank with 76 items was proposed.ConclusionIn collaboration with patients and healthcare professionals, we have proposed a PREM-item bank to evaluate the experiences of patients' receiving cancer care in an outpatient clinic. This item bank is the first step to dynamically assess the quality of cancer care provided in an outpatient setting.
| S-EPMC10786971 | biostudies-literature
Project description:BackgroundPositive mindset (PM) is an important domain of health-related quality of life in Singapore, a multi-ethnic urban city state in Southeast Asia. We therefore developed and calibrated a novel item bank to measure and improve PM.MethodsWe developed an initial candidate pool of 48 items from focus groups, in-depth interviews and existing instruments locally developed and validated for use in Singapore. We administered all items in English to a multi-stage sample stratified for age and gender, of subjects with and without medical conditions recruited from the community and a hospital, and calibrated their responses using Samejima's Graded Response Model. We evaluated a final 36-item bank with respect to Item Response Theory (IRT) model assumptions, model fit, differential item functioning (DIF), concurrent and known-groups validity.ResultsAmong 493 participants (49.3% male, 41.6% above 50 years old, 33% Chinese, Malay and Indian), bifactor model analyses supported unidimensionality: explained common variance of the general factor was 0.86 and omega hierarchical was 0.97. Local independence was deemed acceptable: the average absolute residual correlations were <0.06 and 3.3% of the total item-pair residuals were flagged for local dependence. The overall model fit was adequate and provided good coverage of the PM construct (theta range: -3.6 to +2.4). Five items exhibited DIF with respect to ethnicity and gender, but were retained without modification of scores because they measured important aspects of PM. Scores correlated in the hypothesized direction with a self-reported measure of global health (Spearman's rho = -0.28, p<0.001) and discriminated between groups of participants with and without a self-reported diagnosis of a mood disorder (p = 0.007) adjusting for age, gender, ethnicity, education and marital status.ConclusionThe 36-item PM item bank demonstrated satisfactory psychometric properties for the English-speaking Singaporean population. IRT model assumptions were sufficiently met and scores showed concurrent and known-groups validity. Future studies to evaluate the validity of PM scores when items are administered adaptively are needed.
| S-EPMC6668803 | biostudies-literature
Project description:BackgroundSocial relationships (SR) is an important domain of health-related quality of life. We developed and calibrated a novel item bank to measure SR in Singapore, a multi-ethnic city in Southeast Asia.MethodsWe developed an initial candidate pool of 51 items from focus groups, individual in-depth interviews and existing instruments that had been developed and/or validated for use in Singapore. We administered all items in English to a multi-stage sample of subjects, stratified for age and gender, with and without medical conditions, recruited from community and hospital settings. We calibrated their responses using Samejima's Graded Response Model (SGRM). We evaluated a final 30-item bank with respect to Item Response Theory (IRT) model assumptions, model fit, differential item functioning (DIF), and concurrent and known-groups validity.ResultsAmong 503 participants (47.7% male, 41.4% above 50 years old, 34.0% Chinese, 33.6% Malay and 32.4% Indian), bi-factor model analyses supported essential unidimensionality: explained common variance of the general factor was 0.805 and omega hierarchical was 0.98. Local independence was deemed acceptable: the average absolute residual correlations were < 0.06 and 1.8% of the total item-pair residuals were flagged for local dependence. The overall SGRM model fit was adequate (p = 0.146). Five items exhibited DIF with respect to age, ethnicity and education, but were retained without modification of scores because they measured important aspects of SR. The SR scores correlated in the hypothesized direction with a self-reported measure of global health (Spearman's rho = - 0.28, p < 0.001).ConclusionThe 30-item SR item bank has shown acceptable psychometric properties. Future studies to evaluate the validity of SR scores when items are administered adaptively are needed.
| S-EPMC6505203 | biostudies-literature
Project description:BackgroundMedication adherence is important in managing the progression of chronic diseases. A promising approach to reduce cognitive burden when measuring medication adherence lies in the use of computer-adaptive tests (CATs) or in the development of shorter patient-reported outcome measures (PROMs). However, the lack of an item bank currently hampers this progress.ObjectiveWe aim to develop an item bank to measure general medication adherence.MethodsUsing the preferred reporting items for systematic review and meta-analysis (PRISMA), articles published before October 2019 were retrieved from PubMed, Embase, CINAHL, the Cochrane Library, and Web of Science. Items from existing PROMs were classified and selected ("binned" and "winnowed") according to standards published by the Patient-Reported Outcomes Measurement Information System (PROMIS) Cooperative Group.ResultsA total of 126 unique PROMs were identified from 213 studies in 48 countries. Items from the literature review (47 PROMs with 579 items for which permission has been obtained) underwent binning and winnowing. This resulted in 421 candidate items (77 extent of adherence and 344 reasons for adherence).ConclusionsWe developed an item bank for measuring general medication adherence using items from validated PROMs. This will allow researchers to create new PROMs from selected items and provide the foundation to develop CATs.
| S-EPMC7582150 | biostudies-literature
Project description:PurposeCurrent patient-reported outcomes for female urinary incontinence (UI) are limited by their inability to be tailored. Our objective is to describe the development and field testing of seven item banks designed to measure domains identified as important UI in females (UIf). We also describe the calibration and validation properties of the UIf-item banks, which allow for more efficient computerized adaptive testing (CAT) in the future.MethodsThe UIf-measures included 168 items covering seven domains: Stress UI (SUI), overactive bladder (OAB), urinary frequency, physical, social and emotional health impact and adaptation. Items underwent rigorous qualitative development and psychometric testing across two sites. Items were calibrated using item response theory and evaluated for internal consistency, construct validity and responsiveness.ResultsA total of 750 women (249 SUI, 249 OAB and 252 mixed UI) participated. Mean age was 55 ± 14 years, and 23 % were Hispanic and 80 % white. In addition to face and content validity, the measures demonstrated good internal consistency (coefficient alpha 0.92-0.98) and unidimensionality. There was evidence for construct validity with moderate-to-strong correlations with the UDI (r's ≥ 0.6) and IIQ (r's = ≥0.6) scales. The measures were responsive to change for SUI treatment (paired t test p < .001, ES range 1.3-2.9; SRM range 1.3-2.5) and OAB treatment (paired t test p < .05 for all domains except social health impact and adaptation, ES range 0.3-1.5, SRM range 0.4-1.0). The measures were responsive based on concurrent changes with the UDI and IIQ (p < 0.05). CAT versions were developed and pilot-tested.ConclusionsThe UIf-item banks demonstrate good psychometric characteristics and are a sufficiently valid set of customizable tools for measuring UI symptoms and life impact.
| S-EPMC4894000 | biostudies-literature
Project description:CONTEXT:Family satisfaction is an important and commonly used research measure. Yet current measures of family satisfaction are lengthy and may be unnecessarily burdensome--particularly in the setting of serious illness. OBJECTIVES:To use an item bank to develop short forms of the Family Satisfaction with End-of-Life Care (FAMCARE) scale, which measures family satisfaction with care. METHODS:To shorten the existing 20-item FAMCARE measure, item response theory parameters from an item bank were used to select the most informative items. The psychometric properties of the new short-form scales were examined. The item bank was based on data from family members from an ethnically diverse sample of 1983 patients with advanced cancer. RESULTS:Evidence for the new short-form scales supported essential unidimensionality. Reliability estimates from several methods were relatively high, ranging from 0.84 for the five-item scale to 0.94 for the 10-item scale across different age, gender, education, ethnic, and relationship groups. CONCLUSION:The FAMCARE-10 and FAMCARE-5 short-form scales evidenced high reliability across sociodemographic subgroups and are potentially less burdensome and time-consuming scales for monitoring family satisfaction among seriously ill patients.
| S-EPMC4441836 | biostudies-literature
Project description:PurposeTo provide calibrated item measures and rating category thresholds for the Activity Inventory (AI), an adaptive visual function questionnaire, from difficulty ratings obtained from a large sample of new low vision patients at pre-rehabilitation baseline.MethodsBaseline AI (510 items) rating scale data from five previous low vision rehabilitation outcome studies (n = 3623) were combined, and the method of successive dichotomizations was used to estimate calibrated item measures and rating category thresholds. Infit statistics were analyzed to evaluate the fit of the data to the model. Factor analysis was applied to person measures estimated from different subsets of items (e.g., functional domains such as reading, mobility) to evaluate differential person functioning.ResultsEstimated item measures were well targeted to the low vision patient population. The distribution of infit statistics confirmed the validity of the estimated measures and the two-factor structure previously observed for the AI.ConclusionsOur calibrated item measures and rating category thresholds enable researchers to estimate changes in visual ability from low vision rehabilitation on the same scale, facilitating comparisons between studies.Translational relevanceThe work described in this paper provides calibrated item measures and rating category thresholds for a visual function questionnaire to measure patient-centered outcomes in low vision clinical research. The calibrated AI also can be used as a patient outcome measure and quality assurance tool in clinical practice.
| S-EPMC8113999 | biostudies-literature
Project description:Interventions: We are assessing the impact of the National Bowel Cancer Screening Program (NBCSP) by comparing participation rates of people with and without Severe Mental Illness (SMI) and looking at health outcomes. We will be using data collected from Aug 2006 - latest available.
We are linking data using Commonwealth data (NBCSP, Medicare Benefits Schedule, Pharmaceutical Benefits Scheme, Australian Cancer Database & the National Death Index) to compare bowel cancer screening participation in people with SMI to those from the general population. We will additionally link these to the NSW cancer registry and hospital data to examine care pathways from diagnosis through treatment and end-of-life care.
We will also conduct a consultation with people with experience of SMI and Colorectal cancer and people with SMI in peer support roles who can provide their perspective on the barriers faced by people with SMI to gaining timely screening, diagnosis and optimal care.
These participants will be recruited from New South Wales consumer organisations and organisations with a strong focus on provision of peer support and advocacy. We will use a semi structured group interview schedule to facilitate discussion of a single focus group of 15 people. The group will consist of both people with lived experience who have direct experience of bowel cancer (n=10), as well as other people with lived experience who have supported people in this situation – as peer support workers or in other consumer advocacy/support roles (n=5). We will use this qualitative arm of the study to further develop our understanding of the quantitative findings. The consultation will also develop ideas on how to improve access to care.
Primary outcome(s): Participation rates in the National Bowel Cancer Screening Program assessed using data from the NBCSP.[Person-years will be calculated from entry into the study (2006) (the date of commencement of the NBCSP) or from the year that people become eligible for screening (i.e. age 50), whichever occurs later.. This is a retrospective cohort study, so all of the outcomes have already occurred and were recorded in the administrative data. This will be assessed when we receive the data.];Colonoscopy rates assessed using data from the NBCSP [Person-years will be calculated from entry into the study (2006 the date of commencement of the NBCSP), or from the year that people become eligible for screening (i.e. age 50), whichever occurs later, until colonoscopy. This is a retrospective cohort study, so all of the outcomes have already occurred and have been recorded in the administrative data.];Cancer diagnosis using data from the Australian Cancer Database[Person-years will be calculated from entry into the study (2006 the date of commencement of the NBCSP), or from the year that people become eligible for screening (i.e. age 50), whichever occurs later, until cancer diagnosis. This is a retrospective cohort study, so all of the outcomes have already occurred and have been recorded in the administrative data.]
Study Design: Purpose: Screening;Duration: Longitudinal;Selection: Case control;Timing: Both
| 2470998 | ecrin-mdr-crc
Project description:BackgroundMeasuring the quality and performance of health care is a major challenge in improving the efficiency of a health system. Patient experience is one important measure of the quality of health care, and the use of patient-reported experience measures (PREMs) is recommended. The aims of this project are 1) to develop item banks of PREMs that assess the quality of health care for adult patients with psychiatric disorders (schizophrenia, bipolar disorder, and depression) and to validate computerized adaptive testing (CAT) to support the routine use of PREMs; and 2) to analyze the implementation and acceptability of the CAT among patients, professionals, and health authorities.MethodsThis multicenter and cross-sectional study is based on a mixed method approach, integrating qualitative and quantitative methodologies in two main phases: 1) item bank and CAT development based on a standardized procedure, including conceptual work and definition of the domain mapping, item selection, calibration of the item bank and CAT simulations to elaborate the administration algorithm, and CAT validation; and 2) a qualitative study exploring the implementation and acceptability of the CAT among patients, professionals, and health authorities.DiscussionThe development of a set of PREMs on quality of care in mental health that overcomes the limitations of previous works (ie, allowing national comparisons regardless of the characteristics of patients and care and based on modern testing using item banks and CAT) could help health care professionals and health system policymakers to identify strategies to improve the quality and efficiency of mental health care.Trial registrationNCT02491866.
| S-EPMC6345324 | biostudies-literature
Project description:Background: The objective of this study was to develop a conceptual framework to define a domain map describing the experience of patients with severe mental illnesses (SMIs) on the quality of mental health care. Methods: This study used an exploratory qualitative approach to examine the subjective experience of adult patients (18-65 years old) with SMIs, including schizophrenia (SZ), bipolar disorder (BD) and major depressive disorder (MDD). Participants were selected using a purposeful sampling method. Semistructured interviews were conducted with 37 psychiatric inpatients and outpatients recruited from the largest public hospital in southeastern France. Transcripts were subjected to an inductive analysis by using two complementary approaches (thematic analysis and computerized text analysis) to identify themes and subthemes. Results: Our analysis generated a conceptual model composed of 7 main themes, ranked from most important to least important as follows: interpersonal relationships, care environment, drug therapy, access and care coordination, respect and dignity, information and psychological care. The interpersonal relationships theme was divided into 3 subthemes: patient-staff relationships, relations with other patients and involvement of family and friends. All themes were spontaneously raised by respondents. Conclusion: This work provides a conceptual framework that will inform the subsequent development of a patient-reported experience measure to monitor and improve the performance of the mental health care system in France. The findings showed that patients with SMIs place an emphasis on the interpersonal component, which is one of the important predictors of therapeutic alliance. Trial registration: NCT02491866.
| S-EPMC7906613 | biostudies-literature