A multilevel structural equation model for assessing a drug effect on a patient-reported outcome measure in on-demand medication data.
Ontology highlight
ABSTRACT:
SUBMITTER: Kessels R
PROVIDER: S-EPMC9292391 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundRespiratory syncytial virus (RSV) causes significant morbidity and mortality in older adults. Despite a number of RSV vaccine candidates in clinical trials, there are no existing disease-specific, self-reported measures that assess the symptoms and severity of RSV infection from the perspective of adult patients with acute RSV. The objective of this study was to describe the initial conceptualization and development of the RSV Infection, Intensity and Impact Questionnaire (RSV-iiiQ), a new patient-reported outcome measure.MethodsA targeted review of the literature identified relevant existing measures, symptoms, and impacts of RSV. A draft version of the RSV-iiiQ was developed based on the Influenza Intensity and Impact Questionnaire (Flu-iiQ) with expert input. Qualitative interviews (N = 20) were conducted with participants to optimize the RSV-iiiQ conceptual model and confirm the content validity of the RSV-iiiQ. Interviews included concept elicitation and a cognitive debriefing assessment. A draft conceptual framework was developed, and the electronic clinical outcome assessment was piloted. All steps of instrument development followed Food and Drug Administration guidance for patient-reported outcomes.ResultsIn-depth concept elicitation interviews followed by cognitive debriefings demonstrated that the content of the items was comprehensive, covered the breadth of RSV symptoms and impacts, and was relevant to the experiences of individuals with RSV. Both the paper and electronic versions of the RSV-iiiQ were easily completed. Minor refinements were made to some items based on participant feedback, and the draft conceptual framework was refined.ConclusionsThe RSV-iiiQ was developed for use in clinical trials to measure the symptom intensity and impact of acute RSV infection from the perspective of adult patients. The tool was developed in accordance with current regulatory guidance and is useful to support patient-focused drug development.
| S-EPMC9976435 | biostudies-literature
Project description:Introduction Poor medication adherence is associated with worsening patient health outcomes and increasing healthcare costs. A holistic tool to assess both medication adherence and drivers of adherence behaviour has yet to be developed. This study aimed to examine SPUR, a multifactorial patient-reported outcome measure of medication adherence in patients living with type 2 diabetes, with a view to develop a suitable model for psychometric analysis. Furthermore, the study aimed to explore the relationship between the SPUR model and socio-clinical factors of medication adherence. Research design and methods The study recruited 378 adult patients living with type 2 diabetes from a mix of community and secondary-care settings to participate in this non-interventional cross-sectional study. The original SPUR-45 tool was completed by participants with other patient-reported outcome measures for comparison, in addition to the collection of two objective adherence measures; HbA1c and the medication possession ratio (MPR). Results Factor and reliability analysis conducted on SPUR-45 produced a revised and more concise version (27-items) of the tool, SPUR-27, which was psychometrically assessed. SPUR-27 observed strong internal consistency with significant correlations to the other psychometric measures (Beliefs about Medication Questionnaire, Diabetes Treatment Satisfaction Questionnaire, Medicine Adherence Rating Scale) completed by participants. Higher SPUR-27 scores were associated with lower HbA1c values and a higher MPR, as well as other predicted socio-clinical factors such as higher income, increased age and lower body mass index. Conclusions SPUR-27 demonstrated strong psychometric properties. Further work should look to examine the test–retest reliability of the model as well as examine transferability to other chronic conditions and broader population samples. Overall, the initial findings suggest that SPUR-27 is a reliable model for the multifactorial assessment of medication adherence among patients living with type 2 diabetes.
| S-EPMC9454040 | biostudies-literature
Project description:BackgroundMedication adherence plays a critical role in controlling the evolution of chronic disease, as low medication adherence may lead to worse health outcomes, higher mortality, and morbidity. Assessment of their patients' medication adherence by clinicians is essential for avoiding inappropriate therapeutic intensification, associated health care expenditures, and the inappropriate inclusion of patients in time- and resource-consuming educational interventions. In both research and clinical practices the most extensively used measures of medication adherence are patient-reported outcome measures (PROMs), because of their ability to capture subjective dimensions of nonadherence. Machine learning (ML), a subfield of artificial intelligence, uses computer algorithms that automatically improve through experience. In this context, ML tools could efficiently model the complexity of and interactions between multiple patient behaviors that lead to medication adherence.ObjectiveThis study aimed to create and validate a PROM on medication adherence interpreted using an ML approach.MethodsThis cross-sectional, single-center, observational study was carried out a French teaching hospital between 2021 and 2022. Eligible patients must have had at least 1 long-term treatment, medication adherence evaluation other than a questionnaire, the ability to read or understand French, an age older than 18 years, and provided their nonopposition. Included adults responded to an initial version of the PROM composed of 11 items, each item being presented using a 4-point Likert scale. The initial set of items was obtained using a Delphi consensus process. Patients were classified as poorly, moderately, or highly adherent based on the results of a medication adherence assessment standard used in the daily practice of each outpatient unit. An ML-derived decision tree was built by combining the medication adherence status and PROM responses. Sensitivity, specificity, positive and negative predictive values (NPVs), and global accuracy of the final 5-item PROM were evaluated.ResultsWe created an initial 11-item PROM with a 4-point Likert scale using the Delphi process. After item reduction, a decision tree derived from 218 patients including data obtained from the final 5-item PROM allowed patient classification into poorly, moderately, or highly adherent based on item responses. The psychometric properties were 78% (95% CI 40%-96%) sensitivity, 71% (95% CI 53%-85%) specificity, 41% (95% CI 19%-67%) positive predictive values, 93% (95% CI 74%-99%) NPV, and 70% (95% CI 55%-83%) accuracy.ConclusionsWe developed a medication adherence tool based on ML with an excellent NPV. This could allow prioritization processes to avoid referring highly adherent patients to time- and resource-consuming interventions. The decision tree can be easily implemented in computerized prescriber order-entry systems and digital tools in smartphones. External validation of this tool in a study including a larger number of patients with diseases associated with low medication adherence is required to confirm its use in analyzing and assessing the complexity of medication adherence.
| S-EPMC10616746 | biostudies-literature
Project description:PurposeThe aim of this study was to generate evidence supporting the development and content validity of a new PRO instrument, the Small Intestinal Bacterial Overgrowth (SIBO) Symptom Measure (SSM) daily diary. The SSM assesses symptom severity in SIBO patients, with the ultimate goal of providing a fit for purpose PRO for endpoint measurement.MethodsQualitative research included 35 SIBO patients in three study stages, using a hybrid concept elicitation (CE)/cognitive interview (CI) method with US patients, ≥ 18 years. Stage 1 included a literature review, clinician interviews, and initial CE interviews with SIBO patients to identify symptoms important to patients for inclusion in the SSM. Stage 2 included hybrid CE/CI to learn more about patients' SIBO experience and test the draft SSM. Finally, stage 3 used CIs to refine the instrument and test its content validity.ResultsIn stage 1 (n = 8), 15 relevant concepts were identified, with items drafted based on the literature review/clinician interviews and elicitation work. Within stage 2 (n = 15), the SSM was refined to include 11 items; with wording revised for three items. Stage 3 (n = 12) confirmed the comprehensiveness of the SSM, as well as appropriateness of the item wording, recall period, and response scale. The resulting 11-item SSM assesses the severity of bloating, abdominal distention, abdominal discomfort, abdominal pain, flatulence, physical tiredness, nausea, diarrhea, constipation, appetite loss, and belching.ConclusionsThis study provides evidence supporting the content validity of the new PRO. Comprehensive patient input ensures that the SSM is a well-defined measure of SIBO, ready for psychometric validation studies.
| S-EPMC10393850 | biostudies-literature
Project description:ObjectivesGCA is systemic vasculitis manifesting as cranial, ocular or large vessel vasculitis. A prior qualitative study developed 40 candidate items to assess the impact of GCA on health-related quality of life (HRQoL). This study aimed to determine final scale structure and measurement properties of the GCA patient reported outcome (GCA-PRO) measure.MethodsCross-sectional study included UK patients with clinician-confirmed GCA. They completed 40 candidate items for the GCA-PRO at times 1 and 2 (3 days apart), EQ-5D-5L, ICECAP-A, CAT-PROM5 and self-report of disease activity. Rasch and exploratory factor analyses informed item reduction and established structural validity, reliability and unidimensionality of the final GCA-PRO. Evidence of validity was also established with hypothesis testing (GCA-PRO vs other PRO scores, and between participants with 'active disease' vs those 'in remission') and test-retest reliability.ResultsThe study population consisted of 428 patients: mean (s.d.) age 74.2 (7.2), 285 (67%) female; 327 (76%) cranial GCA, 114 (26.6%) large vessel vasculitis and 142 (33.2%) ocular involvement. Rasch analysis eliminated 10 candidate GCA items and informed restructuring of response categories into four-point Likert scales. Factor analysis confirmed four domains: acute symptoms (eight items), activities of daily living (seven items), psychological (seven items) and participation (eight items). The overall scale had adequate Rasch model fit (χ2 = 25.219, degrees of freedom = 24, P = 0.394). Convergent validity with EQ5D-5L, ICECAP-A and Cat-PROM5 was confirmed through hypothesis testing. Internal consistency and test-retest reliability were excellent.ConclusionThe final GCA-PRO is a 30-item, four-domain scale with robust evidence of validity and reliability in measuring HRQoL in people with GCA.
| S-EPMC10765151 | biostudies-literature
Project description:BackgroundMost antithrombotic medication users are older adults. Patient-reported outcome measures are commonly used in clinical research on antithrombotic medication, such as the diagnosis of intracranial hemorrhage.ObjectivesTo determine the reliability of patient-reported intracranial hemorrhage, anticoagulant and platelet aggregation inhibitor use in the older adult population.Patients/methodsWe conducted a secondary analysis of a prospective, observational cohort study of older adults who presented to the emergency department with a fall. The primary outcome was diagnosis of intracranial bleeding. We compared patient-reported intracranial bleeding to structured chart review with adjudication. We also compared patient-reported use of antiplatelet and anticoagulant medication to physician-reported medication use supplemented with structured chart review. We calculated the diagnostic accuracy of the patient-reported outcomes using our comparators as the reference standard.ResultsExact agreement for patient-reported intracranial bleeds was 95%, with a Cohen's kappa of 0.30 (95% confidence interval [CI], 0.15-0.45). The sensitivity was 36.7% (95% CI, 20.6%-56.1%) and specificity 97.2% (95% CI, 95.8%-98.1%). For anticoagulant medication use, exact agreement was 87%, Cohen's kappa 0.66 (95% CI, 0.63-0.72), sensitivity 84.0% (95% CI, 79.3%-83.8%), and specificity 87.6% (95% CI, 85.1%-89.7%). For antiplatelet medication use, exact agreement was 77%, Cohen's kappa 0.50 (95% CI, 0.44-0.55), sensitivity 68.7% (95% CI, 64.0%-73.1%), and specificity 81.2% (95% CI, 78.0-83.8%).ConclusionsPatient-reported outcome and exposure data were unreliable in this study. Our findings have a bearing on future research study design.
| S-EPMC8117814 | biostudies-literature
Project description:Structural equation modeling (SEM) provides an extensive toolbox to analyze the multivariate interrelations of directly observed variables and latent constructs. Multilevel SEM integrates mixed effects to examine the covariances between observed and latent variables across many levels of analysis. However, while it is necessary to consider model fit, traditional indices are largely insufficient to analyze model fit at each level of analysis. The present paper reviews i) the partially-saturated model fit approach first suggested by Ryu and West (2009) and ii) an alternative model parameterization that removes the multilevel data structure. We next describe the implementation of an algorithm to compute partially-saturated model fit for 2-level structural equation models in the open source SEM package, OpenMx, including verification in a simulation study. Finally, an example empirical application evaluates leading theories on the structure of affect from ecological momentary assessment data collected thrice daily for two weeks from 345 participants.
| S-EPMC7410097 | biostudies-literature
Project description:Background Validity is the ability of an instrument to measure what it claims to measure. It means the degree to which the empirical evidence supports the trustworthiness of interpretations based on the calculated scores. The hematological malignancy (HM) specific patient reported outcome measure (HM-PRO), is a newly developed instrument for use in daily clinical practice as well as in research. This study, provides the evidence for construct validity of the HM-PRO, specifically focusing on the convergent and divergent validity compared to the other established instruments used in hematology. Methods This validation study adopted a prospective cross-sectional design where a heterogeneous group of patients diagnosed with different HMs and different disease state were recruited. A total of 905 patients were recruited from seven secondary care hospitals in the UK and online through five patient organizations. Patients were asked to complete the HM-PRO and other cancer specific PRO’s, FACT-G and EORTC QLQ C-30. Data analysis was performed using IBM SPSS 23 statistical software. Results A total of 486 males (53.7%) and 419 females (46.3%), with a mean age of 64.3 (± 12.4) years and mean time since diagnosis of 4.6 ( ± 5.2) were recruited. The total score of Part A of the HM-PRO highly correlated with the five functional scales of the EORTC QLQ-C30 (Physical = ?0.71, Role = ?0.72, Emotional = ?0.64, Cognitive = ?0.58, Social = ?0.74—p < 0.001). With respect to correlation with FACT-G, the total score of Part A of the HM-PRO highly correlated with Physical (?0.74), Emotional (?0.57), Functional (?0.66) domains and overall score of FACT-G (?0.74). Similarly, the total score of Part B of the HM-PRO highly correlated with three symptoms scales of EORTC QLQ-C30 (Fatigue scale = ?0.74, Nausea and Vomiting = ?0.52, Pain = ?0.59—p < 0.001) and individual symptom items (Dyspnea = 0.51, Insomnia= 0.43, Appetite loss = 0.54—p < 0.001). Conclusion The construct validity evidence presented in this research is a testimony to the HM-PRO’s ability to measure HRQoL issues which it intends to measure. This is of utmost importance when a PRO is used in routine clinical practice so that the interpretation of the scores or response to an individual item is understood by the clinicians/nurses as intended by the patients.
| S-EPMC7506039 | biostudies-literature
Project description:BACKGROUND:In the past years, a mobile health (mHealth) app called the Dutch Talking Touch Screen Questionnaire (DTTSQ) was developed in The Netherlands. The aim of development was to enable Dutch physical therapy patients to autonomously complete a health-related questionnaire regardless of their level of literacy and digital skills. OBJECTIVE:The aim of this study was to evaluate the usability (defined as the effectiveness, efficiency, and satisfaction) of the prototype of the DTTSQ for Dutch physical therapy patients with diverse levels of experience in using mobile technology. METHODS:The qualitative Three-Step Test-Interview method, including both think-aloud and retrospective probing techniques, was used to gain insight into the usability of the DTTSQ. A total of 24 physical therapy patients were included. The interview data were analyzed using a thematic content analysis approach aimed at analyzing the accuracy and completeness with which participants completed the questionnaire (effectiveness), the time it took the participants to complete the questionnaire (efficiency), and the extent to which the participants were satisfied with the ease of use of the questionnaire (satisfaction). The problems encountered by the participants in this study were given a severity rating that was used to provide a rough estimate of the need for additional usability efforts. RESULTS:All participants within this study were very satisfied with the ease of use of the DTTSQ. Overall, 9 participants stated that the usability of the app exceeded their expectations. The group of 4 average-/high-experienced participants encountered only 1 problem in total, whereas the 11 little-experienced participants encountered an average of 2 problems per person and the 9 inexperienced participants an average of 3 problems per person. A total of 13 different kind of problems were found during this study. Of these problems, 4 need to be addressed before the DTTSQ will be released because they have the potential to negatively influence future usage of the tool. The other 9 problems were less likely to influence future usage of the tool substantially. CONCLUSIONS:The usability of the DTTSQ needs to be improved before it can be released. No problems were found with satisfaction or efficiency during the usability test. The effectiveness needs to be improved by (1) making it easier to navigate through screens without the possibility of accidentally skipping one, (2) enabling the possibility to insert an answer by tapping on the text underneath a photograph instead of just touching the photograph itself, and (3) making it easier to correct wrong answers. This study shows the importance of including less skilled participants in a usability study when striving for inclusive design and the importance of measuring not just satisfaction but also efficiency and effectiveness during such studies.
| S-EPMC6789421 | biostudies-literature
Project description:BackgroundFacial cancer surgery involving the midface (comprising the lower eyelids, nose, cheeks, and upper lip) can have debilitating life-changing functional, social, and psychological impacts on the patient. Midface symptoms are inadequately captured by existing patient-reported outcome measures (PROMs). PROMs are increasingly used for individual patient care, quality improvement, and standardized reporting of treatment outcomes. This study aimed to present our findings from the first phase of the development of a midface, specifically periocular and nasal, PROM.MethodsAfter international guidance for PROM development, the first phase comprised identification of salient issues and item generation. Fifteen patients who had midface surgery and 10 clinicians from various specialties with more than 5 years' experience treating these patients were recruited. Semi-structured interviews explored aesthetic, functional, social, and psychological outcomes, with specific attention to deficiencies in current PROMs. Thematic analysis was used to develop an item pool, and group interviews with clinicians were carried out to create and refine PROM scales.ResultsQualitative data from patient interviews were grouped into aesthetic, functional, and psychosocial domains for the eyelids and nose. Ninety-nine draft items were generated across these domains. Following focus group discussions, the final version of the midface-specific PROM contained 31 items (13 eye-specific, 10-nose-specific, eight general midface items).ConclusionsThis midface-specific PROM is valuable in assessing and comparing patient-reported outcomes in those who have undergone complex resection and reconstruction of the midface. This PROM is currently undergoing field testing.
| S-EPMC10959565 | biostudies-literature