Development and validation of an instrument to assess treatment adherence for each individual drug taken by a patient.
Ontology highlight
ABSTRACT:
SUBMITTER: Sidorkiewicz S
PROVIDER: S-EPMC4874131 | biostudies-other | 2016
REPOSITORIES: biostudies-other
Similar Datasets
Project description:BACKGROUND:Patient portals are widely adopted in the United States and allow millions of patients access to their electronic health records (EHRs), including their EHR clinical notes. A patient's ability to understand the information in the EHR is dependent on their overall health literacy. Although many tests of health literacy exist, none specifically focuses on EHR note comprehension. OBJECTIVE:The aim of this paper was to develop an instrument to assess patients' EHR note comprehension. METHODS:We identified 6 common diseases or conditions (heart failure, diabetes, cancer, hypertension, chronic obstructive pulmonary disease, and liver failure) and selected 5 representative EHR notes for each disease or condition. One note that did not contain natural language text was removed. Questions were generated from these notes using Sentence Verification Technique and were analyzed using item response theory (IRT) to identify a set of questions that represent a good test of ability for EHR note comprehension. RESULTS:Using Sentence Verification Technique, 154 questions were generated from the 29 EHR notes initially obtained. Of these, 83 were manually selected for inclusion in the Amazon Mechanical Turk crowdsourcing tasks and 55 were ultimately retained following IRT analysis. A follow-up validation with a second Amazon Mechanical Turk task and IRT analysis confirmed that the 55 questions test a latent ability dimension for EHR note comprehension. A short test of 14 items was created along with the 55-item test. CONCLUSIONS:We developed ComprehENotes, an instrument for assessing EHR note comprehension from existing EHR notes, gathered responses using crowdsourcing, and used IRT to analyze those responses, thus resulting in a set of questions to measure EHR note comprehension. Crowdsourced responses from Amazon Mechanical Turk can be used to estimate item parameters and select a subset of items for inclusion in the test set using IRT. The final set of questions is the first test of EHR note comprehension.
| S-EPMC5943623 | biostudies-literature
Project description:To date, several medication adherence instruments have been developed and validated worldwide. However, most instruments have only assessed medication adherence from the patient's perspective. The aim was to develop and validate the PATIENT-Medication Adherence Instrument (P-MAI) and the HEALTHCARE PROFESSIONAL-Medication Adherence Instrument (H-MAI) to assess medication adherence from the patient's and healthcare professional (HCP)'s perspectives. The P-MAI-12 and H-MAI-12 were developed using the nominal group technique. The face and content validity was determined by an expert panel and piloted. The initial version of these instruments consisted of 12 items were validated from October-December 2018 at a primary care clinic in Malaysia. Included were patients aged ≥21 years, diagnosed with diabetes mellitus, taking at least one oral hypoglycaemic agent and who could understand English. The HCPs recruited were family medicine specialists or trainees. To assess validity, exploratory factor analysis (EFA) and concurrent validity were performed; internal consistency and test-retest were performed to assess its reliability. A total of 120/158 patients (response rate = 75.9%) and 30/33 HCPs (response rate = 90.9%) agreed to participate. EFA found three problematic items in both instruments, which was then removed. The final version of the P-MAI-9 and the HMAI-9 had 9 items each with two domains (adherence = 2 items and knowledge/belief = 7 items). For concurrent validity, the total score of the P-MAI-9 and the H-MAI-9 were not significantly different (p = 0.091), indicating that medication adherence assessed from both the patient's and HCP's perspectives were similar. Both instruments achieved acceptable internal consistency (Cronbach's α: P-MAI-9 = 0.722; H-MAI-9 = 0.895). For the P-MAI-9, 7/9 items showed no significant difference between test and retest whereas 8/9 items in the H-MAI-9 showed significant difference at test and retest (p>0.05). In conclusion, the P-MAI-9 and H-MAI-9 had low sensitivity and high specificity suggesting that both instruments can be used for identifying patients more likely to be non-adherent to their medications.
| S-EPMC7657514 | biostudies-literature
Project description:The study aimed in developing and validating a Health Belief Model (HBM) based instrument used for cross-sectional studies among secondary school students in Jimma town, Oromia, Ethiopia. A school-based cross-sectional study was conducted from May 25 to June 10, 2021. The sample size was 634, and students were randomly selected from public and private secondary schools. The 81 items were developed reviewing different literatures based on the constructs of HBM. The constructs were perceived severity, perceived vulnerability, perceived benefit, perceived barrier, self-efficacy, cues to action, perceived school support and self-protective practice. Data were collected using a self-administered questionnaire. The data were cleaned, entered into and analyzed using SPSS 23.0. A principal axis factoring with varimax rotation was carried out to extract items. Items with no loading factor or cross-loaded items were deleted. Items having factor loading coefficient of ≥0.4 were retained. An internal reliability was ensured at Cronbach's alpha >0.70. All items with corrected item-total correlation coefficient below 0.30 were deleted from reliability analysis. In this study, 576 respondents were participated making a response rate of 90.8%. A total of thirty items were extracted and loaded in to eleven factors with cumulative variance of 56.719%. Percieved social support, percieved benefit, percieved school responsibility, self-efficacy, and practice items were internally consistent. Percieved vurnerability was neither valid nor reliable construct. Similarly, from the extracted factors, attitude towards face mask use and percieved peer influence were not internally consistent. Lastly, percieved benefit, self-efficacy and percieved school responsibility significantly predicted student's adherence to COVID-19 self-protective practices. The study found that perceived benefit, perceived school support, social support, self-efficacy, perceived school environment cleanness, perceived school responsibility, perceived school health education, attitude to use face mask, perceived severity, cues to action and perceived peer influence were valid. Finally, perceived benefit, self-efficacy and perceived school responsibility significantly predicted student's adherence to COVID-19 self-protective practices.
| S-EPMC9770370 | biostudies-literature
Project description:The purpose of this study was to perform a comprehensive systematic review of the literature on voice-related patient-reported outcome (PRO) measures in adults and to evaluate each instrument for the presence of important measurement properties.MEDLINE, the Cumulative Index of Nursing and Allied Health Literature, and the Health and Psychosocial Instrument databases were searched using relevant vocabulary terms and key terms related to PRO measures and voice. Inclusion and exclusion criteria were developed in consultation with an expert panel. Three independent investigators assessed study methodology using criteria developed a priori. Measurement properties were examined and entered into evidence tables.A total of 3,744 studies assessing voice-related constructs were identified. This list was narrowed to 32 PRO measures on the basis of predetermined inclusion and exclusion criteria. Questionnaire measurement properties varied widely. Important thematic deficiencies were apparent: (a) lack of patient involvement in the item development process, (b) lack of robust construct validity, and (c) lack of clear interpretability and scaling.PRO measures are a principal means of evaluating treatment effectiveness in voice-related conditions. Despite their prominence, available PRO measures have disparate methodological rigor. Care must be taken to understand the psychometric and measurement properties and the applicability of PRO measures before advocating for their use in clinical or research applications.
| S-EPMC5533561 | biostudies-other
Project description:BackgroundPatient safety is a fundamental value of healthcare to avoid patient harm. Non-compliance with patient safety standards may result in patient harm and is therefore a global concern. A Self-assessment Instrument for Perioperative Patient Safety (SIPPS) monitoring and benchmarking compliance to safety standards was validated in a multicentre pilot study.MethodsA preliminary questionnaire, based on the Dutch perioperative patient safety guidelines and covering international patient safety goals, was evaluated in a first digital RAND Delphi round. The results were used to optimize the questionnaire and design the SIPPS. For measurement and benchmarking purposes, SIPPS was categorized into seven main patient safety domains concerning all care episode phases of the perioperative trajectory. After consensus was reached in a face-to-face Delphi round, SIPPS was pilot-tested in five hospitals for five characteristics: measurability, applicability, improvement potential, discriminatory capacity and feasibility.ResultsThe results of the first Delphi round showed moderate feasibility for the preliminary questionnaire (81·6 per cent). The pilot test showed good measurability for SIPPS: 99·8 per cent of requested information was assessable. Some 99·9 per cent of SIPPS questions were applicable to the selected respondents. With SIPPS, room for improvement in perioperative patient safety compliance was demonstrated for all hospitals, concerning all safety domains and all care episode phases of the perioperative trajectory (compliance 76·1 per cent). SIPPS showed mixed results for discriminatory capacity. SIPPS showed good feasibility for all items (range 91·9-95·7 per cent).ConclusionA self-assessment instrument for measuring perioperative patient safety (SIPPS) compliance meeting international standards was validated. With SIPPS, improvement areas for perioperative patient safety and best practices across hospitals could be identified.
| S-EPMC6254004 | biostudies-literature
Project description:BackgroundThe patients' task to find, evaluate and transfer health information to one's individual condition and life requires competences that are summarized by the term 'health literacy'. Poor health literacy is associated with poorer health outcomes, like a higher rate of rehospitalization, lower receipt of screenings and a higher frequency of doctor visits.ObjectiveThree levels of health literacy are distinguished: functional, communicative and critical health literacy. Aim of this study was to translate and adapt the 'Functional Communicative Critical Health Literacy' (FCCHL) questionnaire to German, and assess its psychometric properties.Methods/designThe FCCHL was sent to 9075 participants enrolled in a RCT on health coaching. 4040 participants responded. Besides descriptive and reliability analysis, confirmatory factor analysis was performed to test the questionnaire's postulated scale structure in a calibration (N = 3000) and a validation sample (N = 1040) for cross-validation.ResultsThe instrument was well accepted (missing values ?2.1% per item) and showed acceptable or good internal consistency for the entire scale (? = 0.77) and the subscales (? = 0.75-0.80). The proposed three-factor model did not fit the German data sufficiently. As the scales 'communicative health literacy' and 'critical health literacy' showed high intercorrelation (0.98), they were combined to a new scale called 'processing health literacy'. The fit indices for the amended two-factor model were satisfying in both subgroups.ConclusionsReliability and acceptance of the German FCCHL are satisfying. An amended two-factor structure showed better validity than the original factor structure. Further research regarding the FCCHL and the underlying construct is needed.
| S-EPMC5810638 | biostudies-literature
Project description:BackgroundCaregiver burden is present in many clients managing illness in a companion animal, but current assessment tools are time-consuming and lack normative reference values.ObjectivesStatistical reduction of items in a measure of caregiver burden to create an abbreviated version, validation of the abbreviated version, and calculation of reference values.AnimalsNone.MethodsThis study was conducted using observational methods. Owners of an ill cat or dog were recruited through social media (n = 429). Veterinary clients with an ill (n = 459) or healthy (n = 961) cat or dog were recruited through a general veterinary and an academic hospital with multiple specialties. The study was conducted in 3 stages: (a) reduction of the Zarit Burden Interview (ZBI) adapted for use in pets via factor and item analyses, (b) psychometric validation of the abbreviated instrument, and (c) standardization of the abbreviated (7 items) and full (18 items) measures.ResultsA 7-item measure showed high correlations with the full measure (r = 0.88-0.93) and good internal consistency (α = .71-.75) across samples of veterinary clients with an ill cat or dog. This abbreviated measure correlated significantly (P < .001) and positively with stress (r = 0.40-0.75) and negatively with quality of life (r = -0.32 to -0.56). Reference values derived from clients with a healthy companion animal suggest "normal" burden ranges of 0 to 17 on the full measure and 0 to 8 on the abbreviated version.Conclusions and clinical importanceFor situations precluding full assessment of client caregiver burden, this brief 7-item version can be used with good internal consistency and validity. Reference values can help determine if a client's caregiver burden is increased.
| S-EPMC6524077 | biostudies-literature
Project description:Background: Several instruments that measure spirituality present overlaps with positive emotions, impacting the interpretation of their findings. In order to minimize these problems, we aimed to develop, assess the reliability and validate a new scale to evaluate spirituality. Methods: The instrument was designed using a theoretical framework minimizing tautological issues (i.e., Koenig's framework), a qualitative study investigating the definitions of spirituality, the development of the first version of instrument by experts' meetings and a qualitative cognitive debriefing. Then, the instrument was examined for its content validity by a multidisciplinary group of judges and was pilot-tested in two different groups - less religious (medical students - n = 85) and more religious (practicing religious members - n = 85). Finally, psychometric properties and validity were assessed. Results: The developed Attitudes Related to Spirituality Scale (ARES) is a self-report 11-item instrument using five-level Likert items. ARES presented appropriate psychometric properties revealing excellent internal consistency (alpha = 0.98) and temporal stability (ICC = 0.98). Likewise, ARES was strongly correlated with other validated R/S instruments (i.e., Duke Religion Index and Brief Multidimensional Measure of Religiousness/Spirituality) and was able to discriminate higher and lower religious groups. In the exploratory factor analysis, a unidimensional structure of the scale was described. Fit indices for the scale demonstrated good fit in the unidimensional model. Conclusion: The ARES is a reliable, valid and stable one-dimension instrument that is appropriate for use in the Portuguese-speaking population. Descriptors: Spirituality; Scale; Factorial Analysis; Instrument; Measure; Psychometrics.
| S-EPMC8600364 | biostudies-literature
Project description:BackgroundThe Clinician Reported Photonumeric Cellulite Severity Scale (CR-PCSS) and Patient Reported PCSS (PR-PCSS) are newly developed tools for assessing cellulite severity.ObjectiveTo report on the reliability, validity, and ability to detect a change in cellulite severity on the buttocks of adult women with the CR-PCSS and PR-PCSS.Materials and methodsContent validity of both scales was established through concept elicitation and cognitive interviews. Test-retest reliability was evaluated, and intra-rater (both scales) and inter-rater (CR-PCSS only) reliability were estimated using intraclass correlation coefficients (ICCs) for agreement and consistency. Ability to detect a change was determined using the Subject-Global Aesthetic Improvement Scale (GAIS) or Investigator-GAIS as anchors.ResultsFor the CR-PCSS (n = 6) at baseline and Day 2, the mean interrater ICCs were ≥0.70 and mean intrarater ICCs (95% confidence interval [CI]) were ≥0.81 (0.72-0.90) for both buttocks. For the PR-PCSS (n = 99) at baseline and Day 14, the mean test-retest reliability ICCs (95% CI) were ≥0.86 (0.79-0.91) for both buttocks. A clinically meaningful change was 1.0 point on the PR-PCSS and 1.0 on the CR-PCSS.ConclusionThe CR-PCSS and PR-PCSS reliably assess cellulite severity of the buttocks and can detect a clinically meaningful change after treatment for cellulite.
| S-EPMC7685927 | biostudies-literature
Project description:ImportanceAs video-based care expands in many clinical settings, assessing patient experiences with this care modality will help optimize health care quality, safety, and communication.ObjectiveTo develop and assess the psychometric properties of the video visit user experience (VVUE) measure, a patient-reported measure of experiences with video-based technology.Design, setting, and participantsIn this survey study, veterans completed a web-based, mail, or telephone survey about their use of Veterans Healthcare Administration (VHA) virtual care between September 2021 and January 2022. The survey was completed by patients who reported having a VHA video visit on their own device or a VHA-issued device and linked to VHA utilization data for the 6 months following the survey. Data analysis was performed from March 2022 to February 2023.Main outcomes and measuresThe survey included 19 items about experiences with video visits that were rated using a 4-point Likert-type scale (strongly disagree to strongly agree). First, an exploratory factor analysis was conducted to determine the factor structure and parsimonious set of items, using the McDonald Omega test to assess internal consistency reliability. Then, a confirmatory factor analysis was conducted to test structural validity, and bivariate correlations between VVUE and VHA health care engagement were calculated to test concurrent validity. Finally, predictive validity was assessed using logistic regression to determine whether VVUE was associated with future VHA video visit use.ResultsAmong 1887 respondents included in the analyses, 83.2% (95% CI, 81.5%-84.8%) were male, 41.0% (95% CI, 38.8%-43.1%) were aged 65 years or older, and the majority had multiple chronic medical and mental health conditions. The exploratory factor analysis identified a 10-item single-factor VVUE measure (including questions about satisfaction, user-centeredness, technical quality, usefulness, and appropriateness), explaining 96% of the total variance, with acceptable internal consistency reliability (ω = 0.95). The confirmatory factor analysis results confirmed a single-factor solution (standardized root mean squared residual = 0.04). VVUE was positively associated with VHA health care engagement (ρ = 0.47; P < .001). Predictive validity models demonstrated that higher VVUE measure scores were associated with future use of video visits, where each 1-point increase on VVUE was associated with greater likelihood of having a video visit in subsequent 6 months (adjusted odds ratio, 1.04; 95% CI, 1.02-1.06).Conclusions and relevanceThe findings of this study of veterans using video visits suggest that a brief measure is valid to capture veterans' experiences receiving VHA virtual care.
| S-EPMC10998154 | biostudies-literature