Content validity of an item bank to assess intervention characteristic determinants of implementing evidence-based practices
Ontology highlight
ABSTRACT:
SUBMITTER: Jones S
PROVIDER: S-EPMC10192670 | biostudies-literature | 2023 Jan
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:PurposePrevious research indicated that the Patient-Reported Outcomes Measurement Information System (PROMIS®) item bank v2.0 'Ability to Participate in Social Roles and Activities' may miss subdomains of social participation. The purpose of this study was to generate items for these missing subdomains and to evaluate their content validity.MethodsA three-step approach was followed: (1) Item generation for 16 International Classification of Functioning Disability and Health subdomains currently not covered by the item bank; (2) Evaluation of content validity of generated items through expert review (n = 20) and think-aloud interviews with a purposeful sample of people with and without (chronic) health conditions (n = 10), to assess item comprehensibility, relevance, and comprehensiveness; and 3) Item revision based on the results of step 2, in a consensus procedure.ResultsFirst, 48 items were generated. Second, overall, content experts indicated that the generated items were relevant. Furthermore, based on experts' responses, items were simplified and 'participation in social media' was identified as an important additional subdomain of social participation. Additionally, 'participating in various social roles simultaneously' was identified as a missing item. Based on the responses of the interviewed adults items were simplified. Third, in total 17 items, covering 17 subdomains, were proposed to be added to the original item bank.DiscussionThe relevance, comprehensibility and comprehensiveness of the 17 proposed items were supported. Whether the proposed extension of the item bank leads to better psychometric properties of the item bank should be tested in a large-scale field study.
| S-EPMC7561593 | biostudies-literature
Project description:BackgroundPresbyopia is an age-related condition that causes a decreased ability to focus on nearby objects. Multifocal contact lenses are commonly used to address this issue. However, there seems to be a notable dissatisfaction among multifocal contact lens wearers. The absence of a reliable instrument to measure the patient's perspective, despite the widespread use of this method, highlights the need for further research in this area.ObjectiveThe objective of this study is to develop an item-bank integrating all domains necessary to assess the patient's perspective on multifocal contact lens performance, offering a comprehensive measure. The item-bank will ensure a high level of content validity, be self-administered, and will initially be available in Spanish. The aim of this tool is to serve as a valuable resource for research and optometric clinics, facilitating the follow-up of patients with presbyopia who wear multifocal contact lenses or those who are newly starting to use them.MethodologyThe MCL-PRO item bank, followed a systematic and step-wise inductive approach to gather information, following the recommendations outlined in the COSMIN guidelines and similar studies. The process involved the following steps: (1) Literature review and relevant existing items identification (2) Social media review, (3) Semi-structured focus groups, (4) performing qualitative analysis, (5) refining and revising the items, and (6) generating the content of the item bank.ResultsA total of 575 items were included in the item-bank hosted under 8 different domains that were found to be important for presbyopic population: visual symptoms (213), activity limitation (111), ocular symptoms (135), convenience (36), emotional well-being (33), general symptoms (16), cognitive issues (21) and economic issues (10).ConclusionThe item-bank created has followed standardised methodology for its development and encloses all the aspects for MCL performance evaluation from patients perspective.
| S-EPMC10853121 | biostudies-literature
Project description:Objectivesageism harms individuals' health and wellbeing and can be costly to societies. Reliable and valid measures that can quantify ageism are critical for achieving accurate data on its global prevalence, determinants and impacts, and to evaluate the effectiveness of interventions to reduce it. Ageism scales exist; however, none have been demonstrated to validly measure ageism in a manner consistent with consensus definitions of the concept (i.e. as manifested in all of stereotypes, prejudices and discrimination), whilst also quantifying ageism against all groups, from a target and perpetrator perspective, and across diverse country settings. Our objective was to develop an item pool to meet this need.Methodswe completed the conceptualisation, item generation and content validity assessment phases of a new World Health Organisation (WHO) WHO-ageism item pool that aims to measure the multi-dimensional nature of ageism. These phases drew on a review of available evidence, an experts' workshop and structured content validity reviews conducted by experts in scale development and ageism drawn from every world region defined by WHO.Resultsour resulting item pool is designed to provide a multi-dimensional measure of ageism against all ages measured from both a perpetration and experienced perspective and that can produce valid and reliable scores within diverse country contexts and comparable scores across these contexts.Conclusionsour item pool is the first major step in providing a global and comprehensive measure of ageism. Future phases of research will refine the item pool and establish the statistical psychometric properties of the final tool.
| S-EPMC10615060 | biostudies-literature
Project description:Background and objectivePatients experience a wide range of signs, symptoms, and impacts related to coronavirus disease 2019 (COVID-19). A patient-reported outcome (PRO) item bank that measures the most relevant patient experiences is needed to fully evaluate treatment benefit in COVID-19 clinical trials.MethodsA review of the literature and social media informed a novel PRO item bank of COVID-19 signs, symptoms, and impacts and general pandemic impacts. Twenty 1:1 concept elicitation and cognitive debriefing interviews were conducted with adults in the US who had symptomatic COVID-19. A conceptual model was developed and the PRO item bank refined following interviews.ResultsA heterogenous set of signs, symptoms, and impacts of COVID-19, as well as impacts associated with the pandemic overall, was identified. Fifty-five short-term and long-term signs and symptom items, 26 items assessing disease-related impacts, and seven items evaluating pandemic-related impacts are included in the item bank.ConclusionsThe novel and preliminarily content-valid IQVIA COVID-19 Daily Diary Item Bank© and the IQVIA COVID-19 Weekly Diary Item Bank© were developed to measure signs and symptoms, their associated severity, and disease-related and pandemic-related impacts. The items are arranged in seven groups and can be individually selected based on research needs.
| S-EPMC9296757 | biostudies-literature
Project description:Establishing evidence of content validity and satisfaction is an integral part of intervention research. The purpose of this article is to describe content validity and satisfaction relative to the Telephone Assessment and Skill-Building Kit (TASK), an 8-week follow-up program based on individualized assessment of stroke caregiver needs.The TASK intervention enables caregivers to develop skills based on assessment of their own needs. During the development of the TASK program, 10 experts rated the validity of the TASK intervention components for accuracy, feasibility, acceptability, and problem relevance. After incorporating feedback from the experts, a randomized controlled clinical trial was instituted using a convenience sample of 40 stroke caregivers to determine satisfaction (usefulness, ease of use, and acceptability) with the TASK intervention (n=21) compared with an attention control group (n=19). Data collection occurred between March 2005 and June 2006. Data were analyzed using descriptive statistics, independent sample t tests, and content analysis.Expert ratings on a 1 to 5 scale, with 5 being strongly agree, provided evidence of content validity (accuracy 4.71, feasibility 4.46, acceptability 4.40, problem relevance 4.67). Caregivers in the TASK group scored significantly higher than the attention control group on all satisfaction measures (usefulness p=.02; ease of use p=.02; acceptability p=.05). Qualitative comments from caregivers provided further evidence of satisfaction.Evidence of content validity and user satisfaction for the TASK intervention relative to an attention control group was found.The TASK program may be a viable telephone-based program that can be implemented by nurses to support family caregivers during the first few months after stroke survivors are discharged home.
| S-EPMC5546610 | biostudies-other
Project description:ObjectiveTo establish content validity of a single-item, migraine-specific symptom severity questionnaire for completion by migraine patients, key family members (KFMs) of migraine patients, and Healthcare Professionals (HCPs) who treat migraine patients.BackgroundMigraine is a common disabling primary headache disorder with high prevalence and significant socioeconomic burden and personal impacts. There is a need for a global assessment of migraine symptom severity to evaluate potential new therapies from multiple perspectives.MethodsThe migraine Global Impression Item (mGI-I) was drafted and tested in a non-interventional, qualitative study comprising telephone interviews with 15 migraine patients, 15 KFMs of migraine patients, and 15 migraine treating HCPs. The mGI-I was drafted with two different item stem options and two different response scale options to ask about the patient's migraine from the perspective of each respondent. Cognitive interviews were conducted to test comprehensiveness, clarity and ease of completion of the different versions of the mGI-I iteratively in three sequential waves of respondents.ResultsRevisions were made to the draft mGI-I after Wave 1 and Wave 2 of the interviews. Changes were made to simplify the item stem (removing unnecessary text), make language more patient-friendly (e.g. use of "migraine attack"), and add clarity to the item stem for consistent interpretation (include descriptive language of migraine attacks). Across both waves there was a preference for a 5-point response scale compared to a 7-point scale. In Wave 3, all respondents found the revised instructions, item stem, and 5-point response scale comprehensive, easy to understand and to answer. No further changes to the mGI-I were made after Wave 3.ConclusionsThis qualitative study of 45 total respondents across 3 subpopulations, established the content validity and appropriateness of the mGI-I in migraine patients, KFMs, and migraine-treating HCPs. The study specifically confirmed that the mGI-I is comprehensive, easily understood and answered for each respondent population.
| S-EPMC8932152 | biostudies-literature
Project description:PurposeTo report on the content generation and item refinement phases for a myopia refractive intervention-specific quality-of-life (QoL) item bank that will be operationalized using computerized adaptive testing.MethodsMyopia refractive intervention-specific QoL domains and items were generated from (1) a literature search of existing refractive-intervention QoL questionnaires; (2) semistructured interviews with myopic patients corrected using spectacles, contact lenses and/or refractive surgery (n = 32); (3) and myopia experts (n = 9) recruited from the Singapore National Eye Centre. After a thematic analysis, items were systematically refined and tested using cognitive interviews with 24 additional patients with corrected myopia.ResultsOf the 32 participants with myopia interviewed (mean ± standard deviation age, 35.6 ± 9.0 years; 71.9% female; 78.1% Chinese), 12 (37.5%) wore spectacles, 7 (21.9%) used contact lenses, and 20 (62.5%) had undergone laser refractive surgery. Initially, 912 items within 7 independent QoL domains were identified. After refinement, 204 items were retained, including those relating to mobility challenges and work-related difficulties that are not well-represented in current refractive intervention-specific questionnaires.ConclusionsThrough a rigorous item generation and selection process, we have developed a 204-item and 7-domain myopia refractive intervention-specific item bank that will now undergo rigorous psychometric testing to generate item calibrations for the validation of a novel computerized adaptive testing instrument designed for use in research and routine clinical practice.Translational relevanceOnce psychometrically validated and operationalized using computerized adaptive testing, this myopia refractive intervention-specific instrument will enable researchers and clinicians to quickly and comprehensively assess the impact of myopic refractive interventions across seven QoL domains.
| S-EPMC10214877 | biostudies-literature
Project description:BackgroundDelirium is a neuropsychiatric syndrome that can have serious consequences and is often overlooked by healthcare professionals. The level of knowledge about delirium is often insufficient among nursing and medical staff. At the current time there is no suitable questionnaire to record the level of knowledge in German-speaking countries.AimDevelopment of a questionnaire and evaluation of content validity.MethodsFollowing a literature search to identify current best practice, several questionnaires were identified. An already published questionnaire with the dimensions of basic knowledge of delirium and risk factors has been translated, adapted and extended by the dimension of nonpharmacological delirium prevention. Delirium experts assessed the relevance of the questionnaire items in two rounds of reviews. Content validity was calculated using the Content Validity Index (CVI) at item (I-CVI) and scale (S-CVI) level. Additionally, the modified Kappa (k*) was calculated using a lower 95% confidence interval (CI).ResultsThe original 30-item questionnaire was expanded to include 18 delirium prevention items. After the first round of scoring 30 out of 48 items showed good to excellent I‑CVI scores. Considering the comments, 6 items were discarded and 12 were adapted in terms of language and content. In the final version of the questionnaire 41 items with excellent scores remained. The total scale score increased from 0.88 in the first version to 1.0 in the final version. Nurses were identified as the target group, potentially also therapists and medical personnel.ConclusionThe delirium knowledge questionnaire is content-valid.
| S-EPMC8791090 | biostudies-literature
Project description:Matrix reasoning tasks are among the most widely used measures of cognitive ability in the behavioral sciences, but the lack of matrix reasoning tests in the public domain complicates their use. Here, we present an extensive investigation and psychometric validation of the matrix reasoning item bank (MaRs-IB), an open-access set of matrix reasoning items. In a first study, we calibrate the psychometric functioning of the items in the MaRs-IB in a large sample of adult participants (N = 1501). Using additive multilevel item structure models, we establish that the MaRs-IB has many desirable psychometric properties: its items span a wide range of difficulty, possess medium-to-large levels of discrimination, and exhibit robust associations between item complexity and difficulty. However, we also find that item clones are not always psychometrically equivalent and cannot be assumed to be exchangeable. In a second study, we demonstrate how experimenters can use the estimated item parameters to design new matrix reasoning tests using optimal item assembly. Specifically, we design and validate two new sets of test forms in an independent sample of adults (N = 600). We find these new tests possess good reliability and convergent validity with an established measure of matrix reasoning. We hope that the materials and results made available here will encourage experimenters to use the MaRs-IB in their research.
| S-EPMC10551052 | biostudies-literature
Project description:BACKGROUND: A multifaceted implementation (MFI) strategy was used to implement an evidence-based occupational therapy program for people with dementia (COTiD program). This strategy was successful in increasing the number of referrals, but not in improving occupational therapists' (OTs) adherence. Therefore, a process evaluation was conducted to identify factors that influenced the effectiveness of the MFI strategy. METHODS: A mixed-method approach of qualitative and quantitative research was used to evaluate the implementation process. The MFI strategy as planned and as executed were reported and evaluated based on the framework of Hulscher et al. (2003; 2006). Data on OTs attitudes and expected barriers were collected at baseline from 94 OTs using a 19-item questionnaire. Data on the experiences were collected after finishing the implementation using focus groups with OTs and telephone interviews with physicians and managers. For quantitative data, frequencies and correlations were calculated and qualitative data were analyzed using inductive content analysis. RESULTS: The implementation strategy as executed had a stronger focus than planned on increasing OTs promotional skills due to an initial lack of referrals. This resulted in less attention for increasing OTs' skills in using the COTiD program as initially intended. At baseline, OTs had a positive attitude toward the program, however, 75% did not feel experienced enough and only 14.3% felt competent in using the program. Focus groups and interviews revealed various determinants that influenced implementation. Most managers were positive about the program. However, the degree of operational support of managers for OTs regarding the implementation was not always adequate. Managers stated that a well-defined place for occupational therapy within the dementia care network was lacking although this was perceived necessary for successful implementation. Several physicians perceived psychosocial interventions not to be in their area of expertise or not their responsibility. All professionals perceived inter-professional collaboration to be a facilitator for effective implementation, and general practitioners were perceived as key partners in this collaboration. However, collaboration was not always optimal. OTs indicated that increasing the referral rate was most effective when promoting OT via other disciplines within a physician's network. CONCLUSION: Our data suggests that a first step in successful implementation should be to make sure that individual and organizational barriers are resolved. In addition, implementation should be network-based and encourage inter-professional collaboration. Initial promotion of COTiD should focus on physicians that have a positive attitude toward non-pharmacological interventions.
| S-EPMC4226207 | biostudies-other