Development and validation of an instrument to measure and manage organizational process variety.
Ontology highlight
ABSTRACT:
SUBMITTER: Zelt S
PROVIDER: S-EPMC6198977 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Social pain is an emotional reaction to social exclusion which has been widely investigated in experimental settings. We developed the Social Pain Questionnaire (SPQ) and examined its factor structure, reliability, and construct validity. We constructed a 46-item pool that covered a broad range of situations related to social pain. Using three different subsamples (Online convenience sample: n = 623, Representative sample: n = 2531, Clinical sample of outpatients seeking psychotherapy: n = 270) we reduced the item pool to 10 items for the final SPQ scale, paying particular attention to content validity and factorial structure. Convergent, divergent and discriminant validity were assessed using standardized measures of related constructs and group differences. For the final 10-item version, a good factorial structure and reliability were found. Convergent validity was supported by correlations with related instruments of interpersonal sensitivity, attachment styles, depression and social anxiety. The representative and clinical sample differed significantly in social pain. The SPQ is an economic self-report measure with solid psychometric properties. Our data support the factorial, construct and convergent validity. The SPQ can be used to clarify the role of social pain in mental disorders and to incorporate interventions targeted towards social pain in psychotherapeutic settings.
| S-EPMC8050222 | biostudies-literature
Project description:ObjectiveTo validate a brief survey developed to be used in hospitals nationwide to assess organizational readiness to change to increase cultural competency.Data sources/study settingAnalysis of primary data collected as part of a 125-item Organizational Assessment Survey conducted in the ten US hospitals participating in the Robert Wood Johnson Foundation Expecting Success program in 2005-2006.Study designThe study utilized a cross-sectional survey.Data collectionSurveys were distributed to participants in the ten hospitals based on job title and role within the organization (including clinicians, clinical administrators, other clinical professionals, and those in relevant nonclinical roles; respondents = 513; response rate = 31%). Missing data were deleted listwise. We computed internal consistency reliability via Cronbach's alpha and interrater agreement using the rwg(j) index, and conducted exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) to examine validity of the survey. We subsequently conducted ANOVAs to examine whether the instrument adequately distinguished between hospitals.Principal findingsAcross 408 complete responses, a scree plot generated by the EFA and a follow-up CFA indicated a 2-factor solution (RMSEA = 0.06; CFI = 0.96; GFI = 0.96; RMSR = 0.08). We identified these primary factors as two scales, a 12-item Readiness to Address Quality scale (α = 0.85; rwg(j) = 0.93) and an 11-item Readiness to Address Disparities scale (α = 0.65; rwg(j) = 0.89). ANOVAs suggested that these scales distinguished between hospitals (RTAQ: F[9, 428] = 3.70, P < .001; RTAD: F[9, 435] = 3.02, P = .002).ConclusionsThis survey can help identify an organization's readiness to change to increase cultural competency.
| S-EPMC7839647 | biostudies-literature
Project description:Assessment environment, synonymous with climate or atmosphere, is multifaceted. Although there are valid and reliable instruments for measuring the educational environment, there is no validated instrument for measuring the assessment environment in medical programs. This study aimed to develop an instrument for measuring students' perceptions of the assessment environment in an undergraduate medical program and to examine the psychometric properties of the new instrument.The Assessment Environment Questionnaire (AEQ), a 40-item, four-point (1=Strongly Disagree to 4=Strongly Agree) Likert scale instrument designed by the authors, was administered to medical undergraduates from the authors' institution. The response rate was 626/794 (78.84%). To establish construct validity, exploratory factor analysis (EFA) with principal component analysis and varimax rotation was conducted. To examine the internal consistency reliability of the instrument, Cronbach's α was computed. Mean scores for the entire AEQ and for each factor/subscale were calculated. Mean AEQ scores of students from different academic years and sex were examined.Six hundred and eleven completed questionnaires were analysed. EFA extracted four factors: feedback mechanism (seven items), learning and performance (five items), information on assessment (five items), and assessment system/procedure (three items), which together explained 56.72% of the variance. Based on the four extracted factors/subscales, the AEQ was reduced to 20 items. Cronbach's α for the 20-item AEQ was 0.89, whereas Cronbach's α for the four factors/subscales ranged from 0.71 to 0.87. Mean score for the AEQ was 2.68/4.00. The factor/subscale of 'feedback mechanism' recorded the lowest mean (2.39/4.00), whereas the factor/subscale of 'assessment system/procedure' scored the highest mean (2.92/4.00). Significant differences were found among the AEQ scores of students from different academic years.The AEQ is a valid and reliable instrument. Initial validation supports its use to measure students' perceptions of the assessment environment in an undergraduate medical program.
| S-EPMC4624573 | biostudies-other
Project description:For older adults, the capacity to self-manage medications may be limited by several factors. However, currently available tools do not permit a comprehensive assessment of such limitations. The Domain Specific Limitation in Medication Management Capacity (DSL-MMC) was developed to address this need. This study aimed to establish the face and content validity of the DSL-MMC. The DSL-MMC tool consisted of 4 domains and 12 sub-domains with 42 items including: 1. physical abilities (vision, dexterity, hearing); 2. cognition (comprehension, memory, executive functioning); 3. medication regimen complexity (dosing regimen, non-oral administration, polypharmacy); and 4. access/caregiver (prescription refill, new prescription, caregiver). Pharmacists assessed each item for relevance, importance, readability, understandability, and representation. Items with content validity index (CVI) scores of <0.80 for relevance were examined for revision or removal. Twelve pharmacists participated in the study. CVI scores for relevance and importance of domains were 1.0; of the sub-domains, two were below 0.80. Among the 42 items, 35 (83%) and 30 (71%) maintained CVI scores above 0.80 for relevance and importance, respectively. Five items were removed, three were merged and seven were modified due to low CVI scores and/or feedback. The DSL-MMC has been validated for content.
| S-EPMC8167785 | biostudies-literature
Project description:BackgroundA different ethos with respect to the perception of medical ethics prevails in societies in transition such as those in the Arabian Peninsula, which makes it difficult to apply international principles of bioethics in medical practice. This study aimed to develop and psychometrically test an instrument that measures physicians' awareness of bioethics and medical law and their attitudes towards the practice of medical ethics. Additionally, it examined physician correlates influencing the awareness of bioethics.MethodsFollowing a rigorous review of relevant literature by a panel of experts, a 13-item instrument, the Omani physicians' bioethics and medical law awareness (OBMLA) questionnaire was developed with the aim of assessing physicians' awareness of bioethics and medical law. The study tool's construct validity and internal consistency reliability were examined by exploratory factor analysis (EFA) and Cronbach's alpha. In a cross-sectional study, the questionnaire was distributed among a random sample of 200 physicians at a tertiary hospital in Muscat, Oman. Participant characteristics that may influence awareness of bioethics and medical law were explored.ResultsThe EFA of the OBMLA questionnaire resulted in three well-loading factors: (1) Physicians' bioethics practice subscale (2) incentive related bioethics subscale and (3) medical law awareness subscale. Internal consistency reliability ranged between Cronbach's α: 0.73-0.8. Of the total 200 participants, 52% reported that teaching medical ethics during medical school was inadequate. The overall mean (standard deviation, SD) of the bioethics awareness score and Omani medical law awareness were 27.6 (3.5) and 10.1 (2.1) respectively. The majority of physicians (73%) reported that they frequently encountered ethical dilemmas in their practice and 24.5% endorsed the view that unethical decisions tended to occur in their practice.ConclusionThe study provides an insight into the practice of bioethics, and the awareness of bioethics and medical law among physicians in a teaching hospital in Oman. The OBMLA questionnaire appears to be a valid and reliable tool to assess a physician's awareness of bioethics and medical law. In this preliminary study, it appears that participants have suboptimal scores on the indices which measure practice and awareness of bioethics and medical law.
| S-EPMC8140473 | biostudies-literature
Project description:BackgroundImplementing effective interventions in healthcare requires organizations to be ready to support change. This study aimed to develop, adapt transculturally, and assess the content and face validity of the Organizational Readiness for Knowledge Translation (OR4KT) tool. The OR4KT was designed to measure the readiness of healthcare organizations to implement evidence-informed change across a variety of services.MethodsBased on systematic reviews of the literature, a Delphi exercise, and expert consultation, we first generated an initial pool of items. Second, we developed and assessed content validity of the pilot OR4KT questionnaire in English. Third, we created French and Spanish versions using a sequential forward and backward translation approach, and transcultural adaptation by a consensus process. Finally, we conducted pilot studies in three contexts - the Basque country region (Spain), and the provinces of Québec and Ontario (Canada) - where 30 experts assessed the face validity of the three versions of OR4KT.ResultsWe selected 59 items, grouped in 6 dimensions (organizational climate, context, change content, leadership, organizational support, and motivation) for the final English version of OR4KT. Translation and transcultural adaptation did not identify any content or language problems. Our findings indicate that the English, French and Spanish versions of OR4KT are linguistically equivalents and have high face validity. Only minor revisions to the wording of some items were recommended.ConclusionThe OR4KT holds promise as a measure of readiness for knowledge translation (KT) in healthcare organizations. The validity and reliability of the three versions of the OR4KT will be assessed in real-life contexts of implementation of evidence-based changes in healthcare.
| S-EPMC6186488 | biostudies-literature
Project description:IntroductionFollowing a review of patient-reported outcome (PRO) instruments in the literature, existing PRO instruments may not adequately capture the experience of receiving treatment for proliferative diabetic retinopathy (PDR). Therefore, this study aimed to develop a de novo instrument to comprehensively assess the patient experience of PDR.MethodsThis qualitative, mixed-methods study comprised item generation for the Diabetic Retinopathy-Patient Experience Questionnaire (DR-PEQ), content validation in patients with PDR, and preliminary Rasch measurement theory (RMT) analyses. Adult patients with diabetes mellitus and PDR who received aflibercept and/or panretinal photocoagulation within 6 months of study initiation were eligible for participation. The preliminary DR-PEQ comprised four scales: Daily Activities, Emotional Impact, Social Impact, and Vision Problems. DR-PEQ items were generated using existing knowledge of patient experiences in PDR and conceptual gaps identified from existing PRO instruments. Patients indicated the level of difficulty conducting daily activities and frequency experiencing emotional impacts, social impacts, and vision problems attributed to diabetic retinopathy and its treatment in the past 7 days. Content validity was evaluated in two rounds of in-depth, semi-structured patient interviews. Measurement properties were investigated via RMT analyses.ResultsThe preliminary DR-PEQ comprised 72 items. Overall, mean (SD) patient age was 53.7 (14.7) years. Forty patients completed the first interview; of these, 30 completed the second interview. Patients reported that the DR-PEQ was easily understood and relevant to their experience. Minor revisions, including removal of the Social Impact scale and addition of a Treatment Experience scale, were implemented to generate 85 items spanning four scales: Daily Activities, Emotional Impact, Vision Problems, and Treatment Experience. RMT analyses provided preliminary evidence that the DR-PEQ performed as intended.ConclusionThe DR-PEQ evaluated a broad spectrum of symptoms, functional impacts, and treatment experiences relevant to patients with PDR. Additional analyses are warranted to evaluate psychometric properties in a larger patient population.
| S-EPMC9969934 | biostudies-literature
Project description:BackgroundEngaging families in care leads to improved patient- and family-centreed outcomes and is recommended by cardiovascular societies. However, no validated tools are currently available to measure family engagement in acute cardiac care. We previously described the development of the FAMily Engagement (FAME) instrument. The purpose of this study is to validate the FAME instrument in acute cardiac care.MethodsThe FAME questionnaire was administered to family members of patients in a cardiovascular intensive care unit and ward at an academic tertiary care hospital in Montreal, Canada. After hospital discharge, we assessed family satisfaction in the intensive care unit (FS-ICU) and mental health (using the Hospital Anxiety and Depression Scale [HADS]). Higher FAME scores indicate increased care engagement. Reliability was assessed using internal consistency testing. Predictive validity was evaluated by assessing the relationship between the FAME score and the FS-ICU score and whether the FAME score was correlated with the HADS score. Convergent validity was assessed by comparing the FAME score with engagement elements of the FS-ICU score.ResultsA total of 160 family participants were included (age 54.8 ± 14.8 years; 66% women; 36% non-White). The most common relationships to the patient were spouse/partner and adult child (both n = 62; 39%). The mean FAME score was 70.8 ± 16.0. The FAME instrument had high internal consistency (Cronbach's a = 0.86). The FAME score was associated with family satisfaction in the multivariable analysis (P < 0.001). No correlation occurred between FAME and HADS anxiety or depression scores.ConclusionsThe FAME tool demonstrated reliability and convergent and predictive validity in the acute care cardiac population. Further research is needed to explore whether selected engagement interventions can impact the FAME score favourably.
| S-EPMC10066429 | biostudies-literature
Project description:IntroductionLessons captured from interviews with 12 European regions are represented in a new instrument, the B3-Maturity Model (B3-MM). B3-MM aims to assess maturity along 12 dimensions reflecting the various aspects that need to be managed in order to deliver integrated care. The objective of the study was to test the content validity of B3-MM as part of SCIROCCO (Scaling Integrated Care into Context), a European Union funded project.MethodsA literature review was conducted to compare B3-MM's 12 dimensions and their measurement scales with existing measures and instruments that focus on assessing the development of integrated care. Subsequently, a three-round survey conducted through a Delphi study with international experts in the field of integrated care was performed to test the relevance of: 1) the dimensions, 2) the maturity indicators and 3) the assessment scale used in B3-MM.ResultsThe 11 articles included in the literature review confirmed all the dimensions described in the original version of B3-MM. The Delphi study rounds resulted in various phrasing amendments of indicators and assessment scale. Full agreement among the experts on the relevance of the 12 B3-MM dimensions, their indicators, and assessment scale was reached after the third Delphi round.Conclusion and discussionThe B3-MM dimensions, maturity indicators and assessment scale showed satisfactory content validity. While the B3-MM is a unique instrument based on existing knowledge and experiences of regions in integrated care, further testing is needed to explore other measurement properties of B3-MM.
| S-EPMC5853880 | biostudies-literature
Project description:BackgroundMany individuals with Parkinson's disease are not diagnosed and treated. Attitudes about aging and related help-seeking may affect the timely diagnosis of Parkinson's disease. Our objectives were to develop measures of older adults' expectations regarding movement with aging, specifically related to parkinsonism, and their beliefs about seeking healthcare for the diagnosis and treatment of parkinsonism.MethodsWe established content and face validity from interviews with experts, review of the literature, and pre-testing with key informants. Two 9-item instruments resulted: Expectations Regarding Movement (ERM) and Healthcare Seeking Beliefs for parkinsonism (HSB). These instruments were administered to 210 older adults at senior centers to investigate internal consistency and construct validity.Results192 (91%) of the older adults completed more than 90% of the survey. The mean age was 76; 17 (9%) reported parkinsonism. Both scales demonstrated good internal consistency (α = 0.90). Factor analysis supported construct validity of the ERM and HSB scores. Older age, lower education, worse self-reported health and African American race each were associated with lower ERM scores, but not HSB scores.ConclusionThe ERM, a brief measure of expectations regarding movement with aging, shows reliability and validity. This scale may be useful in identifying older adults at increased risk for under-identification of Parkinson's disease. Further work is needed to measure healthcare seeking for parkinsonism.
| S-EPMC3427187 | biostudies-literature