Development and Validation of a Brief Version of the Research Engagement Survey Tool.
Ontology highlight
ABSTRACT:
SUBMITTER: Goodman MS
PROVIDER: S-EPMC8507896 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:AimTo adapt the provider version of the Primary Care Assessment Tool (PCAT) for Vietnam and determine its internal consistency and validity.BackgroundThere is a growing need to measure and explore the impact of various characteristics of health care systems on the quality of primary care. It would provide the best evidence for policy makers if these evaluations come from both the demand and supply sides of the health care sector. Comparatively more researchers have studied primary care quality from the consumer perspective than from the provider's perspective. This study aims at the latter.MethodOur study translated and adapted the PCAT provider version (PCAT PE) into a Vietnamese version, after which a cross-sectional survey was conducted to examine the feasibility, internal consistency and validity of the Vietnamese PCAT provider version (VN PCAT PE). All general doctors working at 152 commune health centres in Thua Thien Hue province had been selected to participate in the survey.FindingsThe VN PCAT PE is an instrument for evaluation of primary care in Vietnam with 116 items comprising six scales representing four core primary care domains, and three additional scales representing three derivative domains. From the translation and cultural adaptation stage, two items were combined, two items were removed and one item was added. Six other items were excluded due to problems in item-total correlations. All items have a low non-response or 'don't know/don't remember' response rate, and there were no floor or ceiling effects. All scales had a Cronbach's alpha above 0.80, except for the Coordination scale, which still was above the minimum level of 0.70.ConclusionThe VN PCAT PE demonstrates adequate internal consistency and validity to be used as an effective tool for measuring the quality of primary care in Vietnam from the provider perspective.
| S-EPMC6609979 | biostudies-literature
Project description:BACKGROUND:Malawi does not have validated tools for assessing primary care performance from patients' experience. The aim of this study was to develop a Malawian version of Primary Care Assessment Tool (PCAT-Mw) and to evaluate its reliability and validity in the assessment of the core primary care dimensions from adult patients' perspective in Malawi. METHODS:A team of experts assessed the South African version of the primary care assessment tool (ZA-PCAT) for face and content validity. The adapted questionnaire underwent forward and backward translation and a pilot study. The tool was then used in an interviewer administered cross-sectional survey in Neno district, Malawi, to test validity and reliability. Exploratory factor analysis was performed on a random half of the sample to evaluate internal consistency, reliability and construct validity of items and scales. The identified constructs were then tested with confirmatory factor analysis. Likert scale assumption testing and descriptive statistics were done on the final factor structure. The PCAT-Mw was further tested for intra-rater and inter-rater reliability. RESULTS:From the responses of 631 patients, a 29-item PCAT-Mw was constructed comprising seven multi-item scales, representing five primary care dimensions (first contact, continuity, comprehensiveness, coordination and community orientation). All the seven scales achieved good internal consistency, item-total correlations and construct validity. Cronbach's alpha coefficient ranged from 0.66 to 0.91. A satisfactory goodness of fit model was achieved (GFI = 0.90, CFI = 0.91, RMSEA = 0.05, PCLOSE = 0.65). The full range of possible scores was observed for all scales. Scaling assumptions tests were achieved for all except the two comprehensiveness scales. Intra-class correlation coefficient (ICC) was 0.90 (n = 44, 95% CI 0.81-0.94, p < 0.001) for intra-rater reliability and 0.84 (n = 42, 95% CI 0.71-0.96, p < 0.001) for inter-rater reliability. CONCLUSIONS:Comprehensive metric analyses supported the reliability and validity of PCAT-Mw in assessing the core concepts of primary care from adult patients' experience. This tool could be used for health service research in primary care in Malawi.
| S-EPMC5956555 | biostudies-literature
Project description:BackgroundWe conducted three studies to validate the Polish version of the BRS. Our objectives are as follows: first, to explore the dimensional structure of the scale and to determine the internal consistency (study 1: n = 1022); second, to determine the congruent and divergent validity of the BRS (study 2: n = 242); and third, to examine sensitivity of the BRS scale to detect high-risk population (study 3: n = 602).MethodsTo explore the dimensional structure of the scale, we tested a two-factor model with one factor for positively worded items and one factor for negatively worded items. To determine the congruent and divergent validity of the BRS, we analysed correlations among BRS and resilience, positive mental health, and with positive and negative religious coping. We used Student's t-test to examine sensitivity of the BRS scale to detect a high-risk population.ResultsBased on the CFA, a bivariate model was confirmed for items positively and negatively formulated with a higher order factor, which indicates the homogeneity of the scale, similar to the analyses carried out for their language versions confirming this type of homogeneity of the scale. The internal compatibility assessment based on Cronbach's Alpha and McDonald's Omega is good (0.88). Our analyses intended to test convergent and divergent validity, and showed that the BRS results are significantly related to a questionnaire measuring similar constructions. Our validation studies also provided important diagnoses regarding BRS "sensitivity", indicating that groups with higher stress levels achieved lower BRS resilience results.ConclusionThe results of our research indicate that the Polish version of the BRS should be considered to be a reliable and valid research tool. The Polish version of BRS is a reliable and accurate way of measuring resilience as the ability to bounce back from adversity and overcome various challenges or stressors. This scale may be used for both research and intervention purposes.
| S-EPMC7416919 | biostudies-literature
Project description:The Work-Related Quality of Life Scale (WRQLS) was developed by Van Laar et al. The Thai version was developed and could be completed in 13.4 min on average with some items having a factor loading of less than 0.4. The aims of this study were (a) to develop a brief Thai version of the WRQLS (brief THWRQLS), and (b) to assess its validity and reliability. A descriptive correlation study was performed with the components of THWRQLS selected based on statistical and judgmental criteria. The statistical criteria were developed using secondary data from 320 physicians identifying discrimination, internal consistency and exploratory factor analysis (EFA). The judgmental criteria included content validity and agreement by five experts. The web-based brief THWRQLS was then used by 250 health personnel, and confirmatory factor analysis (CFA) was conducted and internal consistency assessed. The brief THWRQLS consisted of seven dimensions, encompassing 25 of the original 32 items. The CFA revealed that most of the standardized factor loadings were greater than 0.5. The 2goodness of fit was 268.772 (p < 0.01), the comparative fit index was 0.971, the root mean square error of approximation was 0.039, and the standardized root mean square residual was 0.049. The Cronbach's alpha coefficient of the scale was 0.94, and almost all dimensions were greater than 0.7 except for that of "stress at work," which was 0.53. In conclusion, the brief THWRQLS appeared to be valid, and the reliability was acceptable, except in the dimension of "stress at work."
| S-EPMC7084910 | biostudies-literature
Project description:BackgroundWe report the development and evaluation of a web-based tool designed to facilitate student extra-curricular engagement in medical research through project matching students with academic supervisors. UK based university students were surveyed to explore their perceptions of undergraduate research, barriers and facilitators to current engagement. Following this, an online web-based intervention ( www.ProjectPal.org ) was developed to support access of students to research projects and supervisors. A pilot intervention was undertaken across a London-based university in January 2013 to February 2016. In March 2016, anonymised data were extracted from the prospective data log for analysis of website engagement and usage. Supervisors were surveyed to evaluate the website and student outputs.ResultsFifty-one students responded to the electronic survey. Twenty-four (47%) reported frustration at a perceived lack of opportunities to carry out extra-curricular academic projects. Major barriers to engaging in undergraduate research reported were difficulties in identifying suitable supervisors (33/51; 65%) and time pressures (36/51; 71%) associated with this. Students reported being opportunistic in their engagement with undergraduate research. Following implementation of the website, 438 students signed up to ProjectPal and the website was accessed 1357 times. Access increased on a yearly basis. Overall, 70 projects were advertised by 35 supervisors. There were 86 applications made by students for these projects. By February 2016, the 70 projects had generated 5 peer-review publications with a further 7 manuscripts under peer-review, 14 national presentations, and 1 national prize.ConclusionThe use of an online platform to promote undergraduate engagement with extra-curricular research appears to facilitate extra-curricular engagement with research. Further work to understand the impact compared to normal opportunistic practices in enhancing student engagement is now underway.
| S-EPMC6044023 | biostudies-literature
Project description:Smith and colleagues developed the Brief Resilience Scale (BRS) to assess the individual ability to recover from stress despite significant adversity. This study aimed to validate the German version of the BRS. We used data from a population-based (sample 1: n = 1.481) and a representative (sample 2: n = 1.128) sample of participants from the German general population (age ? 18) to assess reliability and validity. Confirmatory factor analyses (CFA) were conducted to compare one- and two-factorial models from previous studies with a method-factor model which especially accounts for the wording of the items. Reliability was analyzed. Convergent validity was measured by correlating BRS scores with mental health measures, coping, social support, and optimism. Reliability was good (? = .85, ? = .85 for both samples). The method-factor model showed excellent model fit (sample 1: ?2/df = 7.544; RMSEA = .07; CFI = .99; SRMR = .02; sample 2: ?2/df = 1.166; RMSEA = .01; CFI = 1.00; SRMR = .01) which was significantly better than the one-factor model (??2(4) = 172.71, p < .001) or the two-factor model (??2(3) = 31.16, p < .001). The BRS was positively correlated with well-being, social support, optimism, and the coping strategies active coping, positive reframing, acceptance, and humor. It was negatively correlated with somatic symptoms, anxiety and insomnia, social dysfunction, depression, and the coping strategies religion, denial, venting, substance use, and self-blame. To conclude, our results provide evidence for the reliability and validity of the German adaptation of the BRS as well as the unidimensional structure of the scale once method effects are accounted for.
| S-EPMC5811014 | biostudies-literature
Project description:Attitudes toward sexuality are a key variable for sexual health. It is really important for psychology and education to have adapted and validated questionnaires to evaluate these attitudes. Therefore, the objective of this research was to adapt, validate and calculate the equivalence of the Colombia Sexual Opinion Survey as compared to the same survey from Spain. To this end, a total of eight experts were consulted and 1,167 subjects from Colombia and Spain answered the Sexual Opinion Survey, the Sexual Assertiveness Scale, the Massachusetts General Hospital-Sexual Functioning Questionnaire, and the Sexuality Scale. The evaluation was conducted by online and the results show adequate qualitative and quantitative properties of the items, with adequate reliability and external validity and compliance with the strong invariance between the two countries. Consequently, the Colombia Sexual Opinion Survey is a valid and reliable scale and its scores can be compared with the ones from the Spain survey, with minimum bias.
| S-EPMC5023103 | biostudies-literature
Project description:With theoretical and empirical interest in narcissism growing, there is a need for brief measures of pathological narcissism that can be used more practically while assessing the construct comprehensively. Data from four samples (total N = 3,851) collected across two separate research groups and representing undergraduate, community, and clinical populations were used to establish the reliability, validity, and utility of the Brief-Pathological Narcissism Inventory (B-PNI). Item response theory and confirmatory factor analyses were used to determine the best-performing 28 items from the original PNI and ensure that the B-PNI exhibited a factor structure consistent with the original PNI. Items were retained for all seven pathological narcissism facet scales. Additional results also support the criterion validity of the B-PNI, suggesting that it can be used in place of the original PNI to assess the various facets of pathological narcissism effectively and without loss of information, which may enhance the ability of researchers to investigate pathological narcissism in future work.
| S-EPMC4659764 | biostudies-literature
Project description:BackgroundThe objective of this study was to develop and validate a short, self-administered questionnaire to assess diet quality in clinical settings, using the Alternative Healthy Eating Index (AHEI) as reference.MethodsA total of 1040 men and women (aged 44.6?±?14.4 y) completed a validated web-based food frequency questionnaire (webFFQ) and had their height and weight measured (development sample). Participants were categorized arbitrarily according to diet quality (high: AHEI score???65/110, low: AHEI score?<?65/110) based on dietary intake data from the webFFQ. The Brief Diet Quality Assessment Tool was developed using a classification and regression tree (CART) approach and individual answers to the webFFQ among participants considered to have a plausible energy intake (ratio of reported energy intake to basal metabolic rate???1.2 and?<?2.4; n =?1040). A second sample of 3344 older adults (aged 66.5?±?6.4 y) was used to test the external validity of the Brief Diet Quality Assessment Tool (external validation sample).ResultsThe decision tree included sequences of 3 to 6 binary questions, yielding 21 different pathways classifying diet quality as being high or low. In the development sample, the area under the receiver operating characteristic (ROC) curve of the predictive model was 0.92, with sensitivity, specificity and agreement values of 89.5, 83.9 and 87.2%. Compared with individuals having a low-quality diet according to the Brief Diet Quality Assessment Tool (mean AHEI 56.7?±?11.4), individuals classified as having a high-quality diet (mean AHEI 71.3?±?11.0) were significantly older, and had lower BMI, percent body fat and waist circumference, and had lower blood pressure, triglycerides, cholesterol/HDL ratio and fasting insulin as well as higher HDL-cholesterol concentrations (all P <?0.05). Similar results were observed in the external validation sample, although overall performance of the Brief Diet Quality Assessment Tool was slightly lower than in the development sample, with an area under the ROC curve of 0.79 and sensitivity, specificity and agreement values of 73.0, 69.0 and 71.3%, respectively.ConclusionThe CART approach yielded a simple and rapid Brief Diet Quality Assessment Tool that identifies individuals at risk of having a low-quality diet. Further studies are needed to test the performance of this tool in primary care settings.
| S-EPMC6685233 | biostudies-literature
Project description:The current study aimed to validate the Japanese version of the Burnout Assessment Tool (BAT-J), a new burnout measure. We conducted an Internet survey to confirm the validity and reliability of the BAT-J, using registered monitors from a Japanese survey company. The first-wave survey was conducted in May 2018, with 1,032 monitors. Of these, 498 participated in the second-wave survey in June 2018 to confirm 1-month test-retest reliability. We examined the factorial validity of the BAT-J core symptoms (BAT-JC) and BAT-J secondary symptoms (BAT-JS), as well as their reliability (internal consistency and test-retest reliability) and construct validity. Factorial validity was examined using confirmatory factor analyses and exploratory structural equation modeling bifactor analyses. Convergent and discriminant validity were examined using multitrait-multimethod frameworks well as the average variance explained. Exploratory structural equation modeling bifactor solutions for the BAT-JC, BAT-JS, and BAT-J demonstrated the best fit to the data. They also indicated that the general factor accounted for over two-thirds of the common variance explained. Internal consistency and test-retest reliability were confirmed. Convergent and internal discriminant validity of the BAT-JC were confirmed vis-ȧ-vis burnout, as assessed with the Maslach Burnout Inventory - General Survey. Moreover, external discriminant validity of the BAT-J was demonstrated for work engagement and workaholism. Finally, both BAT scales showed significant positive relationships with job demands and turnover intention. All validity results were in line with the job demands-resources model. The results of the current study provide the first evidence for the BAT-J's reliability and factorial and construct validity.
| S-EPMC7431961 | biostudies-literature