Dataset Information

Development and validation of the Vietnamese Primary Care Assessment Tool - provider version.

ABSTRACT: AIM:To adapt the provider version of the Primary Care Assessment Tool (PCAT) for Vietnam and determine its internal consistency and validity. BACKGROUND:There is a growing need to measure and explore the impact of various characteristics of health care systems on the quality of primary care. It would provide the best evidence for policy makers if these evaluations come from both the demand and supply sides of the health care sector. Comparatively more researchers have studied primary care quality from the consumer perspective than from the provider's perspective. This study aims at the latter. METHOD:Our study translated and adapted the PCAT provider version (PCAT PE) into a Vietnamese version, after which a cross-sectional survey was conducted to examine the feasibility, internal consistency and validity of the Vietnamese PCAT provider version (VN PCAT PE). All general doctors working at 152 commune health centres in Thua Thien Hue province had been selected to participate in the survey. FINDINGS:The VN PCAT PE is an instrument for evaluation of primary care in Vietnam with 116 items comprising six scales representing four core primary care domains, and three additional scales representing three derivative domains. From the translation and cultural adaptation stage, two items were combined, two items were removed and one item was added. Six other items were excluded due to problems in item-total correlations. All items have a low non-response or 'don't know/don't remember' response rate, and there were no floor or ceiling effects. All scales had a Cronbach's alpha above 0.80, except for the Coordination scale, which still was above the minimum level of 0.70. CONCLUSION:The VN PCAT PE demonstrates adequate internal consistency and validity to be used as an effective tool for measuring the quality of primary care in Vietnam from the provider perspective.

SUBMITTER: Hoa NT

PROVIDER: S-EPMC6609979 | biostudies-literature | 2019 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development and validation of the Vietnamese Primary Care Assessment Tool - provider version.

Hoa Nguyen Thi NT Derese Anselme A Markuns Jeffrey F JF Tam Nguyen Minha NM Peersman Wim W

Primary health care research & development 20190701

<h4>Aim</h4>To adapt the provider version of the Primary Care Assessment Tool (PCAT) for Vietnam and determine its internal consistency and validity.<h4>Background</h4>There is a growing need to measure and explore the impact of various characteristics of health care systems on the quality of primary care. It would provide the best evidence for policy makers if these evaluations come from both the demand and supply sides of the health care sector. Comparatively more researchers have studied prim ...[more]

PMID: 32800011

Similar Datasets

Project description:BACKGROUND:Malawi does not have validated tools for assessing primary care performance from patients' experience. The aim of this study was to develop a Malawian version of Primary Care Assessment Tool (PCAT-Mw) and to evaluate its reliability and validity in the assessment of the core primary care dimensions from adult patients' perspective in Malawi. METHODS:A team of experts assessed the South African version of the primary care assessment tool (ZA-PCAT) for face and content validity. The adapted questionnaire underwent forward and backward translation and a pilot study. The tool was then used in an interviewer administered cross-sectional survey in Neno district, Malawi, to test validity and reliability. Exploratory factor analysis was performed on a random half of the sample to evaluate internal consistency, reliability and construct validity of items and scales. The identified constructs were then tested with confirmatory factor analysis. Likert scale assumption testing and descriptive statistics were done on the final factor structure. The PCAT-Mw was further tested for intra-rater and inter-rater reliability. RESULTS:From the responses of 631 patients, a 29-item PCAT-Mw was constructed comprising seven multi-item scales, representing five primary care dimensions (first contact, continuity, comprehensiveness, coordination and community orientation). All the seven scales achieved good internal consistency, item-total correlations and construct validity. Cronbach's alpha coefficient ranged from 0.66 to 0.91. A satisfactory goodness of fit model was achieved (GFI = 0.90, CFI = 0.91, RMSEA = 0.05, PCLOSE = 0.65). The full range of possible scores was observed for all scales. Scaling assumptions tests were achieved for all except the two comprehensiveness scales. Intra-class correlation coefficient (ICC) was 0.90 (n = 44, 95% CI 0.81-0.94, p < 0.001) for intra-rater reliability and 0.84 (n = 42, 95% CI 0.71-0.96, p < 0.001) for inter-rater reliability. CONCLUSIONS:Comprehensive metric analyses supported the reliability and validity of PCAT-Mw in assessing the core concepts of primary care from adult patients' experience. This tool could be used for health service research in primary care in Malawi.

Project description:BackgroundMeasuring quality of primary care has attracted much attention around the world. Our team has developed and validated an Assessment Survey of Primary Care (ASPC) for evaluating quality of primary care in China. To facilitate the daily use of ASPC, this study aimed to develop and validate a rapid assessment version of ASPC (RA-ASPC) in China.MethodsThis is a multi-phase study on 21 experts and 1,184 patients from 12 primary care facilities in 10 cities in China. Importance, representativeness, easy understanding, and general applicability of each item in ASPC scale were rated to select the top two ranked items for constituting RA-ASPC. Reliability of RA-ASPC was tested by calculating both Cronbach's alpha and McDonald's omega coefficients. Structural validity was assessed by exploratory and confirmatory factor analysis (EFA and CFA). Concurrent validity was performed by analyzing the relationship between RA-ASPC and patient satisfaction. Discriminant validity was tested by assessing the difference of RA-ASPC scores between patients with or without family doctors.ResultsTen items were selected for RA-ASPC. Both Cronbach's alpha (0.732) and McDonald's omega (0.729) suggested satisfactory internal consistency. In EFA, explained variance of RA-ASPC (72.6%) indicated its ability to measure quality of primary care in China. CFA indicators showed convincing goodness-of-fit (GFI = 0.996, AGFI = 0.992, CFI = 1.000, NFI = 0.980, RMR = 0.022, and the RMSEA = 0.000) for RA-ASPC. Positive association between RA-ASPC and patient satisfaction supported the concurrent validity of RA-ASPC. Patients with family doctors perceived higher quality of primary care than those without family doctors, indicating good discriminant validity of RA-ASPC.ConclusionThe theoretical framework of RA-ASPC was in line with internationally recognized core functions of primary care. Good psychometric properties of RA-ASPC proved its appropriateness in assessing quality of primary care from patients' perspectives in China.

Project description:AIM:To conduct advanced psychometric analysis of Primary Care Assessment Tool (PCAT) in Tibet and identify avenues for metric performance improvement. BACKGROUND:Measuring progress toward high-performing primary health care can contribute to the achievement of sustainable development goals. The adult version of PCAT is an instrument for measuring patient experience, with key elements of primary care. It has been extensively used and validated internationally. However, only little information is available regarding its psychometric properties obtained based on advanced analysis. METHODS:We used data collected from 1386 primary care users in two prefectures in Tibet. First, iterative confirmatory factor analysis examined the fit of the primary care construct in the original tool. Then item response theory analysis evaluated how well the questions and individual response options perform at different levels of patient experience. Finally, multiple logistic regression modeling examined the predicative validity of primary care domains against patient satisfaction. FINDINGS:A best final structure for the PCAT-Tibetan includes 7 domains and 27 items. Confirmatory factor analysis suggests good fit for a unidimensional model for items within each domain but doesn't support a unidimensional model for the entire instrument with all domains. Non-parametric and parametric item response theory analysis models show that for most items, the favorable response option (4 = definitely) is overwhelmingly endorsed, the discriminability parameter is over 1, and the difficulty parameters are all negative, suggesting that the items are most sensitive and specific for patients with poor primary care experience. Ongoing care is the strongest predictor of patient satisfaction. These findings suggest the need for some principles in adapting the tool to different health system contexts, more items measuring excellent primary care experience, and update of the four-point response options.

Project description:BackgroundSchool health programs need to target all aspects of physical, psychological, and social well-being. Using a slightly modified version of the COSMIN Risk of Bias checklist, we developed and conducted the first validation of the School Health Assessment Tool for Primary Schools (SHAT-PS).MethodThe exploratory sequential mixed method was used in this study. In the first phase, scientific databases were systematically searched to find school health models and instruments and 65 interviews were conducted with school stakeholders. The Colaizzi's method was used to code the qualitative data into themes. Then, a pool of items was created for each theme, rechecked by psychometric experts and then validated for content (i.e., relevance, clarity, and comprehensiveness) by psychometric experts and individuals of the target population (i.e., school personnel). In the second phase, classical test theory was utilized to analyze the validity and reliability of the resulting items from phase 1 among 400 individuals working at primary schools.ResultsThe coding of the interviews resulted in ten themes that we labeled based on the theoretical literature: school health policies, community connections, health education, physical activity, health services, nutrition, psychological services, physical environment, equipment and facilities, and school staff's health. The items created for each theme ended up in an initial pool of 76 items. In the final stage of phase 1, 69 items remained after the content validity assessment by experts and school personnel. In phase 2, the SHAT-PS items were tested using maximum likelihood exploratory factor analysis and confirmatory factor analysis. Of the 69 items from phase 1, 22 items were removed due to low factor loadings. The results showed that the 8-factor model was the best solution (chi-square/df = 2.41, CFI = .98, TLI = .97, RMSEA = .06). The discriminant and convergent validity of the SHAT-PS were evaluated as satisfactory and the scale had high internal consistency (Cronbach's alpha for all subscales > .93). The test-retest reliability was satisfactory-the intraclass correlation coefficient pooled was .95 (99% CI [.91-.98]). Moreover, the standard error of measurement resulted in an SEM pooled equal to 4.4. No discrepancy was found between subgroups of gender and subgroups of staffs' positions at schools.ConclusionThe SHAT-PS is a valid and reliable tool that may facilitate school staff, stakeholders and researchers to evaluate the presence of the factors that promote health at primary schools. Nevertheless, in the process of validation, many of the items related to staff's health were eliminated due to poor factor loadings. Obviously, staff health is an important factor in the measurement of school health. Hence, we recommend that the validity and reliability of the SHAT-PS in other cultures should be done using the original 76-item version.

Dataset Information

Development and validation of the Vietnamese Primary Care Assessment Tool - provider version.

Publications

Development and validation of the Vietnamese Primary Care Assessment Tool - provider version.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets