Dataset Information

Development and validation of a Malawian version of the primary care assessment tool.

ABSTRACT: BACKGROUND:Malawi does not have validated tools for assessing primary care performance from patients' experience. The aim of this study was to develop a Malawian version of Primary Care Assessment Tool (PCAT-Mw) and to evaluate its reliability and validity in the assessment of the core primary care dimensions from adult patients' perspective in Malawi. METHODS:A team of experts assessed the South African version of the primary care assessment tool (ZA-PCAT) for face and content validity. The adapted questionnaire underwent forward and backward translation and a pilot study. The tool was then used in an interviewer administered cross-sectional survey in Neno district, Malawi, to test validity and reliability. Exploratory factor analysis was performed on a random half of the sample to evaluate internal consistency, reliability and construct validity of items and scales. The identified constructs were then tested with confirmatory factor analysis. Likert scale assumption testing and descriptive statistics were done on the final factor structure. The PCAT-Mw was further tested for intra-rater and inter-rater reliability. RESULTS:From the responses of 631 patients, a 29-item PCAT-Mw was constructed comprising seven multi-item scales, representing five primary care dimensions (first contact, continuity, comprehensiveness, coordination and community orientation). All the seven scales achieved good internal consistency, item-total correlations and construct validity. Cronbach's alpha coefficient ranged from 0.66 to 0.91. A satisfactory goodness of fit model was achieved (GFI?=?0.90, CFI?=?0.91, RMSEA?=?0.05, PCLOSE?=?0.65). The full range of possible scores was observed for all scales. Scaling assumptions tests were achieved for all except the two comprehensiveness scales. Intra-class correlation coefficient (ICC) was 0.90 (n =?44, 95% CI 0.81-0.94, p

SUBMITTER: Dullie L

PROVIDER: S-EPMC5956555 | biostudies-literature | 2018 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development and validation of a Malawian version of the primary care assessment tool.

Dullie Luckson L Meland Eivind E Hetlevik Øystein Ø Mildestvedt Thomas T Gjesdal Sturla S

BMC family practice 20180516 1

<h4>Background</h4>Malawi does not have validated tools for assessing primary care performance from patients' experience. The aim of this study was to develop a Malawian version of Primary Care Assessment Tool (PCAT-Mw) and to evaluate its reliability and validity in the assessment of the core primary care dimensions from adult patients' perspective in Malawi.<h4>Methods</h4>A team of experts assessed the South African version of the primary care assessment tool (ZA-PCAT) for face and content va ...[more]

PMID: 29769022

Similar Datasets

Project description:BackgroundMeasuring quality of primary care has attracted much attention around the world. Our team has developed and validated an Assessment Survey of Primary Care (ASPC) for evaluating quality of primary care in China. To facilitate the daily use of ASPC, this study aimed to develop and validate a rapid assessment version of ASPC (RA-ASPC) in China.MethodsThis is a multi-phase study on 21 experts and 1,184 patients from 12 primary care facilities in 10 cities in China. Importance, representativeness, easy understanding, and general applicability of each item in ASPC scale were rated to select the top two ranked items for constituting RA-ASPC. Reliability of RA-ASPC was tested by calculating both Cronbach's alpha and McDonald's omega coefficients. Structural validity was assessed by exploratory and confirmatory factor analysis (EFA and CFA). Concurrent validity was performed by analyzing the relationship between RA-ASPC and patient satisfaction. Discriminant validity was tested by assessing the difference of RA-ASPC scores between patients with or without family doctors.ResultsTen items were selected for RA-ASPC. Both Cronbach's alpha (0.732) and McDonald's omega (0.729) suggested satisfactory internal consistency. In EFA, explained variance of RA-ASPC (72.6%) indicated its ability to measure quality of primary care in China. CFA indicators showed convincing goodness-of-fit (GFI = 0.996, AGFI = 0.992, CFI = 1.000, NFI = 0.980, RMR = 0.022, and the RMSEA = 0.000) for RA-ASPC. Positive association between RA-ASPC and patient satisfaction supported the concurrent validity of RA-ASPC. Patients with family doctors perceived higher quality of primary care than those without family doctors, indicating good discriminant validity of RA-ASPC.ConclusionThe theoretical framework of RA-ASPC was in line with internationally recognized core functions of primary care. Good psychometric properties of RA-ASPC proved its appropriateness in assessing quality of primary care from patients' perspectives in China.

Project description:AIM:To conduct advanced psychometric analysis of Primary Care Assessment Tool (PCAT) in Tibet and identify avenues for metric performance improvement. BACKGROUND:Measuring progress toward high-performing primary health care can contribute to the achievement of sustainable development goals. The adult version of PCAT is an instrument for measuring patient experience, with key elements of primary care. It has been extensively used and validated internationally. However, only little information is available regarding its psychometric properties obtained based on advanced analysis. METHODS:We used data collected from 1386 primary care users in two prefectures in Tibet. First, iterative confirmatory factor analysis examined the fit of the primary care construct in the original tool. Then item response theory analysis evaluated how well the questions and individual response options perform at different levels of patient experience. Finally, multiple logistic regression modeling examined the predicative validity of primary care domains against patient satisfaction. FINDINGS:A best final structure for the PCAT-Tibetan includes 7 domains and 27 items. Confirmatory factor analysis suggests good fit for a unidimensional model for items within each domain but doesn't support a unidimensional model for the entire instrument with all domains. Non-parametric and parametric item response theory analysis models show that for most items, the favorable response option (4 = definitely) is overwhelmingly endorsed, the discriminability parameter is over 1, and the difficulty parameters are all negative, suggesting that the items are most sensitive and specific for patients with poor primary care experience. Ongoing care is the strongest predictor of patient satisfaction. These findings suggest the need for some principles in adapting the tool to different health system contexts, more items measuring excellent primary care experience, and update of the four-point response options.

Project description:BackgroundSchool health programs need to target all aspects of physical, psychological, and social well-being. Using a slightly modified version of the COSMIN Risk of Bias checklist, we developed and conducted the first validation of the School Health Assessment Tool for Primary Schools (SHAT-PS).MethodThe exploratory sequential mixed method was used in this study. In the first phase, scientific databases were systematically searched to find school health models and instruments and 65 interviews were conducted with school stakeholders. The Colaizzi's method was used to code the qualitative data into themes. Then, a pool of items was created for each theme, rechecked by psychometric experts and then validated for content (i.e., relevance, clarity, and comprehensiveness) by psychometric experts and individuals of the target population (i.e., school personnel). In the second phase, classical test theory was utilized to analyze the validity and reliability of the resulting items from phase 1 among 400 individuals working at primary schools.ResultsThe coding of the interviews resulted in ten themes that we labeled based on the theoretical literature: school health policies, community connections, health education, physical activity, health services, nutrition, psychological services, physical environment, equipment and facilities, and school staff's health. The items created for each theme ended up in an initial pool of 76 items. In the final stage of phase 1, 69 items remained after the content validity assessment by experts and school personnel. In phase 2, the SHAT-PS items were tested using maximum likelihood exploratory factor analysis and confirmatory factor analysis. Of the 69 items from phase 1, 22 items were removed due to low factor loadings. The results showed that the 8-factor model was the best solution (chi-square/df = 2.41, CFI = .98, TLI = .97, RMSEA = .06). The discriminant and convergent validity of the SHAT-PS were evaluated as satisfactory and the scale had high internal consistency (Cronbach's alpha for all subscales > .93). The test-retest reliability was satisfactory-the intraclass correlation coefficient pooled was .95 (99% CI [.91-.98]). Moreover, the standard error of measurement resulted in an SEM pooled equal to 4.4. No discrepancy was found between subgroups of gender and subgroups of staffs' positions at schools.ConclusionThe SHAT-PS is a valid and reliable tool that may facilitate school staff, stakeholders and researchers to evaluate the presence of the factors that promote health at primary schools. Nevertheless, in the process of validation, many of the items related to staff's health were eliminated due to poor factor loadings. Obviously, staff health is an important factor in the measurement of school health. Hence, we recommend that the validity and reliability of the SHAT-PS in other cultures should be done using the original 76-item version.

Project description:In The Netherlands, police officers not only come into contact with juvenile offenders, but also with a large number of juveniles who were involved in a criminal offense, but not in the role of a suspect (i.e., juvenile non-offenders). Until now, no valid and reliable instrument was available that can be used by Dutch police officers for estimating the risk for future care needs of juvenile non-offenders. In the present study, the Youth Actuarial Care Needs Assessment Tool for Non-Offenders (Y-ACNAT-NO) was developed for predicting the risk for future care needs that consisted of (1) a future supervision order as imposed by a juvenile court judge and (2) future worrisome incidents involving child abuse, domestic violence/strife, and/or sexual offensive behavior at the juvenile's living address (i.e., problems in the child-rearing environment).Police records of 3,200 juveniles were retrieved from the Dutch police registration system after which the sample was randomly split in a construction (n = 1,549) and validation sample (n = 1,651). The Y-ACNAT-NO was developed by performing an Exhaustive CHAID analysis using the construction sample. The predictive validity of the instrument was examined in the validation sample by calculating several performance indicators that assess discrimination and calibration.The CHAID output yielded an instrument that consisted of six variables and eleven different risk groups. The risk for future care needs ranged from 0.06 in the lowest risk group to 0.83 in the highest risk group. The AUC value in the validation sample was .764 (95% CI [.743, .784]) and Sander's calibration score indicated an average assessment error of 3.74% in risk estimates per risk category.The Y-ACNAT-NO is the first instrument that can be used by Dutch police officers for estimating the risk for future care needs of juvenile non-offenders. The predictive validity of the Y-ACNAT-NO in terms of discrimination and calibration was sufficient to justify its use as an initial screening instrument when a decision is needed about referring a juvenile for further assessment of care needs.

Dataset Information

Development and validation of a Malawian version of the primary care assessment tool.

Publications

Development and validation of a Malawian version of the primary care assessment tool.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets