Dataset Information

Evaluating health worker performance in Benin using the simulated client method with real children.

ABSTRACT: The simulated client (SC) method for evaluating health worker performance utilizes surveyors who pose as patients to make surreptitious observations during consultations. Compared to conspicuous observation (CO) by surveyors, which is commonly done in developing countries, SC data better reflect usual health worker practices. This information is important because CO can cause performance to be better than usual. Despite this advantage of SCs, the method's full potential has not been realized for evaluating performance for pediatric illnesses because real children have not been utilized as SCs. Previous SC studies used scenarios of ill children that were not actually brought to health workers. During a trial that evaluated a quality improvement intervention in Benin (the Integrated Management of Childhood Illness [IMCI] strategy), we conducted an SC survey with adult caretakers as surveyors and real children to evaluate the feasibility of this approach and used the results to assess the validity of CO.We conducted an SC survey and a CO survey (one right after the other) of health workers in the same 55 health facilities. A detailed description of the SC survey process was produced. Results of the two surveys were compared for 27 performance indicators using logistic regression modeling.SC and CO surveyors observed 54 and 185 consultations, respectively. No serious problems occurred during the SC survey. Performance levels measured by CO were moderately higher than those measured by SCs (median CO - SC difference = 16.4 percentage-points). Survey differences were sometimes much greater for IMCI-trained health workers (median difference = 29.7 percentage-points) than for workers without IMCI training (median difference = 3.1 percentage-points).SC surveys can be done safely with real children if appropriate precautions are taken. CO can introduce moderately large positive biases, and these biases might be greater for health workers exposed to quality improvement interventions.http://clinicaltrials.gov Identifier NCT00510679.

SUBMITTER: Rowe AK

PROVIDER: S-EPMC3541123 | biostudies-literature | 2012 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Evaluating health worker performance in Benin using the simulated client method with real children.

Rowe Alexander K AK Onikpo Faustin F Lama Marcel M Deming Michael S MS

Implementation science : IS 20121008

<h4>Background</h4>The simulated client (SC) method for evaluating health worker performance utilizes surveyors who pose as patients to make surreptitious observations during consultations. Compared to conspicuous observation (CO) by surveyors, which is commonly done in developing countries, SC data better reflect usual health worker practices. This information is important because CO can cause performance to be better than usual. Despite this advantage of SCs, the method's full potential has no ...[more]

PMID: 23043671

Similar Datasets

Project description:BackgroundSuboptimal healthcare quality may be a barrier to achieving child health improvements, yet little is known about the relationship between provider compliance with evidence-based practices and client behavior change. We assess provider compliance in the context of infant and young child feeding (IYCF) counseling, its relationship with client IYCF behaviors in Bangladesh, and explore its potential determinants.MethodsWe use data from a 2017 evaluation of an IYCF program that includes a health worker survey (n = 74), caregiver survey (n = 232), and direct service observation checklists of counseling sessions (n = 232 observations of 74 health workers). We assess the relationship between provider compliance with recommended IYCF counseling topics and behaviors (standardized to a 100-point scale) and three reported IYCF behaviors among clients using multi-level models with random effects at the health worker and sub-district (sampling) levels. We also evaluate whether health worker self-efficacy, satisfaction, and technical knowledge are associated with provider compliance.ResultsHealth worker compliance was significantly associated with reported exclusive breastfeeding for children under 6 months of age (adjusted odds ratio per 1 percentage point increase in counseling compliance score = 1.06, 95% CI 1.01, 1.12) and marginally associated with minimum dietary diversity (adjusted odds ratio per 1 percentage point increase in counseling compliance score = 1.05, 95% CI 1.00, 1.11). Counseling compliance was significantly and positively associated with both health worker self-efficacy and technical knowledge.ConclusionsWe find evidence for an association between health worker compliance and client health behaviors; however, small effect sizes suggest that behavior change is multifactorial and affected by factors beyond care quality. Improvements to technical quality of care may contribute to desired health outcomes; but policies and programs seeking to change health behaviors through counseling may also wish to target upstream factors such as self-efficacy, alongside technical skill-building and knowledge, for maximum impact.

Dataset Information

Evaluating health worker performance in Benin using the simulated client method with real children.

Publications

Evaluating health worker performance in Benin using the simulated client method with real children.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets