Dataset Information

Use of standardised patients to assess quality of tuberculosis care: a pilot, cross-sectional study.

ABSTRACT: Existing studies of the quality of tuberculosis care have relied on recall-based patient surveys, questionnaire surveys of knowledge, and prescription or medical record analysis, and the results mostly show the health-care provider's knowledge rather than actual practice. No study has used standardised patients to assess clinical practice. Therefore we aimed to assess quality of care for tuberculosis using such patients.We did a pilot, cross-sectional validation study of a convenience sample of consenting private health-care providers in low-income and middle-income areas of Delhi, India. We recruited standardised patients in apparently good health from the local community to present four cases (two of presumed tuberculosis and one each of confirmed tuberculosis and suspected multidrug-resistant tuberculosis) to a randomly allocated health-care provider. The key objective was to validate the standardised-patient method using three criteria: negligible risk and ability to avoid adverse events for providers and standardised patients, low detection rates of standardised patients by providers, and data accuracy across standardised patients and audio verification of standardised-patient recall. We also used medical vignettes to assess providers' knowledge of presumed tuberculosis. Correct case management was benchmarked using Standards for Tuberculosis Care in India (STCI).Between Feb 2, and March 28, 2014, we recruited and trained 17 standardised patients who had 250 interactions with 100 health-care providers, 29 of whom were qualified in allopathic medicine (ie, they had a Bachelor of Medicine & Surgery [MBBS] degree), 40 of whom practised alternative medicine, and 31 of whom were informal health-care providers with few or no qualifications. The interactions took place between April 1, and April 23, 2014. The proportion of detected standardised patients was low (11 [5%] detected out of 232 interactions among providers who completed the follow-up survey), and standardised patients' recall correlated highly with audio recordings (r=0·63 [95% CI 0·53-0·79]), with no safety concerns reported. The mean consultation length was 6 min (95% CI 5·5-6·6) with a mean of 6·18 (5·72-6·64) questions or examinations completed, representing 35% (33-38) of essential checklist items. Across all cases, only 52 (21% [16-26]) of 250 were correctly managed. Correct management was higher among MBBS-qualified doctors than other types of health-care provider (adjusted odds ratio 2·41 [95% CI 1·17-4·93]; p=0·0166). Of the 69 providers who completed the vignette, knowledge in the vignettes was more consistent with STCI than their actual clinical practice-eg, 50 (73%) ordered a chest radiograph or sputum test during the vignette compared with seven (10%) during the standardised-patient interaction; OR 0·04 (95% CI 0·02-0·11); p<0·0001.Standardised patients can be successfully implemented to assess tuberculosis care. Our data suggest a big gap between private provider knowledge and practice. Additional work is needed to substantiate our pilot data, understand the know-do gap in provider behaviour, and to identify the best approach to measure and improve the quality of tuberculosis care in India.Grand Challenges Canada, the Bill & Melinda Gates Foundation, Knowledge for Change Program, and the World Bank Development Research Group.

SUBMITTER: Das J

PROVIDER: S-EPMC4633317 | biostudies-literature | 2015 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Use of standardised patients to assess quality of tuberculosis care: a pilot, cross-sectional study.

Das Jishnu J Kwan Ada A Daniels Benjamin B Satyanarayana Srinath S Subbaraman Ramnath R Bergkvist Sofi S Das Ranendra K RK Das Veena V Pai Madhukar M

The Lancet. Infectious diseases 20150809 11

<h4>Background</h4>Existing studies of the quality of tuberculosis care have relied on recall-based patient surveys, questionnaire surveys of knowledge, and prescription or medical record analysis, and the results mostly show the health-care provider's knowledge rather than actual practice. No study has used standardised patients to assess clinical practice. Therefore we aimed to assess quality of care for tuberculosis using such patients.<h4>Methods</h4>We did a pilot, cross-sectional validatio ...[more]

PMID: 26268690

Similar Datasets

Project description:BackgroundIndia's total antibiotic use is the highest of any country. Patients often receive prescription-only drugs directly from pharmacies. Here we aimed to assess the medical advice and drug dispensing practices of pharmacies for standardised patients with presumed and confirmed tuberculosis in India.MethodsIn this cross-sectional study in the three Indian cities Delhi, Mumbai, and Patna, we developed two standardised patient cases: first, a patient presenting with 2-3 weeks of pulmonary tuberculosis symptoms (Case 1); and second, a patient with microbiologically confirmed pulmonary tuberculosis (Case 2). Standardised patients were scheduled to present each case once to sampled pharmacies. We defined ideal management for both cases a priori as referral to a health-care provider without dispensing antibiotics or steroids or both.FindingsBetween April 1, 2014, and Nov 29, 2015, we sampled 622 pharmacies in Delhi, Mumbai, and Patna. Standardised patients completed 1200 (96%) of 1244 interactions. We recorded ideal management (defined as referrals without the use of antibiotics or steroids) in 80 (13%) of 599 Case 1 interactions (95% CI 11-16) and 372 (62%) of 601 Case 2 interactions (95% CI 58-66). Antibiotic use was significantly lower in Case 2 interactions (98 [16%] of 601, 95% CI 13-19) than in Case 1 (221 [37%] of 599, 95% CI 33-41). First-line anti-tuberculosis drugs were not dispensed in any city. The differences in antibiotic or steroid use and number of medicines dispensed between Case 1 and Case 2 were almost entirely attributable to the difference in referral behaviour.InterpretationOnly some urban Indian pharmacies correctly managed patients with presumed tuberculosis, but most correctly managed a case of confirmed tuberculosis. No pharmacy dispensed anti-tuberculosis drugs for either case. Absence of a confirmed diagnosis is a key driver of antibiotic misuse and could inform antimicrobial stewardship interventions.FundingGrand Challenges Canada, Bill & Melinda Gates Foundation, Knowledge for Change Program, and World Bank Development Research Group.

Project description:As the first point of care for many healthcare seekers, private pharmacies play an important role in tuberculosis (TB) care. However, previous studies in India have showed that private pharmacies commonly dispense symptomatic treatments and broad-spectrum antibiotics over-the-counter (OTC), rather than referring patients for TB testing. Such inappropriate management by pharmacies can delaye TB diagnosis. We assessed medical advice and OTC drug dispensing practices of pharmacists for standardized patients presenting with classic symptoms of pulmonary TB (case 1) and for those with sputum smear positive pulmonary TB (case 2), and examined how practices have changed over time in an urban Indian site. We examined how and whether private pharmacies improved practices for TB in 2019 compared to a baseline study conducted in 2015 in the city of Patna, using the same survey sampling techniques and study staff. The proportion of patient-pharmacist interactions that resulted in correct or ideal management, as well as the proportion of interactions resulting in antibiotic, quinolone, and corticosteroid are presented, with standard errors clustered at the provider level. To assess the difference in case management and the use of drugs across the two cases by round, a difference in difference (DiD) model was employed. A total of 936 SP interactions were completed over both rounds of survey. Our results indicate that across both rounds of data collection, 331 of 936 (35%; 95% CI: 32-38%) of interactions were correctly managed. At baseline, 215 of 500 (43%; 95% CI: 39-47%) of interactions were correctly managed whereas 116 of 436 (27%; 95% CI: 23-31%) were correctly managed in the second round of data collection. Ideal management, where in addition to a referral, patients were not prescribed any potentially harmful medications, was seen in 275 of 936 (29%; 95% CI: 27-32%) of interactions overall, with 194 of 500 (39%; 95% CI: 35-43%) of interactions at baseline and 81 of 436 (19%; 95% CI: 15-22%) in round 2. No private pharmacy dispensed anti-TB medications without a prescription. On average, the difference in correct case management between case 1 vs. case 2 dropped by 20 percent points from baseline to the second round of data collection. Similarly, ideal case management decreased by 26 percentage points between rounds. This is in contrast with the dispensation of medicines, which had the opposite effect between rounds; the difference in dispensation of quinolones between case 1 and case 2 increased by 14 percentage points, as did corticosteroids by 9 percentage points, antibiotics by 25 percentage points and medicines generally by 30 percentage points. Our standardised patient study provides valuable insights into how private pharmacies in an Indian city changed their management of patients with TB symptoms or with confirmed TB over a 5-year period. We saw that overall, private pharmacy performance has weakened over time. However, no OTC dispensation of anti-TB medications occurred in either survey round. As the first point of contact for many care seekers, continued and sustained efforts to engage with Indian private pharmacies should be prioritized.

Project description:IntroductionThere are 161 million people living with vision impairment, due to uncorrected refractive errors. A further 510 million people are living with near-vision impairment. There is a need for clearly defined indicators that capture the quality of refractive error service outputs and outcomes and provide insights to shape, change and stimulate action. This study aims to evaluate the quality of refractive error care (Q.REC) in Cambodia, Malaysia and Pakistan, by using unannounced standardised patients (USPs) to identify the proportion of prescribed and dispensed spectacles appropriate for people's refractive error needs and pinpoint/detail opportunities for quality improvement.Method and analysisA cross-sectional Q.REC study will be conducted in randomly selected optical services in Cambodia (180 services, 900 USP visits), the Klang Valley in Malaysia (66 services, 198 USP visits) and in Jhang, Sahiwal and Khanewal districts of Punjab region/state in Pakistan (64 services, 256 USP visits). USPs will receive baseline refractions by three skilled study optometrists/refractionists trained in the Q.REC protocol. USPs will then visit individual optical services, undergo a refraction, purchase spectacles or lenses (if recommended) and record observations about which elements of a refraction and dispensing were conducted. The study optometrist/refractionist will assess each pair of dispensed spectacles by examining the USP's aided visual acuity and visual comfort at distance and/or near and compare the lens prescription to the averaged baseline refraction.Ethics and disseminationThis study has been approved by the University of New South Wales Human Research Ethics Committee (HC210102), the National Ethics Committee for Health Research in Cambodia (043 NECHR), National Medical Research Registry and the Medical Research and Ethics Committee (NMRR-21-689-59279) in Malaysia and the College of Ophthalmology & Allied Vision Sciences Ethical Review Board (COAVS 545/2021) in Pakistan. Written informed consent will be obtained from USPs. Service owners will have the opportunity to opt-out verbally or in writing. Results will be disseminated locally through workshops including the relevant local ministry of health personnel and stakeholders, published in peer-reviewed publications and presented at national and international conferences.

Project description:BACKGROUND:Medical records play a fundamental role in healthcare delivery, quality assessment and improvement. However, there is little objective evidence on the quality of medical records in low and middle-income countries. OBJECTIVE:To provide an unbiased assessment of the quality of medical records for outpatient visits to rural facilities in China. METHODS:A sample of 207 township health facilities across three provinces of China were enrolled. Unannounced standardised patients (SPs) presented to providers following standardised scripts. Three weeks later, investigators returned to collect medical records from each facility. Audio recordings of clinical interactions were then used to evaluate completeness and accuracy of available medical records. RESULTS:Medical records were located for 210 out of 620 SP visits (33.8%). Of those located, more than 80% contained basic patient information and drug treatment when mentioned in visits, but only 57.6% recorded diagnoses. The most incompletely recorded category of information was patient symptoms (74.3% unrecorded), followed by non-drug treatments (65.2% unrecorded). Most of the recorded information was accurate, but accuracy fell below 80% for some items. The keeping of any medical records was positively correlated with the provider's income (? 0.05, 95% CI 0.01 to 0.09). Providers at hospitals with prescription review were less likely to record completely (? -0.87, 95% CI -1.68 to 0.06). Significant variation by disease type was also found in keeping of any medical record and completeness. CONCLUSION:Despite the importance of medical records for health system functioning, many rural facilities have yet to implement systems for maintaining patient records, and records are often incomplete when they exist. Prescription review tied to performance evaluation should be implemented with caution as it may create disincentives for record keeping. Interventions to improve record keeping and management are needed.

Project description:BackgroundIndia has the highest burden of tuberculosis (TB). Although most patients with TB in India seek care from the private sector, there is limited evidence on quality of TB care or its correlates. Following our validation study on the standardized patient (SP) method for TB, we utilized SPs to examine quality of adult TB care among health providers with different qualifications in 2 Indian cities.Methods and findingsDuring 2014-2017, pilot programs engaged the private health sector to improve TB management in Mumbai and Patna. Nested within these projects, to obtain representative, baseline measures of quality of TB care at the city level, we recruited 24 adults to be SPs. They were trained to portray 4 TB "case scenarios" representing various stages of disease and diagnostic progression. Between November 2014 and August 2015, the SPs visited representatively sampled private providers stratified by qualification: (1) allopathic providers with Bachelor of Medicine, Bachelor of Surgery (MBBS) degrees or higher and (2) non-MBBS providers with alternative medicine, minimal, or no qualifications. Our main outcome was case-specific correct management benchmarked against the Standards for TB Care in India (STCI). Using ANOVA, we assessed variation in correct management and quality outcomes across (a) cities, (b) qualifications, and (c) case scenarios. Additionally, 2 micro-experiments identified sources of variation: first, quality in the presence of diagnostic test results certainty and second, provider consistency for different patients presenting the same case. A total of 2,652 SP-provider interactions across 1,203 health facilities were analyzed. Based on our sampling strategy and after removing 50 micro-experiment interactions, 2,602 interactions were weighted for city-representative interpretation. After weighting, the 473 Patna providers receiving SPs represent 3,179 eligible providers in Patna; in Mumbai, the 730 providers represent 7,115 eligible providers. Correct management was observed in 959 out of 2,602 interactions (37%; 35% weighted; 95% CI 32%-37%), primarily from referrals and ordering chest X-rays (CXRs). Unnecessary medicines were given to nearly all SPs, and antibiotic use was common. Anti-TB drugs were prescribed in 118 interactions (4.5%; 5% weighted), of which 45 were given in the case in which such treatment is considered correct management. MBBS and more qualified providers had higher odds of correctly managing cases than non-MBBS providers (odds ratio [OR] 2.80; 95% CI 2.05-3.82; p < 0.0001). Mumbai non-MBBS providers had higher odds of correct management than non-MBBS in Patna (OR 1.79; 95% CI 1.06-3.03), and MBBS providers' quality of care did not vary between cities (OR 1.15; 95% CI 0.79-1.68; p = 0.4642). In the micro-experiments, improving diagnostic certainty had a positive effect on correct management but not across all quality dimensions. Also, providers delivered idiosyncratically consistent care, repeating all observed actions, including mistakes, approximately 75% of the time. The SP method has limitations: it cannot account for patient mix or care-management practices reflecting more than one patient-provider interaction.ConclusionsQuality of TB care is suboptimal and variable in urban India's private health sector. Addressing this is critical for India's plans to end TB by 2025. For the first time, we have rich measures on representative levels of care quality from 2 cities, which can inform private-sector TB interventions and quality-improvement efforts.

Project description:IntroductionSocial risks (e.g., food/transportation insecurity) can hamper type 2 diabetes mellitus (T2DM) self-management, leading to poor outcomes. To determine the extent to which high-quality care can overcome social risks' health impacts, this study assessed the associations between reported social risks, receipt of guideline-based T2DM care, and T2DM outcomes when care is up to date among community health center patients.MethodsA cross-sectional study of adults aged ≥18 years (N=73,484) seen at 186 community health centers, with T2DM and ≥1 year of observation between July 2016 and February 2020. Measures of T2DM care included up-to-date HbA1c, microalbuminuria, low-density lipoprotein screening, and foot examination, and active statin prescription when indicated. Measures of T2DM outcomes among patients with up-to-date care included blood pressure, HbA1c, and low-density lipoprotein control on or within 6‒12 months of an index encounter. Analyses were conducted in 2021.ResultsIndividuals reporting transportation or housing insecurity were less likely to have up-to-date low-density lipoprotein screening; no other associations were seen between social risks and clinical care quality. Among individuals with up-to-date care, food insecurity was associated with lower adjusted rates of controlled HbA1c (79% vs 75%, p<0.001), and transportation insecurity was associated with lower rates of controlled HbA1c (79% vs 74%, p=0.005), blood pressure (74% vs 72%, p=0.025), and low-density lipoprotein (61% vs 57%, p=0.009) than among those with no reported need.ConclusionsCommunity health center patients received similar care regardless of the presence of social risks. However, even among those up to date on care, social risks were associated with worse T2DM control. Future research should identify strategies for improving HbA1c control for individuals with social risks.Trial registrationThis study is registered at www.Clinicaltrialsgov NCT03607617.

Dataset Information

Use of standardised patients to assess quality of tuberculosis care: a pilot, cross-sectional study.

Publications

Use of standardised patients to assess quality of tuberculosis care: a pilot, cross-sectional study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets