Dataset Information

Performance of a quality assurance program for assessing dental health in methamphetamine users.

ABSTRACT: Systematic characterization of the dental consequences of methamphetamine (MA) abuse presupposes a rigorous quality assurance (QA) program to ensure the credibility of the data collected and the scientific integrity and validity of the clinical study. In this report we describe and evaluate the performance of a quality assurance program implemented in a large cross-sectional study of the dental consequences of MA use.A large community sample of MA users was recruited over a 30 month period during 2011-13 and received comprehensive oral examinations and psychosocial assessments by site examiners based at two large community health centers in Los Angeles. National Health and Nutrition Examination Survey (NHANES) protocols for oral health assessments were utilized to characterize dental disease. Using NHANES oral health quality assurance guidelines, examiner reliability statistics such as Cohen's Kappa coefficients and inter-class correlation coefficients were calculated to assess the magnitude of agreement between the site examiners and a reference examiner to ensure conformance and comparability with NHANES practices.Approximately 9% (n = 49) of the enrolled 574 MA users received a repeat dental caries and periodontal examination conducted by the reference examiner. There was high concordance between the reference examiner and the site examiners for identification of untreated dental disease (Kappa statistic values: 0.57-0.75, percent agreement 83-88%). For identification of untreated caries on at least 5 surfaces of anterior teeth, the Kappas ranged from 0.77 to 0.87, and percent agreement from 94 to 97%. The intra-class coefficients (ICCs) ranged from 0.87 to 89 for attachment loss across all periodontal sites assessed and the ICCs ranged from 0.79 to 0.81 for pocket depth. For overall gingival recession, the ICCs ranged from 0.88 to 0.91. When Kappa was calculated based on the CDC/AAP case definitions for severe periodontitis, inter-examiner reliability for site examiners was low (Kappa 0.27-0.67).Overall, the quality assurance program confirmed the procedural adherence of the quality of the data collected on the distribution of dental caries and periodontal disease in MA-users. Examiner concordance was higher for dental caries but lower for specific periodontal assessments.

SUBMITTER: Dye BA

PROVIDER: S-EPMC4491420 | biostudies-literature | 2015 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Performance of a quality assurance program for assessing dental health in methamphetamine users.

Dye Bruce A BA Harrell Lauren L Murphy Debra A DA Belin Thomas T Shetty Vivek V

BMC oral health 20150705

<h4>Background</h4>Systematic characterization of the dental consequences of methamphetamine (MA) abuse presupposes a rigorous quality assurance (QA) program to ensure the credibility of the data collected and the scientific integrity and validity of the clinical study. In this report we describe and evaluate the performance of a quality assurance program implemented in a large cross-sectional study of the dental consequences of MA use.<h4>Methods</h4>A large community sample of MA users was rec ...[more]

PMID: 26143495

Similar Datasets

Project description:BACKGROUND:The Clinical Pharmacology Quality Assurance (CPQA) program provides semiannual proficiency testing (PT) of antiretroviral analytes for 11 US and international clinical pharmacology laboratories (CPLs) to ensure interlaboratory comparability. In this article, we provide estimates of the main sources of variability and assess the accuracy of the algorithm for the assessment of performance. METHODS:Descriptive statistics are reported from 13 PT rounds from 2010 to 2016. Eight of the most common antiretroviral analytes were examined. Variance components analysis was used to rank the relative contributions of CPLs, antiretroviral analyte, and concentration category (low, medium, and high) to bias and variability using mixed models. Binary classification metrics of the PT assessment algorithm are calculated in comparison with a model using 95% prediction limits around estimated regression equations. RESULTS:CPLs provided 4109 reported concentrations of 65 unique samples for each of the 8 antiretroviral analytes across 13 PT rounds. Individual CPL accounted for the greatest amount of total variability (4.4%). Individual CPL and analyte combination (interaction) accounted for the greatest amount of bias (8.1%). Analyte alone accounted for 0.5% or less for total variability and bias. Overall, using a ±20% acceptance window around the final target, 97% of individual reported concentrations were scored acceptable, and 96% of antiretroviral/round scores were deemed satisfactory. Comparison with the regression model gave 100% sensitivity but only 34.47% specificity. Narrowing the acceptance window to ±15% improved specificity to 84.47% while maintaining a 99.17% sensitivity. CONCLUSIONS:The current CPQA PT scoring algorithm that use a ±20% acceptance window seems to suffer from a low specificity and may be too lenient. A stricter ±15% acceptance window would increase specificity and overall accuracy while lowering the overall pass rate by only 3%.

Project description:ObjectiveThis is the first large-scale assessment of the implementation of HIV Rapid Test Quality Improvement Initiative in South Africa.MethodsWe used a quasi-experimental one group post-test only design. The intervention implemented starting April 2014 comprised health-care worker training on quality assurance (QA) of HIV rapid testing and enrolment of the facilities in proficiency testing (PT), targeting 2,077 healthcare facilities in 32 high HIV burden districts. Following the intervention, two consecutive rounds of site assessments were undertaken. The first, conducted after a median of 7.5 months following the training, included 1,915 facilities that participated in the QA training, while the second, conducted after a median of one-year following the first-round assessment included 517 (27.0%) of the 1,915 facilities. In both assessments, the Stepwise-Process-for-Improving-the-quality-of-HIV-Rapid-Testing (SPI-RT) checklist was used to score facilities' performance in 7 domains: training, physical facility, safety, pre-testing, testing, post-testing and external quality assessment. Facilities' level of readiness for national certification was assessed.ResultBetween 2016 and 2017, there were four PT cycles. PT participation increased from 32.4% (620/1,915) in 2016 to 91.5% (1,753/1,915) in 2017. In each PT cycle, PT results were returned by 76%-87% of facilities and a satisfactory result (>80%) was achieved by ?95% of facilities. In the SPI-RT assessment, in round-one, 22.3% of facilities were close to or eligible for national certification-this significantly increased to 38.8% in round-two (P-value<0.001). The median SPI-RT score for the domains HIV pre-testing (83.3%) and post-testing (72.2%) remained the same between the two rounds. The median score for the testing domain increased by 5.6% (to 77.8%).ConclusionFacilities performance on the domains that are critical for accuracy of diagnosis (i.e. pre-testing, testing and post-testing) remained largely unchanged. This study provided several recommendations to improve QA implementation in South Africa, including the need to improve routine use of internal quality control for corrective actions.

Project description:BACKGROUND:Cardiovascular diseases (CVDs) are the leading cause of mortality in India. India has rolled out Comprehensive Primary Health Care (CPHC) reforms including population based screening for hypertension and diabetes, facilitated by frontline health workers. Our study assessed blood pressure and blood sugar coverage achieved by frontline workers using Lot Quality Assurance Sampling (LQAS). METHODS:LQAS Supervision Areas were defined as catchments covered by frontline workers in primary health centres in two districts each of Uttar Pradesh and Delhi. In each Area, 19 households for each of four sampling universes (males, females, Above Poverty Line (APL) and Below Poverty Line (BPL)) were visited using probability proportional to size sampling. Following written informed consent procedures, a short questionnaire was administered to individuals aged 30 or older using tablets related to screening for diabetes and hypertension. Using the LQAS hand tally method, coverage across Supervision Areas was determined. RESULTS:A sample of 2052 individuals was surveyed, median ages ranging from 42 to 45?years. Caste affiliation, education levels, and occupation varied by location; the sample was largely married and Hindu. Awareness of and interaction with frontline health workers was reported in Uttar Pradesh and mixed in Delhi. Greater coverage of CVD risk factor screening (especially blood pressure) was seen among females, as compared to males. No clear pattern of inequality was seen by poverty status; some SAs did not have adequate BPL samples. Overall, blood pressure and blood sugar screening coverage by frontline health workers fell short of targeted coverage levels at the aggregate level, but in all sites, at least one area was crossing this threshold level. CONCLUSION:CVD screening coverage levels at this early stage are low. More emphasis may be needed on reaching males. Sex and poverty related inequalities must be addressed by more closely studying the local context and models of service delivery where the threshold of screening is being met. LQAS is a pragmatic method for measuring program inequalities, in resource-constrained settings, although possibly not for spatially segregated population sub-groups.

Project description:BackgroundCommunity health workers (CHWs) play an important role in improving access to services in areas with limited health infrastructure or workforce. Supervision of CHWs by qualified health professionals is the main link between this lay workforce and the formal health system. The quality of services provided by lay health workers is dependent on adequate supportive supervision. It is however one of the weakest links in CHW programs due to logistical and resource constraints, especially in large scale programs. Interventions such as point of care testing using malaria rapid diagnostic tests (RDTs) require real time monitoring to ensure diagnostic accuracy. In this study, we evaluated the utility of a mobile health technology platform to remotely monitor malaria RDT (mRDT) testing by CHWs for quality improvement.MethodsAs part of a large implementation trial involving mRDT testing by CHWs, we introduced the Fionet system composed of a mobile device (Deki Reader, DR) to assist in processing and automated interpretation of mRDTs, which connects to a cloud-based database which captures reports from the field in real time, displaying results in a custom dashboard of key performance indicators. A random sample of 100 CHWs were trained and provided with the Deki Readers and instructed to use it on 10 successive patients. The CHWs interpretation was compared with the Deki Reader's automatic interpretation, with the errors in processing and interpreting the RDTs recorded. After the CHW entered their interpretation on the DR, the DR provided immediate, automated feedback and interpretation based on its reading of the same cassette. The study team monitored the CHW performance remotely and provided additional support.ResultsA total of 1251 primary and 113 repeat tests were performed by the 97 CHWs who used the DR. 91.6% of the tests had agreement between the DR and the CHWs. There were 61 (4.9%) processing and 52 (4.2%) interpretation errors among the primary tests. There was a tendency towards lower odds of errors with increasing number and frequency of tests, though not statistically significant. Of the 62 tests that were repeated due to errors, 79% achieved concordance between the CHW and the DR. Satisfaction with the use of the DR by the CHWs was high.ConclusionsUse of innovative mHealth strategies for monitoring and quality control can ensure quality within a large scale implementation of community level testing by lay health workers.

Project description:BackgroundThe Better Health Outcomes through Mentoring and Assessment (BHOMA) project is a cluster randomized controlled trial aimed at reducing age-standardized mortality rates in three rural districts through involvement of Community Health Workers (CHWs), Traditional Birth Attendants (TBAs), and Neighborhood Health Committees (NHCs). CHWs conduct quarterly surveys on all households using a questionnaire that captures key health events occurring within their catchment population. In order to validate contact with households, we utilize the Lot Quality Assurance Sampling (LQAS) methodology. In this study, we report experiences of applying the LQAS approach to monitor performance of CHWs in Luangwa District.MethodsBetween April 2011 and December 2013, seven health facilities in Luangwa district were enrolled into the BHOMA project. The health facility catchment areas were divided into 33 geographic zones. Quality assurance was performed each quarter by randomly selecting zones representing about 90% of enrolled catchment areas from which 19 households per zone where also randomly identified. The surveys were conducted by CHW supervisors who had been trained on using the LQAS questionnaire. Information collected included household identity number (ID), whether the CHW visited the household, duration of the most recent visit, and what health information was discussed during the CHW visit. The threshold for success was set at 75% household outreach by CHWs in each zone.ResultsThere are 4,616 total households in the 33 zones. This yielded a target of 32,212 household visits by community health workers during the 7 survey rounds. Based on the set cutoff point for passing the surveys (at least 75% households confirmed as visited), only one team of CHWs at Luangwa high school failed to reach the target during round 1 of the surveys; all the teams otherwise registered successful visits in all the surveys.ConclusionsWe have employed the LQAS methodology for assurance that quarterly surveys were successfully done. This methodology proved helpful in identifying poorly performing CHWs and could be useful for evaluating CHW performance in other areas.Trial registrationIdentifier: NCT01942278 . Date of Registration: September 2013.

Dataset Information

Performance of a quality assurance program for assessing dental health in methamphetamine users.

Publications

Performance of a quality assurance program for assessing dental health in methamphetamine users.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets