Exploring data quality and use of the routine health information system in Ethiopia: a mixed-methods study.
Ontology highlight
ABSTRACT: Objective
A routine health information system (RHIS) enables decision making in the healthcare system. We aimed to analyse data quality at the district and regional level and explore factors and perceptions affecting the quality and use of routine data.Design
This was a mixed-methods study. We used the WHO toolkit for analysing data quality and interviewed staff at the point of data generation and along with the flow of data. Data were analysed using the Performance of Routine Information System Management framework.Setting
This study was performed in eight districts in four regions of Ethiopia. The study was nested within a 2-year programme of the Operational Research and Coaching for government Analysts.Participants
We visited 45 health posts, 1 district hospital, 16 health centres and 8 district offices for analysis of routine RHIS data and interviewed 117 staff members for the qualitative assessment.Outcome measures
We assessed availability of source documents, completeness, timeliness and accuracy of reporting of routine data, and explored data quality and use perceptions.Results
There was variable quality of both indicator and data element. Data on maternal health and immunisation were of higher quality than data on child nutrition. Issues ranged from simple organisational factors, such as availability of register books, to intricate technical issues, like complexity of indicators and choice of denominators based on population estimates. Respondents showed knowledge of the reporting procedures, but also demonstrated limited skills, lack of supportive supervision and reporting to please the next level. We saw limited examples of the use of data by the staff who were responsible for data reporting.Conclusion
We identified important organisational, technical, behavioural and process factors that need further attention to improve the quality and use of RHIS data in Ethiopia.
SUBMITTER: Operational Research and Coaching for Analysts (ORCA)- participants & team
PROVIDER: S-EPMC8710857 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Background: Ethiopia is investing in the routine Health Management Information System. Improved routine data are needed for decision-making in the health sector. Objective: To analyse the quality of the routine Health Management Information System data and triangulate with other sources, such as the Demographic and Health Surveys. Methods: We analysed national Health Management Information System data on 19 indicators of maternal health, neonatal survival, immunization, child nutrition, malaria, and tuberculosis over the 2012-2018 time period. The analyses were conducted by 38 analysts from the Ministry of Health, Ethiopia, and two government agencies who participated in the Operational Research and Coaching for Analysts (ORCA) project between June 2018 and June 2020. Using a World Health Organization Data Quality Review toolkit, we assessed indicator definitions, completeness, internal consistency over time and between related indicators, and external consistency compared with other data sources. Results: Several services reported coverage of above 100%. For many indicators, denominators were based on poor-quality population data estimates. Data on individual vaccinations had relatively good internal consistency. In contrast, there was low external consistency for data on fully vaccinated children, with the routine Health Management Information System showing 89% coverage but the Demographic and Health Survey estimate at 39%. Maternal health indicators displayed increasing coverage over time. Indicators on child nutrition, malaria, and tuberculosis were less consistent. Data on neonatal mortality were incomplete and operationalised as mortality on day 0-6. Our comparisons with survey and population projections indicated that one in eight early neonatal deaths were reported in the routine Health Management Information System. Data quality varied between regions. Conclusions: The quality of routine data gathered in the health system needs further attention. We suggest regular triangulation with data from other sources. We recommend addressing the denominator issues, reducing the complexity of indicators, and aligning indicators to international definitions.
| S-EPMC7833046 | biostudies-literature
Project description:BACKGROUND:A routine health information system is one of the essential components of a health system. Interventions to improve routine health information system data quality and use for decision-making in low- and middle-income countries differ in design, methods, and scope. There have been limited efforts to synthesise the knowledge across the currently available intervention studies. Thus, this scoping review synthesised published results from interventions that aimed at improving data quality and use in routine health information systems in low- and middle-income countries. METHOD:We included articles on intervention studies that aimed to improve data quality and use within routine health information systems in low- and middle-income countries, published in English from January 2008 to February 2020. We searched the literature in the databases Medline/PubMed, Web of Science, Embase, and Global Health. After a meticulous screening, we identified 20 articles on data quality and 16 on data use. We prepared and presented the results as a narrative. RESULTS:Most of the studies were from Sub-Saharan Africa and designed as case studies. Interventions enhancing the quality of data targeted health facilities and staff within districts, and district health managers for improved data use. Combinations of technology enhancement along with capacity building activities, and data quality assessment and feedback system were found useful in improving data quality. Interventions facilitating data availability combined with technology enhancement increased the use of data for planning. CONCLUSION:The studies in this scoping review showed that a combination of interventions, addressing both behavioural and technical factors, improved data quality and use. Interventions addressing organisational factors were non-existent, but these factors were reported to pose challenges to the implementation and performance of reported interventions.
| S-EPMC7544093 | biostudies-literature
Project description:BackgroundDespite the improvements in the knowledge and understanding of the role of health information in the global health system, the quality of data generated by a routine health information system is still very poor in low and middle-income countries. There is a paucity of studies as to what determines data quality in health facilities in the study area. Therefore, this study was aimed to assess the quality of routine health information system data and associated factors in public health facilities of Harari region, Ethiopia.MethodsA cross-sectional study was conducted in all public health facilities in the Harari region of Ethiopia. The department-level data were collected from respective department heads through document reviews, interviews, and observation checklists. Descriptive statistics were used to data quality and multivariate logistic regression was run to identify factors influencing data quality. The level of significance was declared at P value < 0.05.ResultThe study found good quality data in 51.35% (95% CI 44.6-58.1) of the departments in public health facilities in the Harari Region. Departments found in the health centers were 2.5 times more likely to have good quality data as compared to those found in the health posts. The presence of trained staffs able to fill reporting formats (AOR = 2.474; 95% CI 1.124-5.445) and provisions of feedbacks (AOR = 3.083; 95% CI 1.549-6.135) were also significantly associated with data quality.ConclusionThe level of good data quality in the public health facilities was less than the expected national level. Lack of trained personnel able to fill the reporting format and feedback were the factors that are found to be affecting data quality. Therefore, training should be provided to increase the knowledge and skills of the health workers. Regular supportive supervision and feedback should also be maintained.
| S-EPMC8524221 | biostudies-literature
Project description:BackgroundRoutine data are increasingly used in randomised controlled trials evaluating healthcare interventions. They can aid participant identification, outcome assessment, and intervention delivery. Randomised implementation trials evaluate the effect of implementation strategies on implementation outcomes. Implementation strategies, such as reminders, are used to increase the uptake of evidence-based interventions into practice, while implementation outcomes, such as adoption, are key measures of the implementation process. The use of routine data in effectiveness trials has been explored; however, there are no reviews on implementation trials. We therefore aimed to describe how routine data have been used in randomised implementation trials and the design characteristics of these trials.MethodsWe searched MEDLINE (Ovid) and Cochrane Central Register of Controlled Trials from Jan 2000 to Dec 2021 and manually searched protocols from trial registers. We included implementation trials and type II and type III hybrid effectiveness-implementation trials conducted using routine data. We extracted quantitative and qualitative data and narratively synthesised findings.ResultsFrom 4206 titles, we included 80 trials, of which 22.5% targeted implementation of evidence-based clinical guidelines. Multicomponent implementation strategies were more commonly evaluated (70.0%) than single strategies. Most trials assessed adoption as the primary outcome (65.0%). The majority of trials extracted data from electronic health records (EHRs) (62.5%), and 91.3% used routine data for outcome ascertainment. Reported reasons for using routine data were increasing efficiency, assessing outcomes, reducing research burden, improving quality of care, identifying study samples, confirming findings, and assessing representativeness. Data quality, the EHR system, research governance, and external factors such as government policy could act either as facilitators or barriers.ConclusionsAdherence to guidance on designing and reporting implementation studies, and specifically to harmonise the language used in describing implementation strategies and implementation outcomes, would aid identification of studies and data extraction. Routine healthcare data are widely used for participant identification, outcome assessment and intervention delivery. Researchers should familiarise themselves with the barriers and facilitators to using routine data, and efforts could be made to improve data quality to overcome some of the barriers.RegistrationPROSPERO CRD42022292321.
| S-EPMC10544368 | biostudies-literature
Project description:BackgroundPatients with co-occurring behavioral health and chronic medical conditions frequently overuse inpatient hospital services. This pattern of overuse contributes to inefficient health care spending. These patients require coordinated care to achieve optimal health outcomes. However, the poor exchange of health-related information between various clinicians renders the delivery of coordinated care challenging. Health information exchanges (HIEs) facilitate health-related information sharing and have been shown to be effective in chronic disease management; however, their effectiveness in the delivery of integrated care is less clear. It is prudent to consider new approaches to sharing both general medical and behavioral health information.ObjectiveThis study aims to identify and describe factors influencing the intention to use behavioral health information that is shared through HIEs.MethodsWe used a mixed methods design consisting of two sequential phases. A validated survey instrument was emailed to clinical and nonclinical staff in Alabama and Oklahoma. The survey captured information about the impact of predictors on the intention to use behavioral health data in clinical decision making. Follow-up interviews were conducted with a subsample of participants to elaborate on the survey results. Partial least squares structural equation modeling was used to analyze survey data. Thematic analysis was used to identify themes from the interviews.ResultsA total of 62 participants completed the survey. In total, 63% (n=39) of the participants were clinicians. Performance expectancy (β=.382; P=.01) and trust (β=.539; P<.001) predicted intention to use behavioral health information shared via HIEs. The interviewees (n=5) expressed that behavioral health information could be useful in clinical decision making. However, privacy and confidentiality concerns discourage sharing this information, which is generally missing from patient records altogether. The interviewees also stated that training for HIE use was not mandatory; the training that was provided did not focus specifically on the exchange of behavioral health information.ConclusionsDespite barriers, individuals are willing to use behavioral health information from HIEs if they believe that it will enhance job performance and if the information being transmitted is trustworthy. The findings contribute to our understanding of the role HIEs can play in delivering integrated care, particularly to vulnerable patients.
| S-EPMC8193493 | biostudies-literature
Project description:A wide array of sophisticated information technology (IT) systems are being used in nursing home (NH) resident care to improve quality. The purpose of the current study was to explore differences in NH IT sophistication, a comprehensive measure of adoption, used in resident care processes based on facility characteristics over 4 consecutive years and to examine the impact on select long-stay NH quality measures. Results indicate IT systems used in resident care are becoming increasingly sophisticated. NH bed size, type of ownership, and location were significant predictors of IT score in areas related to resident care. Results also suggest that as electronic clinical processes and documents increase (e.g., incident reporting, nursing flowsheets, care planning) in resident care, more falls with injury are detected. Continued assessments of NH IT sophistication are important as the impact of technology on quality continues to be evaluated. [Journal of Gerontological Nursing, 46(4), 15-20.].
| S-EPMC9335303 | biostudies-literature
Project description:ObjectivesTo explore the challenges of secondary use of routinely collected data for analyzing nursing-sensitive outcomes in Austrian acute care hospitals.MethodA convergent parallel mixed methods design was performed. We conducted a quantitative representative survey with nursing managers from 32 Austrian general acute care hospitals and 11 qualitative semi-structured interviews with nursing quality management experts. Both results were first analyzed independently and afterward merged in the discussion.ResultsOn average, 76% of nursing documentation is already electronically supported in the surveyed Austrian hospitals. However, existing nursing data is seldom used for secondary purposes such as nursing-sensitive outcome analyses. This is due to four major reasons: First, hospitals often do not have a data strategy for the secondary use of routine data. Second, hospitals partly lack the use of standardized and uniform nursing terminologies, especially for nursing evaluation. Third, routine nursing data is often not documented correctly and completely. Fourth, data on nursing-sensitive outcomes is usually collected in specific documentation forms not integrated into routine documentation.ConclusionThe awareness of the possibilities for secondary use of nursing data for nursing-sensitive outcome analyses in Austrian hospitals is still in its infancy. Therefore, nursing staff and nursing management must be trained to understand how to collect and process nursing data for nursing-sensitive outcome analyses. Further studies would be interesting in order to determine the factors that influence the decision-making processes for the secondary use of nursing data for outcome analyses.
| S-EPMC8766780 | biostudies-literature
Project description:BackgroundSeveral studies have reported inadequate levels of quality of care in the Ethiopian health system. Facility characteristics associated with better quality remain unclear. Understanding associations between patient volumes and quality of care could help organize service delivery and potentially improve patient outcomes.MethodsUsing data from the routine health management information system (HMIS) and the 2014 Ethiopian Service Provision Assessment survey + we assessed associations between daily total outpatient volumes and quality of services. Quality of care at the facility level was estimated as the average of five measures of provider knowledge (clinical vignettes on malaria and tuberculosis) and competence (observations of family planning, antenatal care and sick child care consultations). We used linear regression models adjusted for several facility-level confounders and region fixed effects with log-transformed patient volume fitted as a linear spline. We repeated analyses for the association between volume of antenatal care visits and quality.ResultsOur analysis included 424 facilities including 270 health centers, 45 primary hospitals and 109 general hospitals in Ethiopia. Quality was low across all facilities ranging from only 18 to 56% with a mean score of 38%. Outpatient volume varied from less than one patient per day to 581. We found a small but statistically significant association between volume and quality which appeared non-linear, with an inverted U-shape. Among facilities seeing less than 90.6 outpatients per day, quality increased with greater patient volumes. Among facilities seeing 90.6 or more outpatients per day, quality decreased with greater patient volumes. We found a similar association between volume and quality of antenatal care visits.ConclusionsHealth care utilization and quality must be improved throughout the health system in Ethiopia. Our results are suggestive of a potential U-shape association between volume and quality of primary care services. Understanding the links between volume of patients and quality of care may provide insights for organizing service delivery in Ethiopia and similar contexts.
| S-EPMC8140434 | biostudies-literature
Project description:Health management information system (HMIS) data are important for guiding the attainment of health targets in low- and middle-income countries. However, the quality of HMIS data is often poor. High-quality information is especially important for populations experiencing high burdens of disease and mortality, such as pregnant women, newborns, and children. The purpose of this study was to assess the quality of maternal and child health (MCH) data collected through the Ethiopian Ministry of Health's HMIS in three districts of Jimma Zone, Oromiya Region, Ethiopia over a 12-month period from July 2014 to June 2015. Considering data quality constructs from the World Health Organization's data quality report card, we appraised the completeness, timeliness, and internal consistency of eight key MCH indicators collected for all the primary health care units (PHCUs) located within three districts of Jimma Zone (Gomma, Kersa and Seka Chekorsa). We further evaluated the agreement between MCH service coverage estimates from the HMIS and estimates obtained from a population-based cross-sectional survey conducted with 3,784 women who were pregnant in the year preceding the survey, using Pearson correlation coefficients, intraclass correlation coefficients (ICC), and Bland-Altman plots. We found that the completeness and timeliness of facility reporting were highest in Gomma (75% and 70%, respectively) and lowest in Kersa (34% and 32%, respectively), and observed very few zero/missing values and moderate/extreme outliers for each MCH indicator. We found that the reporting of MCH indicators improved over time for all PHCUs, however the internal consistency between MCH indicators was low for several PHCUs. We found poor agreement between MCH estimates obtained from the HMIS and the survey, indicating that the HMIS may over-report the coverage of key MCH services, namely, antenatal care, skilled birth attendance and postnatal care. The quality of MCH data within the HMIS at the zonal level in Jimma, Ethiopia, could be improved to inform MCH research and programmatic efforts.
| S-EPMC6411115 | biostudies-literature
Project description:BACKGROUND:Substance use by youth remains a significant public health concern. Social media provides the opportunity to discuss and display substance use-related beliefs and behaviors, suggesting that the act of posting drug-related content, or viewing posted content, may influence substance use in youth. This aligns with empirically supported theories, which posit that behavior is influenced by perceptions of normative behavior. Nevertheless, few studies have explored the content of posts by youth related to substance use. OBJECTIVE:This study aimed to identify the beliefs and behaviors of youth related to substance use by characterizing the content of youths' drug-related tweets. Using a sequential explanatory mixed methods approach, we sampled drug-relevant tweets and qualitatively examined their content. METHODS:We used natural language processing to determine the frequency of drug-related words in public tweets (from 2011 to 2015) among youth Twitter users geolocated to Pennsylvania. We limited our sample by age (13-24 years), yielding approximately 23 million tweets from 20,112 users. We developed a list of drug-related keywords and phrases and selected a random sample of tweets with the most commonly used keywords to identify themes (n=249). RESULTS:We identified two broad classes of emergent themes: functional themes and relational themes. Functional themes included posts that explicated a function of drugs in one's life, with subthemes indicative of pride, longing, coping, and reminiscing as they relate to drug use and effects. Relational themes emphasized a relational nature of substance use, capturing substance use as a part of social relationships, with subthemes indicative of drug-related identity and companionship. We also identified topical areas in tweets related to drug use, including reference to polysubstance use, pop culture, and antidrug content. Across the tweets, the themes of pride (63/249, 25.3%) and longing (39/249, 15.7%) were the most popular. Most tweets that expressed pride (46/63, 73%) were explicitly related to marijuana. Nearly half of the tweets on coping (17/36, 47%) were related to prescription drugs. Very few of the tweets contained antidrug content (9/249, 3.6%). CONCLUSIONS:Data integration indicates that drugs are typically discussed in a positive manner, with content largely reflective of functional and relational patterns of use. The dissemination of this information, coupled with the relative absence of antidrug content, may influence youth such that they perceive drug use as normative and justified. Strategies to address the underlying causes of drug use (eg, coping with stressors) and engage antidrug messaging on social media may reduce normative perceptions and associated behaviors among youth. The findings of this study warrant research to further examine the effects of this content on beliefs and behaviors and to identify ways to leverage social media to decrease substance use in this population.
| S-EPMC7146240 | biostudies-literature