Project description:Background: Ethiopia is investing in the routine Health Management Information System. Improved routine data are needed for decision-making in the health sector. Objective: To analyse the quality of the routine Health Management Information System data and triangulate with other sources, such as the Demographic and Health Surveys. Methods: We analysed national Health Management Information System data on 19 indicators of maternal health, neonatal survival, immunization, child nutrition, malaria, and tuberculosis over the 2012-2018 time period. The analyses were conducted by 38 analysts from the Ministry of Health, Ethiopia, and two government agencies who participated in the Operational Research and Coaching for Analysts (ORCA) project between June 2018 and June 2020. Using a World Health Organization Data Quality Review toolkit, we assessed indicator definitions, completeness, internal consistency over time and between related indicators, and external consistency compared with other data sources. Results: Several services reported coverage of above 100%. For many indicators, denominators were based on poor-quality population data estimates. Data on individual vaccinations had relatively good internal consistency. In contrast, there was low external consistency for data on fully vaccinated children, with the routine Health Management Information System showing 89% coverage but the Demographic and Health Survey estimate at 39%. Maternal health indicators displayed increasing coverage over time. Indicators on child nutrition, malaria, and tuberculosis were less consistent. Data on neonatal mortality were incomplete and operationalised as mortality on day 0-6. Our comparisons with survey and population projections indicated that one in eight early neonatal deaths were reported in the routine Health Management Information System. Data quality varied between regions. Conclusions: The quality of routine data gathered in the health system needs further attention. We suggest regular triangulation with data from other sources. We recommend addressing the denominator issues, reducing the complexity of indicators, and aligning indicators to international definitions.

Project description:Mortality statistics form a crucial component of national Health Management Information Systems (HMIS). However, there are limitations in the availability and quality of mortality data at national level in Viet Nam. This study assessed the completeness of recorded deaths and the reliability of recorded causes of death (COD) in the A6 death registers in the national routine HMIS in Viet Nam.1477 identified deaths in 2014 were reviewed in two provinces. A capture-recapture method was applied to assess the completeness of the A6 death registers. 1365 household verbal autopsy (VA) interviews were successfully conducted, and these were reviewed by physicians who assigned multiple and underlying cause of death (UCOD). These UCODs from VA were then compared with the CODs recorded in the A6 death registers, using kappa scores to assess the reliability of the A6 death register diagnoses. The overall completeness of the A6 death registers in the two provinces was 89.3% (95%CI: 87.8-90.8). No COD recorded in the A6 death registers demonstrated good reliability. There is very low reliability in recording of cardiovascular deaths (kappa for stroke = 0.47 and kappa for ischaemic heart diseases = 0.42) and diabetes (kappa = 0.33). The reporting of deaths due to road traffic accidents, HIV and some cancers are at a moderate level of reliability with kappa scores ranging between 0.57-0.69 (p<0.01). VA methods identify more specific COD than the A6 death registers, and also allow identification of multiple CODs.The study results suggest that data completeness in HMIS A6 death registers in the study sample of communes was relatively high (nearly 90%), but triangulation with death records from other sources would improve the completeness of this system. Further, there is an urgent need to enhance the reliability of COD recorded in the A6 death registers, for which VA methods could be effective. Focussed consultation among stakeholders is needed to develop a suitable mechanism and process for integrating VA methods into the national routine HMIS A6 death registers in Viet Nam.

Project description:BackgroundSound policy, resource allocation and day-to-day management decisions in the health sector require timely information from routine health information systems (RHIS). In most low- and middle-income countries, the RHIS is viewed as being inadequate in providing quality data and continuous information that can be used to help improve health system performance. In addition, there is limited evidence on the effectiveness of RHIS strengthening interventions in improving data quality and use. The purpose of this study is to evaluate the usefulness of the newly developed Performance of Routine Information System Management (PRISM) framework, which consists of a conceptual framework and associated data collection and analysis tools to assess, design, strengthen and evaluate RHIS. The specific objectives of the study are: a) to assess the reliability and validity of the PRISM instruments and b) to assess the validity of the PRISM conceptual framework.MethodsFacility- and worker-level data were collected from 110 health care facilities in twelve districts in Uganda in 2004 and 2007 using records reviews, structured interviews and self-administered questionnaires. The analysis procedures include Cronbach's alpha to assess internal consistency of selected instruments, test-retest analysis to assess the reliability and sensitivity of the instruments, and bivariate and multivariate statistical techniques to assess validity of the PRISM instruments and conceptual framework.ResultsCronbach's alpha analysis suggests high reliability (0.7 or greater) for the indices measuring a promotion of a culture of information, RHIS tasks self-efficacy and motivation. The study results also suggest that a promotion of a culture of information influences RHIS tasks self-efficacy, RHIS tasks competence and motivation, and that self-efficacy and the presence of RHIS staff have a direct influence on the use of RHIS information, a key aspect of RHIS performance.ConclusionsThe study results provide some empirical support for the reliability and validity of the PRISM instruments and the validity of the PRISM conceptual framework, suggesting that the PRISM approach can be effectively used by RHIS policy makers and practitioners to assess the RHIS and evaluate RHIS strengthening interventions. However, additional studies with larger sample sizes are needed to further investigate the value of the PRISM instruments in exploring the linkages between RHIS data quality and use, and health systems performance.

Project description:Implementation of a National Health Insurance (NHI) in South Africa requires a reliable, standardized health information system that supports Diagnosis-Related Groupers for reimbursements and resource management. We assessed the quality of inpatient health records, the availability of standard discharge summaries and coded clinical data and the congruence between inpatient health records and discharge summaries in public-sector hospitals to support the NHI implementation in terms of reimbursement and resource management. We undertook a cross-sectional health-records review from 45 representative public hospitals consisting of seven tertiary, 10 regional and 28 district hospitals in 10 NHI pilot districts representing all nine provinces. Data were abstracted from a randomly selected sample of 5795 inpatient health records from the surgical, medical, obstetrics and gynaecology, paediatrics and psychiatry departments. Quality was assessed for 10 pre-defined data elements relevant to NHI reimbursements, by comparing information in source registers, patient folders and discharge summaries for patients admitted in March and July 2015. Cohen's/Fleiss' kappa coefficients (κ) were used to measure agreements between the sources. While 3768 (65%) of the 5795 inpatient-level records contained a discharge summary, less than 835 (15%) of diagnoses were coded using ICD-10 codes. Despite most of the records having correct patient identifiers [κ: 0.92; 95% confidence interval (CI) 0.91-0.93], significant inconsistencies were observed between the registers, patient folders and discharge summaries for some data elements: attending physician's signature (κ: 0.71; 95% CI 0.67-0.75); results of the investigation (κ: 0.71; 95% CI 0.69-0.74); patient's age (κ: 0.72; 95% CI 0.70-0.74); and discharge diagnosis (κ: 0.92; 95% CI 0.90-0.94). The strength of agreement for all elements was statistically significant (P-value ≤ 0.001). The absence of coded inpatient diagnoses and identified data inaccuracies indicates that existing routine health information systems in public-sector hospitals in the NHI pilot districts are not yet able to sufficiently support reimbursements and resource management. Institutional capacity is needed to undertake diagnostic coding, improve data quality and ensure that a standard discharge summary is completed for every inpatient.

Project description:BackgroundThe quality of data in national health information systems has been questionable in most developing countries. However, the mechanisms of errors in the case identification process are not fully understood. This study aimed to investigate the mechanisms of errors in the case identification process in the existing routine health information system (RHIS) in the Philippines by measuring the risk of committing errors for health program indicators used in the Field Health Services Information System (FHSIS 1996), and characterizing those indicators accordingly.MethodsA structured questionnaire on the definitions of 12 selected indicators in the FHSIS was administered to 132 health workers in 14 selected municipalities in the province of Palawan. A proportion of correct answers (difficulty index) and a disparity of two proportions of correct answers between higher and lower scored groups (discrimination index) were calculated, and the patterns of wrong answers for each of the 12 items were abstracted from 113 valid responses.ResultsNone of 12 items reached a difficulty index of 1.00. The average difficulty index of 12 items was 0.266 and the discrimination index that showed a significant difference was 0.216 and above. Compared with these two cut-offs, six items showed non-discrimination against lower difficulty indices of 0.035 (4/113) to 0.195 (22/113), two items showed a positive discrimination against lower difficulty indices of 0.142 (16/113) and 0.248 (28/113), and four items showed a positive discrimination against higher difficulty indices of 0.469 (53/113) to 0.673 (76/113).ConclusionsThe results suggest three characteristics of definitions of indicators such as those that are (1) unsupported by the current conditions in the health system, i.e., (a) data are required from a facility that cannot directly generate the data and, (b) definitions of indicators are not consistent with its corresponding program; (2) incomplete or ambiguous, which allow several interpretations; and (3) complete yet easily misunderstood by health workers.Taking systemic factors into account, the case identification step needs to be reviewed and designed to generate intended data in health information systems.

Project description:BackgroundDespite increasing importance being laid on use of routine data for decision making in India, it has frequently been reported to be riddled with problems. Evidence suggests lack of quality in the health management information system (HMIS), however there is no robust analysis to assess the extent of its inaccuracy. We aim to bridge this gap in evidence by assessing the extent of completeness and quality of HMIS in Haryana state of India.MethodsData on utilization of key maternal and child health (MCH) services were collected using a cross-sectional household survey from 4807 women in 209 Sub-Centre (SC) areas across all 21 districts of Haryana state. Information for same services was also recorded from HMIS records maintained by auxiliary nurse midwives (ANMs) at SCs to check under- or over-recording (Level 1 discordance). Data on utilisation of MCH services from SC ANM records, for a subset of the total women covered in the household survey, were also collected and compared with monthly reports submitted by ANMs to assess over-reporting while report preparation (Level 2 discordance) to paint the complete picture for quality and completeness of routine HMIS.ResultsCompleteness of ANM records for various MCH services ranged from 73% for DPT1 vaccination dates to 94.6% for dates of delivery. Average completeness level for information recorded in HMIS was 88.5%. Extent of Level 1 discordance for iron-folic acid (IFA) supplementation, 3 or more ante-natal care (ANC) visits and 2 Tetanus toxoid (TT) injections was 41%, 16% and 2% respectively. In 48.2% cases, respondents from community as well as HMIS records reported at least one post-natal care (PNC) home visit by ANM. Extent of Level 2 discordance ranged from 1.6% to 6%. These figures were highest for number of women who completed IFA supplementation, contraceptive intra-uterine device insertion and provision of 2nd TT injection during ANC.ConclusionsHMIS records for MCH services at sub-centre level in Haryana state were satisfactory in terms of completeness. However, there were significant differences in terms of reported and evaluated coverage of MCH services. Quality of HMIS needs to be improved in order to make it relevant for public health program planning and research.

Dataset Information

Routine Health Information System (RHIS) improvements for strengthened health system management.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets