Dataset Information

Engaging citizens in the development of a health system performance assessment framework: a case study in Ireland.

ABSTRACT:

Background

The launch in 2017 of the Irish 10-year reform programme Sláintecare represents a key commitment in the future of the health system. An important component of the programme was the development of a health system performance assessment (HSPA) framework. In 2019, the Department of Health of Ireland (DoH) and Health Service Executive (HSE) commissioned the technical support of researchers to develop an outcome-oriented HSPA framework which should reflect the shared priorities of multiple stakeholders, including citizens. This study describes the method applied in the Irish context and reflects on the added value of using a citizen panel in the development of an HSPA framework.

Methods

A panel of 15 citizens was convened, recruited by a third-party company using a sampling strategy to achieve a balanced mix representing the Irish society. Panellists received lay-language preparatory materials before the meeting. Panellists used a three-colour scheme to signal the importance of performance measures. An exit questionnaire was administered to understand how participants experienced being part of the panel. The citizen panel was the first in a series of three panels towards the development of the HSPA framework, followed by panels including representatives of the DoH and HSE, and representatives from professional associations and special interest groups.

Results

The citizen panel generated 249 health performance measures ranging across 13 domains. Top-ranking domains to the citizen panel (people-centredness, coordination of care, and coverage) were less prioritized by the other panels; domains less prioritized by the citizen panel, such as accessibility, responsiveness, efficiency, and effectiveness, were of higher priority in the other panels. Citizen panellists shared a similar understanding of what a citizen panel involves and described their experience at the panel as enjoyable, interesting, and informative.

Conclusions

The priorities of the citizen panel were accounted for during all phases of developing the HSPA framework. This was possible by adopting an inclusive development process and by engaging citizens early on. Citizen engagement in HSPA development is essential for realizing citizen-driven healthcare system performance and generating trust and ownership in performance intelligence. Future research could expand the use of citizen panels to assess, monitor, and report on the performance of healthcare systems.

SUBMITTER: Brito Fernandes O

PROVIDER: S-EPMC8685819 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundUncontrolled hypertension represents a substantial and growing burden in Guatemala and other low and middle-income countries. As a part of the formative phase of an implementation research study, we conducted a needs assessment to define short- and long-term needs and opportunities for hypertension services within the public health system.MethodsWe conducted a multi-method, multi-level assessment of needs related to hypertension within Guatemala's public system using the World Health Organization's health system building blocks framework. We conducted semi-structured interviews with stakeholders at national (n = 17), departmental (n = 7), district (n = 25), and community (n = 30) levels and focus groups with patients (3) and frontline auxiliary nurses (3). We visited and captured data about infrastructure, accessibility, human resources, reporting, medications and supplies at 124 health posts and 53 health centers in five departments of Guatemala. We conducted a thematic analysis of transcribed interviews and focus group discussions supported by matrix analysis. We summarized quantitative data observed during visits to health posts and centers.ResultsMajor challenges for hypertension service delivery included: gaps in infrastructure, insufficient staffing and high turnover, limited training, inconsistent supply of medications, lack of reporting, low prioritization of hypertension, and a low level of funding in the public health system overall. Key opportunities included: prior experience caring for patients with chronic conditions, eagerness from providers to learn, and interest from patients to be involved in managing their health. The 5 departments differ in population served per health facility, accessibility, and staffing. All but 7 health posts had basic infrastructure in place. Enalapril was available in 74% of health posts whereas hydrochlorothiazide was available in only 1 of the 124 health posts. With the exception of one department, over 90% of health posts had a blood pressure monitor.ConclusionsThis multi-level multi-method needs assessment using the building blocks framework highlights contextual factors in Guatemala's public health system that have been important in informing the implementation of a hypertension control trial. Long-term needs that are not addressed within the scope of this study will be important to address to enable sustained implementation and scale-up of the hypertension control approach.

Project description:BACKGROUND:Delivering interventions is the main task of health systems whose accurate measurement is an essential input into tracking performance. Recently, the concept of effective coverage was introduced by World Health Organization to incorporate into health system performance assessment. The aim of present scoping review was mapping the key elements and steps of effective coverage assessment in practical efforts including kinds of interventions, criteria for selecting them and the need, use and quality estimation approaches and strategies of each intervention. METHODS:We conducted a scoping review of health system/program assessments which assessed effective coverage till May 2017. Seven databases were systematically searched with no time and language restriction through applying combined keyword of "effective coverage". RESULTS:Eighteen studies contributed findings on monitoring effective coverage of health interventions and they all were included in the review. Only 4 contributed findings on health system and the others were related to specific intervention(s) assessment. The interventions monitored by effective coverage were mainly in child health, prenatal and antenatal care and delivery, and chronic conditions areas. Potential impact on the burden of disease, leading causes of mortality and morbidity, and high occurrence and prevalence rate were among the main intervention selection criteria. Availability of data was the critical prerequisite, especially, in all of the studies applied ex post approach in estimating effective coverage. Estimation based on a norm, self- reporting from surveys and biomarkers were the main strategies and methods of need, utilization and quality measurement, respectively. CONCLUSIONS:More studies are needed to contribute to the ongoing improvement in the development of effective coverage concept and increasing practical efforts, especially through defining prospective approaches and strategies into estimation of composite measures based on the effective coverage framework. Also, further attention needs to be paid to quality measures of effective coverage in a manner that better conceptualizes and measures the connection between coverage rates and interventions' effectiveness. At the administrative system level, more innovation is needed to develop data systems in order to enhance capacity of routine health service information.

Project description:BACKGROUND:Connected health (CH), as a new paradigm, manages individual and community health in a holistic manner by leveraging a variety of technologies and has the potential for the incorporation of telehealth and integrated care services, covering the whole spectrum of health-related services addressing healthy subjects and chronic patients. The reorganization of services around the person or citizen has been expected to bring high impact in the health care domain. There are a series of concerns (eg, contextual factors influencing the impact of care models, the cost savings associated with CH solutions, and the sustainability of the CH ecosystem) that should be better addressed for CH technologies to reach stakeholders more successfully. Overall, there is a need to effectively establish an understanding of the concepts of CH impact. As services based on CH technologies go beyond standard clinical interventions and assessments of medical devices or medical treatments, the need for standardization and for new ways of measurements and assessments emerges when studying CH impact. OBJECTIVE:This study aimed to introduce the CH impact framework (CHIF) that serves as an approach to assess the impact of CH services. METHODS:This study focused on the subset of CH comprising services that directly address patients and citizens on the management of disease or health and wellness. The CHIF was developed through a multistep procedure and various activities. These included, as initial steps, a literature review and workshop focusing on knowledge elicitation around CH concepts. Then followed the development of the initial version of the framework, refining of the framework with the experts as a result of the second workshop, and, finally, composition and deployment of a questionnaire for preliminary feedback from early-stage researchers in the relevant domains. RESULTS:The framework contributes to a better understanding of what is CH impact and analyzes the factors toward achieving it. CHIF elaborates on how to assess impact in CH services. These aspects can contribute to an impact-aware design of CH services. It can also contribute to a comparison of CH services and further knowledge of the domain. The CHIF is based on 4 concepts, including CH system and service outline, CH system end users, CH outcomes, and factors toward achieving CH impact. The framework is visualized as an ontological model. CONCLUSIONS:The CHIF is an initial step toward identifying methodologies to objectively measure CH impact while recognizing its multiple dimensions and scales.

Project description:BACKGROUND:There is growing evidence that many patients and caregivers innovate by developing new solutions to cope with their health disorders. Given the easy access to vast internet resources and peers globally, it is increasingly important to understand what may influence user innovation and its adoption in health for improving individual well-being and ensuring their safety, in particular, how interactions with peers and physicians or search behavior, along with sociodemographics, may influence the decision to develop a solution or adopt one developed by a peer. OBJECTIVE:The aim of this paper was to study the development and peer-to-peer adoption of user innovations in health care and identify individual-level factors associated with these processes. METHODS:Data were collected via computer-assisted phone survey from a large, random, and representative sample of adult residents in Portugal (N=6204). User innovation questions were added to 1 wave of an ongoing observational, longitudinal, population-based epidemiological study. By asking about individual innovation activity, the sample was split into 3 groups: (1) the developers of health-related solutions for own use (developers), (2) the adopters of solutions developed by other patients or caregivers (peer-to-peer adopters), and (3) the rest of the population. Within the last group, intention to adopt was measured and used as a proxy of future behavior. Regression analysis is used to test the associations. RESULTS:In the population considered in this paper, an estimated 1.3% (75/6008) reported having developed a solution for own use and 3.3% reported to have adopted a solution developed by peers. The 3 groups (developers, adopters, and remaining population) have distinctive characteristics. Gender plays an important role in the solution development, as women are less likely to develop one (odds ratio [OR] 0.4, 95% CI 0.20-0.81; P<.05). Education is positively associated with the development activity (OR 1.13, 95% CI 1.03-1.24; P<.05) but also with the intentions to adopt a peer-developed solution. Search for health-related information is positively associated with the development, adoption, and the intentions to adopt a solution. Interactions with peers over the internet are rare, but in-person interactions are frequent and have a positive association with the dependent variables in all 3 groups. The results also suggest that trust in doctors represents an important dimension that shapes the attitudes of the population toward peer-developed solutions. CONCLUSIONS:This paper demonstrates the importance of the peer community, doctor-patient relationship, citizen's search for information on innovation, and individual attitudes toward peer-to-peer adoption in health care. It stresses the need for a reliable Web-based health-related information and the necessity to deeper understand complex relationships between the need to improve health and fulfill the need and the perception of the health care system.