Building capacity for evidence informed decision making in public health: a case study of organizational change.
Ontology highlight
ABSTRACT:
SUBMITTER: Peirson L
PROVIDER: S-EPMC3305606 | biostudies-literature | 2012 Feb
REPOSITORIES: biostudies-literature
Publications
Building capacity for evidence informed decision making in public health: a case study of organizational change.
Peirson Leslea L Ciliska Donna D Dobbins Maureen M Mowat David D
BMC public health 20120220
<h4>Background</h4>Core competencies for public health in Canada require proficiency in evidence informed decision making (EIDM). However, decision makers often lack access to information, many workers lack knowledge and skills to conduct systematic literature reviews, and public health settings typically lack infrastructure to support EIDM activities. This research was conducted to explore and describe critical factors and dynamics in the early implementation of one public health unit's strateg ...[more]
Similar Datasets
Project description:BackgroundPublic health professionals are increasingly expected to engage in evidence-informed decision making to inform practice and policy decisions. Evidence-informed decision making involves the use of research evidence along with expertise, existing public health resources, knowledge about community health issues, the local context and community, and the political climate. The National Collaborating Centre for Methods and Tools has identified a seven step process for evidence-informed decision making. Tools have been developed to support public health professionals as they work through each of these steps. This paper provides an overview of tools used in three Canadian public health departments involved in a study to develop capacity for evidence-informed decision making.MethodsAs part of a knowledge translation and exchange intervention, a Knowledge Broker worked with public health professionals to identify and apply tools for use with each of the steps of evidence-informed decision making. The Knowledge Broker maintained a reflective journal and interviews were conducted with a purposive sample of decision makers and public health professionals. This paper presents qualitative analysis of the perceived usefulness and usability of the tools.ResultsTools were used in the health departments to assist in: question identification and clarification; searching for the best available research evidence; assessing the research evidence for quality through critical appraisal; deciphering the 'actionable message(s)' from the research evidence; tailoring messages to the local context to ensure their relevance and suitability; deciding whether and planning how to implement research evidence in the local context; and evaluating the effectiveness of implementation efforts. Decision makers provided descriptions of how the tools were used within the health departments and made suggestions for improvement. Overall, the tools were perceived as valuable for advancing and sustaining evidence-informed decision making.ConclusionTools are available to support the process of evidence-informed decision making among public health professionals. The usability and usefulness of these tools for advancing and sustaining evidence-informed decision making are discussed, including recommendations for the tools' application in other public health settings beyond this study. Knowledge and awareness of these tools may assist other health professionals in their efforts to implement evidence-informed practice.
| S-EPMC4223550 | biostudies-literature
Project description:Sports clubs increasingly are settings for health promotion initiatives. This study explored organizational change processes and perceived facilitators and barriers relevant to implementing a health promotion initiative within gymnastics settings in New South Wales (NSW), Australia. A multiple-case design investigated the experiences of the state association (Gymnastics NSW) and five clubs from one region of NSW in a participatory Health-Promoting Gymnastics Clubs (HPGC) program. The program aimed to build the capacity of Gymnastics NSW to support affiliated clubs to become health-promoting settings. Interviews with organizational representatives explored their experiences of the program and identified factors that enabled or inhibited program adoption, implementation and sustainability. Facilitators and barriers identified included leadership and champions; organizational capacity and culture; priorities and timing; and characteristics of the HPGC framework. This multi-level, organizational change intervention demonstrated potential to create health-promoting gymnastics settings. Tailoring strategies in diverse club contexts required involvement of organizational leaders in program development and action planning. Despite positive impacts, pre-existing organizational culture inhibited integration of health promotion as a core value. Sustained organizational change may result from professional regulatory requirements (e.g., accreditation and affiliation), and policy directives and funding (for organizational change, not program delivery) from relevant government departments.
| S-EPMC8297274 | biostudies-literature
Project description:While increasing attention is placed on using evidence-based decision making (EBDM) to improve public health, there is little research assessing the current EBDM capacity of the public health workforce. Public health agencies serve a wide range of populations with varying levels of resources. Our survey tool allows an individual agency to collect data that reflects its unique workforce.Health department leaders and academic researchers collaboratively developed and conducted cross-sectional surveys in Kansas and Mississippi (USA) to assess EBDM capacity. Surveys were delivered to state- and local-level practitioners and community partners working in chronic disease control and prevention. The core component of the surveys was adopted from a previously tested instrument and measured gaps (importance versus availability) in competencies for EBDM in chronic disease. Other survey questions addressed expectations and incentives for using EBDM, self-efficacy in three EBDM skills, and estimates of EBDM within the agency.In both states, participants identified communication with policymakers, use of economic evaluation, and translation of research to practice as top competency gaps. Self-efficacy in developing evidence-based chronic disease control programs was lower than in finding or using data. Public health practitioners estimated that approximately two-thirds of programs in their agency were evidence-based. Mississippi participants indicated that health department leaders' expectations for the use of EBDM was approximately twice that of co-workers' expectations and that the use of EBDM could be increased with training and leadership prioritization.The assessment of EBDM capacity in Kansas and Mississippi built upon previous nationwide findings to identify top gaps in core competencies for EBDM in chronic disease and to estimate a percentage of programs in U.S. health departments that are evidence-based. The survey can serve as a valuable tool for other health departments and non-governmental organizations to assess EBDM capacity within their own workforce and to assist in the identification of approaches that will enhance the uptake of EBDM processes in public health programming and policymaking. Localized survey findings can provide direction for focusing workforce training programs and can indicate the types of incentives and policies that could affect the culture of EBDM in the workplace.
| S-EPMC3364859 | biostudies-other
Project description:BackgroundKnowledge exchange portals are emerging as web tools that can help facilitate knowledge management in public health. We conducted a review to better understand the nature of these portals and their contribution to knowledge management in public health, with the aim of informing future development of portals in this field.MethodsA systematic literature search was conducted of the peer-reviewed and grey literature to identify articles that described the design, development or evaluation of Knowledge Exchange Portals KEPs in the public health field. The content of the articles was analysed, interpreted and synthesised in light of the objectives of the review.ResultsThe systematic search yielded 2223 articles, of which fifteen were deemed eligible for review, including eight case studies, six evaluation studies and one commentary article. Knowledge exchange portals mainly included design features to support knowledge access and creation, but formative evaluation studies examining user needs suggested collaborative features supporting knowledge exchange would also be useful. Overall web usage statistics revealed increasing use of some of these portals over time; however difficulties remain in retaining users. There is some evidence to suggest that the use of a knowledge exchange portal in combination with tailored and targeted messaging can increase the use of evidence in policy and program decision making at the organisational level.ConclusionsKnowledge exchange portals can be a platform for providing integrated access to relevant content and resources in one location, for sharing and distributing information and for bringing people together for knowledge exchange. However more performance evaluation studies are needed to determine how they can best support evidence-informed decision making in public health.
| S-EPMC4046147 | biostudies-literature
Project description:There are professional expectations for public health nurses to develop competencies in evidence-informed decision-making (EIDM) due to its potential for improved client outcomes. Robust tools to assess EIDM competence can encourage increased EIDM engagement and uptake. This study aimed to develop and validate the content of a measure to assess EIDM competence among public health nurses. A four-stage process, based on measure development principles and the Standards for Educational and Psychological Testing, was used to develop and refine items for a new EIDM competence measure: a) content coverage assessment of existing measures; b) identification of existing measures for use and development of items; c) validity assessment based on content; d) validity assessment based on response process. An EIDM competence measurement tool consisting of EIDM knowledge, skills, attitudes/beliefs, and behaviour items was developed using conceptual literature and existing measures (Evidence-Based Practice Competency Tool and Evidence-Based Practice Beliefs Scale) to address limitations of existing EIDM tools identified from the content coverage assessment. Item content validity index ratings ranged from 0.64-1.00. Qualitative themes from validity assessment based on content and response process included word changes to improve clarity, reducing item redundancy, separating multi-component items, and ensuring items reflect nursing role expectations. Upon determining its reliability and validity, there is potential for the EIDM competence measure to be used in: public health nursing practice to identify competence gaps and strengths to facilitate professional development activities; in research to support development of strategies to build EIDM capacity; and for curriculum planning and development across nursing education programs.
| S-EPMC7946311 | biostudies-literature
Project description:Evidence-based public health gives public health practitioners the tools they need to make choices based on the best and most current evidence. An evidence-based public health training course developed in 1997 by the Prevention Research Center in St. Louis has been taught by a transdisciplinary team multiple times with positive results. In order to scale up evidence-based practices, a train-the-trainer initiative was launched in 2010.This study examines the outcomes achieved among participants of courses led by trained state-level faculty. Participants from trainee-led courses in four states (Indiana, Colorado, Nebraska, and Kansas) over three years were asked to complete an online survey. Attempts were made to contact 317 past participants. One-hundred forty-four (50.9 %) reachable participants were included in analysis. Outcomes measured include frequency of use of materials, resources, and other skills or tools from the course; reasons for not using the materials and resources; and benefits from attending the course. Survey responses were tabulated and compared using Chi-square tests.Among the most commonly reported benefits, 88 % of respondents agreed that they acquired knowledge about a new subject, 85 % saw applications for the knowledge to their work, and 78 % agreed the course also improved abilities to make scientifically informed decisions at work. The most commonly reported reasons for not using course content as much as intended included not having enough time to implement evidence-based approaches (42 %); other staff/peers lack training (34 %); and not enough funding for continued training (34 %). The study findings suggest that utilization of course materials and teachings remains relatively high across practitioner groups, whether they were taught by the original trainers or by state-based trainers.The findings of this study suggest that train-the-trainer is an effective method for broadly disseminating evidence-based public health principles. Train-the-trainer is less costly than the traditional method and allows for courses to be tailored to local issues, thus making it a viable approach to dissemination and scale up of new public health practices.
| S-EPMC4676893 | biostudies-other
Project description:INTRODUCTION:It is increasingly considered important that people make an autonomous and informed decision concerning colorectal cancer (CRC) screening. However, the realisation of autonomy within the concept of informed decision-making might be interpreted too narrowly. Additionally, relatively little is known about what the eligible population believes to be a 'good' screening decision. Therefore, we aimed to explore how the concepts of autonomous and informed decision-making relate to how the eligible CRC screening population makes their decision and when they believe to have made a 'good' screening decision. METHODS:We conducted 27 semi-structured interviews with the eligible CRC screening population (eighteen CRC screening participants and nine non-participants). The general topics discussed concerned how people made their CRC screening decision, how they experienced making this decision and when they considered they had made a 'good' decision. RESULTS:Most interviewees viewed a 'good' CRC screening decision as one based on both reasoning and feeling/intuition, and that is made freely. However, many CRC screening non-participants experienced a certain social pressure to participate. All CRC screening non-participants viewed making an informed decision as essential. This appeared to be the case to a lesser extent for CRC screening participants. For most, experiences and values were involved in their decision-making. CONCLUSION:Our sample of the eligible CRC screening population viewed aspects related to the concepts of autonomous and informed decision-making as important for making a 'good' CRC screening decision. However, in particular the existence of a social norm may be affecting a true autonomous decision-making process. Additionally, the present concept of informed decision-making with its strong emphasis on making a fully informed and well-considered decision does not appear to be entirely reflective of the process in practice. More efforts could be made to attune to the diverse values and factors that are involved in deciding about CRC screening participation.
| S-EPMC7259584 | biostudies-literature
Project description:BackgroundThe National Collaborating Centre for Methods and Tools (NCCMT) offers workshops and webinars to build public health capacity for evidence-informed decision-making. Despite positive feedback for NCCMT workshops and resources, NCCMT users found key terms used in research papers difficult to understand. The Understanding Research Evidence (URE) videos use plain language, cartoon visuals, and public health examples to explain complex research concepts. The videos are posted on the NCCMT website and YouTube channel.ObjectiveThe first four videos in the URE web-based video series, which explained odds ratios (ORs), confidence intervals (CIs), clinical significance, and forest plots, were evaluated. The evaluation examined how the videos affected public health professionals' practice. A mixed-methods approach was used to examine the delivery mode and the content of the videos. Specifically, the evaluation explored (1) whether the videos were effective at increasing knowledge on the four video topics, (2) whether public health professionals were satisfied with the videos, and (3) how public health professionals applied the knowledge gained from the videos in their work.MethodsA three-part evaluation was conducted to determine the effectiveness of the first four URE videos. The evaluation included a Web-based survey, telephone interviews, and pretest and posttests, which evaluated public health professionals' experience with the videos and how the videos affected their public health work. Participants were invited to participate in this evaluation through various open access, public health email lists, through informational flyers and posters at the Canadian Public Health Association (CPHA) conference, and through targeted recruitment to NCCMT's network.ResultsIn the Web-based surveys (n=46), participants achieved higher scores on the knowledge assessment questions from watching the OR (P=.04), CI (P=.04), and clinical significance (P=.05) videos but not the forest plot (P=.12) video, as compared with participants who had not watched the videos. The pretest and posttest (n=124) demonstrated that participants had a better understanding of forest plots (P<.001) and CIs (P<.001) after watching the videos. Due to small sample size numbers, there were insufficient pretest and posttest data to conduct meaningful analyses on the clinical significance and OR videos. Telephone interview participants (n=18) thought the videos' use of animation, narration, and plain language was appropriate for people with different levels of understanding and learning styles. Participants felt that by increasing their understanding of research evidence, they could develop better interventions and design evaluations to measure the impact of public health initiatives.ConclusionsOverall, the results of the evaluation showed that watching the videos resulted in an increase in knowledge, and participants had an overall positive experience with the URE videos. With increased competence in using the best available evidence, professionals are empowered to contribute to decisions that can improve health outcomes of communities.
| S-EPMC5639207 | biostudies-literature
Project description:BackgroundThe current state of evidence regarding measures that assess evidence-informed decision-making (EIDM) competence attributes (i.e., knowledge, skills, attitudes/beliefs, behaviours) among nurses is unknown. This systematic review provides a narrative synthesis of the psychometric properties and general characteristics of EIDM competence attribute measures in nursing.MethodsThe search strategy included online databases, hand searches, grey literature, and content experts. To align with the Cochrane Handbook of Systematic Reviews, psychometric outcome data (i.e., acceptability, reliability, validity) were extracted in duplicate, while all remaining data (i.e., study and measure characteristics) were extracted by one team member and checked by a second member for accuracy. Acceptability data was defined as measure completion time and overall rate of missing data. The Standards for Educational and Psychological Testing was used as the guiding framework to define reliability, and validity evidence, identified as a unified concept comprised of four validity sources: content, response process, internal structure and relationships to other variables. A narrative synthesis of measure and study characteristics, and psychometric outcomes is presented across measures and settings.ResultsA total of 5883 citations were screened with 103 studies and 35 unique measures included in the review. Measures were used or tested in acute care (n?=?31 measures), public health (n?=?4 measures), home health (n?=?4 measures), and long-term care (n?=?1 measure). Half of the measures assessed a single competence attribute (n?=?19; 54.3%). Three measures (9%) assessed four competence attributes of knowledge, skills, attitudes/beliefs and behaviours. Regarding acceptability, overall missing data ranged from 1.6-25.6% across 11 measures and completion times ranged from 5 to 25?min (n?=?4 measures). Internal consistency reliability was commonly reported (21 measures), with Cronbach's alphas ranging from 0.45-0.98. Two measures reported four sources of validity evidence, and over half (n?=?19; 54%) reported one source of validity evidence.ConclusionsThis review highlights a gap in the testing and use of competence attribute measures related to evidence-informed decision making in community-based and long-term care settings. Further development of measures is needed conceptually and psychometrically, as most measures assess only a single competence attribute, and lack assessment and evidence of reliability and sources of established validity evidence.RegistrationPROSPERO #CRD42018088754.
| S-EPMC7254762 | biostudies-literature
Project description:BACKGROUND:Ensuring health policies are informed by evidence still remains a challenge despite efforts devoted to this aim. Several tools and approaches aimed at fostering evidence-informed policy-making (EIPM) have been developed, yet there is a lack of availability of indicators specifically devoted to assess and support EIPM. The present study aims to overcome this by building a set of measurable indicators for EIPM intended to infer if and to what extent health-related policies are, or are expected to be, evidence-informed for the purposes of policy planning as well as formative and summative evaluations. METHODS:The indicators for EIPM were developed and validated at international level by means of a two-round internet-based Delphi study conducted within the European project 'REsearch into POlicy to enhance Physical Activity' (REPOPA). A total of 82 researchers and policy-makers from the six European countries (Denmark, Finland, Italy, the Netherlands, Romania, the United Kingdom) involved in the project and international organisations were asked to evaluate the relevance and feasibility of an initial set of 23 indicators developed by REPOPA researchers on the basis of literature and knowledge gathered from the previous phases of the project, and to propose new indicators. RESULTS:The first Delphi round led to the validation of 14 initial indicators and to the development of 8 additional indicators based on panellists' suggestions; the second round led to the validation of a further 11 indicators, including 6 proposed by panellists, and to the rejection of 6 indicators. A total of 25 indicators were validated, covering EIPM issues related to human resources, documentation, participation and monitoring, and stressing different levels of knowledge exchange and involvement of researchers and other stakeholders in policy development and evaluation. CONCLUSION:The study overcame the lack of availability of indicators to assess if and to what extent policies are realised in an evidence-informed manner thanks to the active contribution of researchers and policy-makers. These indicators are intended to become a shared resource usable by policy-makers, researchers and other stakeholders, with a crucial impact on fostering the development of policies informed by evidence.
| S-EPMC5984390 | biostudies-literature