Dataset Information

Facilitating evidence uptake: development and user testing of a systematic review summary format to inform public health decision-making in German-speaking countries.

ABSTRACT:

Background

Systematic reviews are an important source of evidence for public health decision-making, but length and technical jargon tend to hinder their use. In non-English speaking countries, inaccessibility of information in the native language often represents an additional barrier. In line with our vision to strengthen evidence-based public health in the German-speaking world, we developed a German language summary format for systematic reviews of public health interventions and undertook user-testing with public health decision-makers in Germany, Austria and Switzerland.

Methods

We used several guiding principles and core elements identified from the literature to produce a prototype summary format and applied it to a Cochrane review on the impacts of changing portion and package sizes on selection and consumption of food, alcohol and tobacco. Following a pre-test in each of the three countries, we carried out 18 user tests with public health decision-makers in Germany, Austria and Switzerland using the 'think-aloud' method. We analysed participants' comments according to the facets credibility, usability, understandability, usefulness, desirability, findability, identification and accessibility. We also identified elements that hindered the facile and satisfying use of the summary format, and revised it based on participants' feedback.

Results

The summary format was well-received; participants particularly appreciated receiving information in their own language. They generally found the summary format useful and a credible source of information, but also signalled several barriers to a positive user experience such as an information-dense structure and difficulties with understanding statistical terms. Many of the identified challenges were addressed through modifications of the summary format, in particular by allowing for flexible length, placing more emphasis on key messages and relevance for public health practice, expanding the interpretation aid for statistical findings, providing a glossary of technical terms, and only including graphical GRADE ratings. Some barriers to uptake, notably the participants' wish for actionable recommendations and contextual information, could not be addressed.

Conclusions

Participants welcomed the initiative, but user tests also revealed their problems with understanding and interpreting the findings summarised in our prototype format. The revised summary format will be used to communicate the results of Cochrane reviews of public health interventions.

SUBMITTER: Busert LK

PROVIDER: S-EPMC6038322 | biostudies-literature | 2018 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Facilitating evidence uptake: development and user testing of a systematic review summary format to inform public health decision-making in German-speaking countries.

Busert Laura K LK Mütsch Margot M Kien Christina C Flatz Aline A Griebler Ursula U Wildner Manfred M Stratil Jan M JM Rehfuess Eva A EA

Health research policy and systems 20180709 1

<h4>Background</h4>Systematic reviews are an important source of evidence for public health decision-making, but length and technical jargon tend to hinder their use. In non-English speaking countries, inaccessibility of information in the native language often represents an additional barrier. In line with our vision to strengthen evidence-based public health in the German-speaking world, we developed a German language summary format for systematic reviews of public health interventions and und ...[more]

PMID: 29986706

Similar Datasets

Project description:For most women, participation in decision-making during maternity care has a positive impact on their childbirth experiences. Shared decision-making (SDM) is widely advocated as a way to support people in their healthcare choices. The aim of this study was to identify quality criteria and professional competencies for applying shared decision-making in maternity care. We focused on decision-making in everyday maternity care practice for healthy women.An international three-round web-based Delphi study was conducted. The Delphi panel included international experts in SDM and in maternity care: mostly midwives, and additionally obstetricians, educators, researchers, policy makers and representatives of care users. Round 1 contained open-ended questions to explore relevant ingredients for SDM in maternity care and to identify the competencies needed for this. In rounds 2 and 3, experts rated statements on quality criteria and competencies on a 1 to 7 Likert-scale. A priori, positive consensus was defined as 70% or more of the experts scoring ?6 (70% panel agreement).Consensus was reached on 45 quality criteria statements and 4 competency statements. SDM in maternity care is a dynamic process that starts in antenatal care and ends after birth. Experts agreed that the regular visits during pregnancy offer opportunities to build a relationship, anticipate situations and revisit complex decisions. Professionals need to prepare women antenatally for unexpected, urgent decisions in birth and revisit these decisions postnatally. Open and respectful communication between women and care professionals is essential; information needs to be accurate, evidence-based and understandable to women. Experts were divided about the contribution of professional advice in shared decision-making and about the partner's role.SDM in maternity care is a dynamic process that takes into consideration women's individual needs and the context of the pregnancy or birth. The identified ingredients for good quality SDM will help practitioners to apply SDM in practice and educators to prepare (future) professionals for SDM, contributing to women's positive birth experience and satisfaction with care.

Project description:BackgroundThis project engages patients and physicians in the development of Decision Boxes, short clinical topic summaries covering medical questions that have no single best answer. Decision Boxes aim to prepare the clinician to communicate the risks and benefits of the available options to the patient so they can make an informed decision together.MethodsSeven researchers (including four practicing family physicians) selected 10 clinical topics relevant to primary care practice through a Delphi survey. We then developed two one-page prototypes on two of these topics: prostate cancer screening with the prostate-specific antigen test, and prenatal screening for trisomy 21 with the serum integrated test. We presented the prototypes to purposeful samples of family physicians distributed in two focus groups, and patients distributed in four focus groups. We used the User Experience Honeycomb to explore barriers and facilitators to the communication design used in Decision Boxes. All discussions were transcribed, and three researchers proceeded to thematic content analysis of the transcriptions. The coding scheme was first developed from the Honeycomb's seven themes (valuable, usable, credible, useful, desirable, accessible, and findable), and included new themes suggested by the data. Prototypes were modified in light of our findings.ResultsThree rounds were necessary for a majority of researchers to select 10 clinical topics. Fifteen physicians and 33 patients participated in the focus groups. Following analyses, three sections were added to the Decision Boxes: introduction, patient counseling, and references. The information was spread to two pages to try to make the Decision Boxes less busy and improve users' first impression. To try to improve credibility, we gave more visibility to the research institutions involved in development. A statement on the boxes' purpose and a flow chart representing the shared decision-making process were added with the intent of clarifying the tool's purpose. Information about the risks and benefits according to risk levels was added to the Decision Boxes, to try to ease the adaptation of the information to individual patients.ConclusionResults will guide the development of the eight remaining Decision Boxes. A future study will evaluate the effect of Decision Boxes on the integration of evidence-based and shared decision making principles in clinical practice.

Project description:BACKGROUND:Humanitarian action in crisis zones is fraught with many challenges, including lack of timely and accessible research evidence to inform decision-making about humanitarian interventions. Evidence websites have the potential to address this challenge. Evidence Aid is the only evidence website designed for crisis zones that focuses on providing research evidence in the form of systematic reviews. The objective of this study is to explore stakeholders' views of Evidence Aid, contributing further to our understanding of the use of research evidence in decision-making in crisis zones. METHODS:We designed a qualitative user-testing study to collect interview data from stakeholders about their impressions of Evidence Aid. Eligible stakeholders included those with and without previous experience of Evidence Aid. All participants were either currently working or have worked within the last year in a crisis zone. Participants were asked to perform the same user experience-related tasks and answer questions about this experience and their knowledge needs. Data were analysed using a deductive framework analysis approach drawing on Morville's seven facets of the user experience - findability, usability, usefulness, desirability, accessibility, credibility and value. RESULTS:A total of 31 interviews were completed with senior decision-makers (n?=?8), advisors (n?=?7), field managers (n?=?7), analysts/researchers (n?=?5) and healthcare providers (n?=?4). Participant self-reported knowledge needs varied depending on their role. Overall, participants did not identify any 'major' problems (highest order) and identified only two 'big' problems (second highest order) with using the Evidence Aid website, namely the lack of a search engine on the home page and that some full-text articles linked to/from the site require a payment. Participants identified seven specific suggestions about how to improve Evidence Aid, many of which can also be applied to other evidence websites. CONCLUSIONS:Stakeholders in crisis zones found Evidence Aid to be useful, accessible and credible. However, they experienced some problems with the lack of a search engine on the home page and the requirement for payment for some full-text articles linked to/from the site.

Dataset Information

Facilitating evidence uptake: development and user testing of a systematic review summary format to inform public health decision-making in German-speaking countries.

Background

Methods

Results

Conclusions

Publications

Facilitating evidence uptake: development and user testing of a systematic review summary format to inform public health decision-making in German-speaking countries.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets