Dataset Information

A qualitative study into the difficulties experienced by healthcare decision makers when reading a Cochrane diagnostic test accuracy review.

ABSTRACT:

Background

Cochrane reviews are one of the best known and most trusted sources of evidence-based information in health care. While steps have been taken to make Cochrane intervention reviews accessible to a diverse readership, little is known about the accessibility of the newcomer to the Cochrane library: diagnostic test accuracy reviews (DTARs). The current qualitative study explored how healthcare decision makers, who varied in their knowledge and experience with test accuracy research and systematic reviews, read and made sense of DTARs.

Methods

A purposive sample of clinicians, researchers and policy makers (n = 21) took part in a series of think-aloud interviews, using as interview material the first three DTARs published in the Cochrane library. Thematic qualitative analysis of the transcripts was carried out to identify patterns in participants' 'reading' and interpretation of the reviews and the difficulties they encountered.

Results

Participants unfamiliar with the design and methodology of DTARs found the reviews largely inaccessible and experienced a range of difficulties stemming mainly from the mismatch between background knowledge and level of explanation provided in the text. Experience with systematic reviews of interventions did not guarantee better understanding and, in some cases, led to confusion and misinterpretation. These difficulties were further exacerbated by poor layout and presentation, which affected even those with relatively good knowledge of DTARs and had a negative impact not only on their understanding of the reviews but also on their motivation to engage with the text. Comparison between the readings of the three reviews showed that more accessible presentation, such as presenting the results as natural frequencies, significantly increased participants' understanding.

Conclusions

The study demonstrates that authors and editors should pay more attention to the presentation as well as the content of Cochrane DTARs, especially if the reports are aimed at readers with various levels of background knowledge and experience. It also raises the question as to the anticipated target audience of the reports and suggests that different groups of healthcare decision-makers may require different modes of presentation.

SUBMITTER: Zhelev Z

PROVIDER: S-EPMC3663697 | biostudies-literature | 2013 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A qualitative study into the difficulties experienced by healthcare decision makers when reading a Cochrane diagnostic test accuracy review.

Zhelev Zhivko Z Garside Ruth R Hyde Christopher C

Systematic reviews 20130516

<h4>Background</h4>Cochrane reviews are one of the best known and most trusted sources of evidence-based information in health care. While steps have been taken to make Cochrane intervention reviews accessible to a diverse readership, little is known about the accessibility of the newcomer to the Cochrane library: diagnostic test accuracy reviews (DTARs). The current qualitative study explored how healthcare decision makers, who varied in their knowledge and experience with test accuracy researc ...[more]

PMID: 23680077

Similar Datasets

Project description:BackgroundContinued improvements in occupational health can only be ensured if decisions regarding the implementation and continuation of occupational health and safety interventions (OHS interventions) are based on the best available evidence. To ensure that this is the case, scientific evidence should meet the needs of decision-makers. As a first step in bridging the gap between the economic evaluation literature and daily practice in occupational health, this study aimed to provide insight into the occupational health decision-making process and information needs of decision-makers.MethodsAn exploratory qualitative study was conducted with a purposeful sample of occupational health decision-makers in the Ontario healthcare sector. Eighteen in-depth interviews were conducted to explore the process by which occupational health decisions are made and the importance given to the financial implications of OHS interventions. Twenty-five structured telephone interviews were conducted to explore the sources of information used during the decision-making process, and decision-makers' knowledge on economic evaluation methods. In-depth interview data were analyzed according to the constant comparative method. For the structured telephone interviews, summary statistics were prepared.ResultsThe occupational health decision-making process generally consists of three stages: initiation stage, establishing the need for an intervention; pre-implementation stage, developing an intervention and its business case in order to receive senior management approval; and implementation and evaluation stage, implementing and evaluating an intervention. During this process, information on the financial implications of OHS interventions was found to be of great importance, especially the employer's costs and benefits. However, scientific evidence was rarely consulted, sound ex-post program evaluations were hardly ever performed, and there seemed to be a need to advance the economic evaluation skill set of decision-makers.ConclusionsFinancial information is particularly important at the front end of implementation decisions, and can be a key deciding factor of whether to go forward with a new OHS intervention. In addition, it appears that current practice in occupational health in the healthcare sector is not solidly grounded in evidence-based decision-making and strategies should be developed to improve this.

Project description:BACKGROUND:Globally, and in India, research has highlighted the importance of community engagement in achieving national vaccination goals and in promoting health equity. However, community engagement is not well-defined and remains an underutilized approach. There is also paucity of literature on community engagement's effectiveness in achieving vaccination outcomes. To address that gap, this study interviewed Indian vaccination decision makers to derive a shared understanding of the evolving conceptualization of community engagement, and how it has been fostered during India's Decade of Vaccines (2010-2020). METHODS:Semi-structured interviews were conducted with 25 purposefully sampled national-level vaccine decision makers in India, including policymakers, immunization program heads, and vaccine technical committee leads. Participants were identified by their 'elite' status among decisionmakers in the Indian vaccination space. Schutz' Social Phenomenological Theory guided development of an a priori framework derived from the Social Ecological Model. The framework helped organize participants' conceptualizations of communities, community engagement, and related themes. Inter-rater reliability was computed for a subsample of coded interviews, and findings were validated in a one-day member check-in meeting with study participants and teams. RESULTS:The interviews successfully elucidated participants' understanding of key terminology ("community") and approaches to community engagement propagated by the vaccine decision makers. Participants conceptualized 'communities' as vaccine-eligible children, their parents, frontline healthcare workers, and vaccination influencers. Engagement with those communities was understood to mean vaccine outreach, capacity-building of healthcare workers, and information dissemination. However, participants indicated that there were neither explicit policy guidelines defining community engagement nor pertinent evaluation metrics, despite awareness that community engagement is complex and under-researched. Examples of different approaches to community engagement ranged from vaccine imposition to empowered community vaccination decision-making. Finally, participants proposed an operational definition of community engagement and discussed concerns related to implementing it. CONCLUSIONS:Although decision makers had different perceptions about what constitutes a community, and how community engagement should optimally function, the combined group articulated its importance to ensure vaccination equity and reiterated the need for concerted political will to build trust with communities. At the same time, work remains to be done both in terms of research on community engagement as well as development of appropriate implementation and outcome metrics.

Project description:IntroductionEmergency departments (EDs) are an important safety net for rural populations. Results of our earlier studies suggest that rural Canadian hospitals have limited access to advanced imaging services and intensive care units and that patients are transferred over large distances. They also revealed significant geographical variations in rural services. In the absence of national standards, our studies raise questions about inequities in rural access to emergency services and the risks for citizens. Our goal is to build recommendations for improving services by mobilising stakeholders interested in rural emergency care. With help and full engagement of stakeholders, we will (1) identify solutions for improving quality and performance in rural EDs; (2) formulate and prioritise recommendations; (3) transfer knowledge of the recommendations to rural EDs and support operationalisation and (4) assess knowledge transfer and explore further impacts of this participatory action research project.MethodologyWe will use a participatory action research approach. We will plan for a governance structure that includes all stakeholdersâ€™ representatives, so throughout this project, stakeholders are fully engaged at every step. Our sample will be 26 EDs in rural Quebec. We will conduct semistructured individual and focus group interviews with relevant and representative participants, including patients and citizens (estimated n=200). Interviews will be thematically analysed to extract potential solutions and other qualitative information.An expert panel (Â±15) will use an analysis grid to develop consensus recommendations from solutions suggested and will evaluate feasibility, impacts, costs, conditions for implementation and establish monitoring indicators. Recommendations will be transferred to stakeholders using tailored knowledge translation strategies (web platform, meetings and so on).Discussion and expected resultsThis study will result in a comprehensive consensus list of feasible and high-priority recommendations enabling decision-makers in emergency care to implement improvements in rural emergency care in Quebec.Ethics and disseminationThis protocol has been approved by the CSSS Alphonse-Desjardins research ethics committee (Project number: MP 2017-009). The qualitative material will be kept confidential and the data will be presented in a way that respects confidentiality. The dissemination plan for the study includes publications in scientific and professional journals. We will also use social media to disseminate our findings and activities such as communications in public conferences.

Project description:OBJECTIVE:To elicit European healthcare policy-makers' views, understanding and attitudes about the implementation of frailty screening and management strategies and responses to stakeholders' views. DESIGN:Thematic analysis of semistructured qualitative interviews. SETTING:European healthcare policy departments. PARTICIPANTS:Seven European healthcare policy-makers representing the European Union (n=2), UK (n=2), Italy (n=1), Spain (n=1) and Poland (n=1). Participants were sourced through professional networks and the European Commission Authentication Service website and were required to be in an active healthcare policy or decision-making role. RESULTS:Seven themes were identified. Our findings reveal a 'knowledge gap', around frailty and awareness of the malleability of frailty, which has resulted in restricted ownership of frailty by specialists. Policy-makers emphasised the need to recognise frailty as a clinical syndrome but stressed that it should be managed via an integrated and interdisciplinary response to chronicity and ageing. That is, through social co-production. This would require a culture shift in care with redeployment of existing resources to deliver frailty management and intervention services. Policy-makers proposed barriers to a culture shift, indicating a need to be innovative with solutions to empower older adults to optimise their health and well-being, while still fully engaging in the social environment. The cultural acceptance of an integrated care system theme described the complexities of institutional change management, as well as cultural issues relating to working democratically, while in signposting adult care, the need for a personal navigator to help older adults to access appropriate services was proposed. Policy-makers also believed that screening for frailty could be an effective tool for frailty management. CONCLUSIONS:There is potential for frailty to be managed in a more integrated and person-centred manner, overcoming the challenges associated with niche ownership within the healthcare system. There is also a need to raise its profile and develop a common understanding of its malleability among stakeholders, as well as consistency in how and when it is measured.

Project description:BACKGROUND:A pretest probability must be selected to calculate data to help clinicians, guideline boards and policy makers interpret diagnostic accuracy parameters. When multiple analyses for the same target condition are compared, identical pretest probabilities might be selected to facilitate the comparison. Some pretest probabilities may lead to exaggerations of the patient harms or benefits, and guidance on how and why to select a specific pretest probability is minimally described. Therefore, the aim of this study was to assess the data sources and methods used in Cochrane diagnostic test accuracy (DTA) reviews for determining pretest probabilities to facilitate the interpretation of DTA parameters. A secondary aim was to assess the use of identical pretest probabilities to compare multiple meta-analyses within the same target condition. METHODS:Cochrane DTA reviews presenting at least one meta-analytic estimate of the sensitivity and/or specificity as a primary analysis published between 2008 and January 2018 were included. Study selection and data extraction were performed by one author and checked by other authors. Observed data sources (e.g. studies in the review, or external sources) and methods to select pretest probabilities (e.g. median) were categorized. RESULTS:Fifty-nine DTA reviews were included, comprising of 308 meta-analyses. A pretest probability was used in 148 analyses. Authors used included studies in the DTA review, external sources, and author consensus as data sources for the pretest probability. Measures of central tendency with or without a measure of dispersion were used to determine the pretest probabilities, with the median most commonly used. Thirty-two target conditions had at least one identical pretest probability for all of the meta-analyses within their target condition. About half of the used identical pretest probabilities were inside the prevalence ranges from all analyses within a target condition. CONCLUSIONS:Multiple sources and methods were used to determine (identical) pretest probabilities in Cochrane DTA reviews. Indirectness and severity of downstream consequences may influence the acceptability of the certainty in calculated data with pretest probabilities. Consider: whether to present normalized frequencies, the influence of pretest probabilities on normalized frequencies, and whether to use identical pretest probabilities for meta-analyses in a target condition.

Dataset Information

A qualitative study into the difficulties experienced by healthcare decision makers when reading a Cochrane diagnostic test accuracy review.

Background

Methods

Results

Conclusions

Publications

A qualitative study into the difficulties experienced by healthcare decision makers when reading a Cochrane diagnostic test accuracy review.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets