Dataset Information

The harvest plot: a method for synthesising evidence about the differential effects of interventions.

ABSTRACT:

Background

One attraction of meta-analysis is the forest plot, a compact overview of the essential data included in a systematic review and the overall 'result'. However, meta-analysis is not always suitable for synthesising evidence about the effects of interventions which may influence the wider determinants of health. As part of a systematic review of the effects of population-level tobacco control interventions on social inequalities in smoking, we designed a novel approach to synthesis intended to bring aspects of the graphical directness of a forest plot to bear on the problem of synthesising evidence from a complex and diverse group of studies.

Methods

We coded the included studies (n = 85) on two methodological dimensions (suitability of study design and quality of execution) and extracted data on effects stratified by up to six different dimensions of inequality (income, occupation, education, gender, race or ethnicity, and age), distinguishing between 'hard' (behavioural) and 'intermediate' (process or attitudinal) outcomes. Adopting a hypothesis-testing approach, we then assessed which of three competing hypotheses (positive social gradient, negative social gradient, or no gradient) was best supported by each study for each dimension of inequality.

Results

We plotted the results on a matrix ('harvest plot') for each category of intervention, weighting studies by the methodological criteria and distributing them between the competing hypotheses. These matrices formed part of the analytical process and helped to encapsulate the output, for example by drawing attention to the finding that increasing the price of tobacco products may be more effective in discouraging smoking among people with lower incomes and in lower occupational groups.

Conclusion

The harvest plot is a novel and useful method for synthesising evidence about the differential effects of population-level interventions. It contributes to the challenge of making best use of all available evidence by incorporating all relevant data. The visual display assists both the process of synthesis and the assimilation of the findings. The method is suitable for adaptation to a variety of questions in evidence synthesis and may be particularly useful for systematic reviews addressing the broader type of research question which may be most relevant to policymakers.

SUBMITTER: Ogilvie D

PROVIDER: S-EPMC2270283 | biostudies-literature | 2008 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The harvest plot: a method for synthesising evidence about the differential effects of interventions.

Ogilvie David D Fayter Debra D Petticrew Mark M Sowden Amanda A Thomas Sian S Whitehead Margaret M Worthy Gill G

BMC medical research methodology 20080225

<h4>Background</h4>One attraction of meta-analysis is the forest plot, a compact overview of the essential data included in a systematic review and the overall 'result'. However, meta-analysis is not always suitable for synthesising evidence about the effects of interventions which may influence the wider determinants of health. As part of a systematic review of the effects of population-level tobacco control interventions on social inequalities in smoking, we designed a novel approach to synthe ...[more]

PMID: 18298827

Similar Datasets

Project description:BackgroundSystematic reviews have developed into a powerful method for summarising and synthesising evidence. The rise in systematic reviews creates a methodological opportunity and associated challenges and this is seen in the development of overviews, or reviews of systematic reviews. One of these challenges is how to summarise evidence from systematic reviews of complex interventions for inclusion in an overview. Interventions for communicating with and involving consumers in their care are frequently complex. In this article we outline a method for preparing data integration tables to enable review-level synthesis of the evidence on interventions for communication and participation in health.Methods and resultsSystematic reviews published by the Cochrane Consumers and Communication Review Group were utilised as the basis from which to develop linked steps for data extraction, evidence assessment and synthesis. The resulting output is called a data integration table. Four steps were undertaken in designing the data integration tables: first, relevant information for a comprehensive picture of the characteristics of the review was identified from each review, extracted and summarised. Second, results for the outcomes of the review were assessed and translated to standardised evidence statements. Third, outcomes and evidence statements were mapped into an outcome taxonomy that we developed, using language specific to the field of interventions for communication and participation. Fourth, the implications of the review were assessed after the mapping step clarified the level of evidence available for each intervention.ConclusionThe data integration tables represent building blocks for constructing overviews of review-level evidence and for the conduct of meta-synthesis. Individually, each table aims to improve the consistency of reporting on the features and effects of interventions for communication and participation; provides a broad assessment of the strength of evidence derived from different methods of analysis; indicates a degree of certainty with results; and reports outcomes and gaps in the evidence in a consistent and coherent way. In addition, individual tables can serve as a valuable tool for accurate dissemination of large amounts of complex information on communication and participation to professionals as well as to members of the public.

Project description:INTRODUCTION:Over the last two decades, patient portals have emerged as a noticeable eHealth strategy. To date, research on patient portals has been rapidly increasing. Our umbrella review aims to provide a meta-level synthesis to make sense of the evidence on patient portals from published systematic reviews (SRs). METHODS:We will employ a modified version of the Joanna Briggs Institute umbrella review method. The search strategy encompasses multiple databases. The inclusion criterion is specific to SRs focused on patient portal. Patients or public were not involved in this work. ANALYSIS:Two researchers will independently screen titles/abstracts and then full-text articles against the inclusion/exclusion criteria. Methodological quality of included reviews will be assessed and data will be extracted from the final selection of reviews. These reviews will be categorised into quantitative, qualitative and/or mixed-synthesis groups based on information about the design of primary studies provided in the reviews. Correspondingly, we will create quantitative, qualitative and/or mixed-synthesis Excel data-extraction tables. Within each table, data will be extracted with the reference to primary studies as reported in the reviews, and will be synthesised into themes and then a smaller number of findings/outcomes. Modified Grading of Recommendations Assessment, Development and Evaluation (GRADE) and Confidence in the Evidence from Reviews of Qualitative research (CERQual) tools will be applied to assess the strength of evidence at the level of each finding/outcome. The output of our umbrella review will consist of summary of findings tables and evidence profile tables. A narrative meta-level synthesis will be provided. We will use the clinical adoption meta-model as an organising framework. ETHICS AND DISSEMINATION:As an outcome of this review, we will create a guidance and roadmap to be used in a future Delphi study to gather feedback from Canadian eHealth stakeholders. We will also present at conferences and publish the final report. The umbrella review does not require ethical approval. PROSPERO REGISTRATION NUMBER:CRD42018096657.

Project description:BackgroundChildren and adolescents with attention-deficit/hyperactivity disorder (ADHD) have impairing levels of difficulty paying attention, impulsive behaviour and/or hyperactivity. ADHD causes extensive difficulties for young people at school, and as a result these children are at high risk for a wide range of poor outcomes. We ultimately aim to develop a flexible, modular 'toolkit' of evidence-based strategies that can be delivered by primary school staff to improve the school environment and experience for children with ADHD; the purpose of this review is to identify and quantify the evidence-base for potential intervention components. This protocol sets out our plans to systematically identify non-pharmacological interventions that target outcomes that have been reported to be of importance to key stakeholders (ADHD symptoms, organisation skills, executive-global- and classroom-functioning, quality of life, self-esteem and conflict with teachers and peers). We plan to link promising individual intervention components to measured outcomes, and synthesise the evidence of effectiveness for each outcome.MethodsA systematic search for studies published from the year 2000 that target the outcomes of interest in children and young people aged 3-12 will be conducted. Titles and abstracts will be screened using prioritisation software, and then full texts of potentially eligible studies will be screened. Systematic reviews, RCTs, non-randomised and case-series studies are eligible designs. Synthesis will vary by the type of evidence available, potentially including a review of reviews, meta-analysis and narrative synthesis. Heterogeneity of studies meta-analysed will be assessed, along with publication bias. Intervention mapping will be applied to understand potential behaviour change mechanisms for promising intervention components.DiscussionThis review will highlight interventions that appear to effectively ameliorate negative outcomes that are of importance for people with ADHD, parents, school staff and experts. Components of intervention design and features that are associated with effective change in the outcome will be delineated and used to inform the development of a 'toolkit' of non-pharmacological strategies that school staff can use to improve the primary school experience for children with ADHD.Trial registrationPROSPERO number CRD42021233924.

Dataset Information

The harvest plot: a method for synthesising evidence about the differential effects of interventions.

Background

Methods

Results

Conclusion

Publications

The harvest plot: a method for synthesising evidence about the differential effects of interventions.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets