Dataset Information

Searching for Programme theories for a realist evaluation: a case study comparing an academic database search and a simple Google search.

ABSTRACT: BACKGROUND:Realist methodologies are increasingly being used to evaluate complex interventions in health and social care. Programme theory (ideas and assumptions of how a particular intervention works) development is the first step in a realist evaluation or a realist synthesis, with literature reviews providing important evidence to support this. Deciding how to search for programme theories is challenging and there is limited guidance available. Using an example of identifying programme theories for a realist evaluation of Pressure Ulcer Risk Assessment Instruments in clinical practice, the authors explore and compare several different approaches to literature searching and highlight important methodological considerations for those embarking on a programme theory review. METHODS:We compared the performance of an academic database search with a simple Google search and developed an optimised search strategy for the identification primary references (i.e. documents providing the clearest examples of programme theories) associated with the use of Pressure Ulcer Risk Assessment Instruments (PU-RAIs). We identified the number of primary references and the total number of references retrieved per source. We then calculated the number needed to read (NNR) expressed as the total number of titles and abstracts screened to identify one relevant reference from each source. RESULTS:The academic database search (comprising CINAHL, The Cochrane Library, EMBASE, HMIC, Medline) identified 2 /10 primary references with a NNR of 1395.The Google search identified 7/10 primary references with a NNR of 10.1. The combined NNR was 286.3. The optimised search combining Google and CINAHL identified 10/10 primary references with a NNR of 40.2. CONCLUSION:The striking difference between the efficiency of the review's academic database and Google searches in finding relevant references prompted an in-depth comparison of the two types of search. The findings indicate the importance of including grey literature sources such as Google in this particular programme theory search, while acknowledging the need for transparency of methods. Further research is needed to facilitate improved guidance for programme theory searches to enhance practice in the realist field and to save researcher time and therefore resource.

SUBMITTER: Coleman S

PROVIDER: S-EPMC7450563 | biostudies-literature | 2020 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Searching for Programme theories for a realist evaluation: a case study comparing an academic database search and a simple Google search.

Coleman Susanne S Wright Judy M JM Nixon Jane J Schoonhoven Lisette L Twiddy Maureen M Greenhalgh Joanne J

BMC medical research methodology 20200826 1

<h4>Background</h4>Realist methodologies are increasingly being used to evaluate complex interventions in health and social care. Programme theory (ideas and assumptions of how a particular intervention works) development is the first step in a realist evaluation or a realist synthesis, with literature reviews providing important evidence to support this. Deciding how to search for programme theories is challenging and there is limited guidance available. Using an example of identifying programm ...[more]

PMID: 32847521

Similar Datasets

Project description:BackgroundThe health visitors' role in many countries is changing. In Scotland, the role has undergone substantial changes through the introduction of an enhanced health visiting programme, which includes increased, structured home visits. This evaluation was conducted within NHS Ayrshire and Arran, one of the 14 Scottish Health Boards. Our aim was to understand and explain how, and why, the programme could contribute to improving health and wellbeing outcomes for children and families.MethodsWe used a realist evaluation approach, conducted in three phases. In phase one, eight managerial staff involved in developing and implementing the programme provided data, which were used to develop initial programme theories. In phase two, the programme theories were tested using qualitative data from 25 health visitors and 22 parents. The programme theories were refined through analyses and interpretation of data in phase three.ResultsThe home visiting context provided by the programme interacted with the mechanisms of the programme and produced outcomes such as early identification of health and wellbeing issues amongst families who needed more support, leading to referral and engagement with sources of additional help. The home visits facilitated development of parent-health visitor relationships, and parents considered health visitors as their first point of contact on children's wellbeing and developmental-related issues. Moreover, the programme provided more clarity to health visitors' role, which in turn enhanced partnership working. However, there were aspects of the programme that may require further development. For instance, both parents and health visitors were concerned about the wide gaps between some home visits.ConclusionsThe enhanced health visiting programme increased opportunities for monitoring and early identification of health and wellbeing concerns. It created structures for a more efficient partnership working and ensured that the needs of children and families were supported. These benefits need to be evaluated further in an effectiveness study.

Dataset Information

Searching for Programme theories for a realist evaluation: a case study comparing an academic database search and a simple Google search.

Publications

Searching for Programme theories for a realist evaluation: a case study comparing an academic database search and a simple Google search.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets