Dataset Information

Using natural experiments to evaluate population health interventions: new Medical Research Council guidance.

ABSTRACT: Natural experimental studies are often recommended as a way of understanding the health impact of policies and other large scale interventions. Although they have certain advantages over planned experiments, and may be the only option when it is impossible to manipulate exposure to the intervention, natural experimental studies are more susceptible to bias. This paper introduces new guidance from the Medical Research Council to help researchers and users, funders and publishers of research evidence make the best use of natural experimental approaches to evaluating population health interventions. The guidance emphasises that natural experiments can provide convincing evidence of impact even when effects are small or take time to appear. However, a good understanding is needed of the process determining exposure to the intervention, and careful choice and combination of methods, testing of assumptions and transparent reporting is vital. More could be learnt from natural experiments in future as experience of promising but lesser used methods accumulates.

SUBMITTER: Craig P

PROVIDER: S-EPMC3796763 | biostudies-literature | 2012 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Using natural experiments to evaluate population health interventions: new Medical Research Council guidance.

Craig Peter P Cooper Cyrus C Gunnell David D Haw Sally S Lawson Kenny K Macintyre Sally S Ogilvie David D Petticrew Mark M Reeves Barney B Sutton Matt M Thompson Simon S

Journal of epidemiology and community health 20120510 12

Natural experimental studies are often recommended as a way of understanding the health impact of policies and other large scale interventions. Although they have certain advantages over planned experiments, and may be the only option when it is impossible to manipulate exposure to the intervention, natural experimental studies are more susceptible to bias. This paper introduces new guidance from the Medical Research Council to help researchers and users, funders and publishers of research evide ...[more]

PMID: 22577181

Similar Datasets

Project description:BackgroundNovel technical solutions are called for to promote home-based exercise among community-dwelling stroke survivors supported by their caregivers. Lack of resources and knowledge about how to accomplish it, has been demonstrated. The objective of this study is to describe in detail the development of ActivABLES, a technical intervention to promote home-based exercise and physical activity engagement of community-dwelling stroke survivors with support from their caregivers.MethodsThe technical development process of ActivABLES was guided by the Medical Research Council (MRC) framework for development and evaluation of complex interventions as well as by principles of human-centred design and co-design. The main steps included: (1) Synthesis of evidence supporting the inclusion of balance exercises, mobility and walking exercises and exercises for the upper arm; (2) Implementation of initial user studies with qualitative data collection from individual interviews with stroke survivors, and focus group interviews with caregivers and health professionals; (3) Preliminary testing of eight prototypes with seven stroke survivors and their caregivers.ResultsAfter the preliminary testing of eight prototypes, four prototypes were not further developed whereas four prototypes were modified further. In addition, two new prototypes were developed, leaving six prototypes for further modification: 1) ActivFOAM for balance exercises, 2) WalkingSTARR to facilitate walking, 3) ActivBALL for hand exercises, 4) ActivSTICKS for upper arm exercises, and 5) ActivLAMP and 6) ActivTREE which both give visual feedback on progress of daily exercise and physical activities. ActivFOAM, ActivBALL and ActivSTICKS are all connected to a tablet where exercise instructions are given. All the exercise prototypes can be connected to ActivLAMP and ActivTREE to give feedback on how much exercise the user has done. Settings can be individualised and recommended daily time and/or repetition can easily be changed as the user progresses to higher activity levels.ConclusionsThe development process of ActivABLES was guided by the principles of human-centred design, with iterative testing of future users, and by the MRC framework of complex intervention, with a repeated process of development and testing. This process resulted in six prototypes which are available for feasibility testing among a small group of community-dwelling stroke survivors.

Project description:The Medical Research Council grading system has served through decades for the evaluation of muscle strength and has been recognized as a cardinal feature of daily neurological, rehabilitation and general medicine examination of patients, despite being respectfully criticized due to the unequal width of its response options. No study has systematically examined, through modern psychometric approach, whether physicians are able to properly use the Medical Research Council grades. The objectives of this study were: (i) to investigate physicians' ability to discriminate among the Medical Research Council categories in patients with different neuromuscular disorders and with various degrees of weakness through thresholds examination using Rasch analysis as a modern psychometric method; (ii) to examine possible factors influencing physicians' ability to apply the Medical Research Council categories through differential item function analyses; and (iii) to examine whether the widely used Medical Research Council 12 muscles sum score in patients with Guillain-Barré syndrome and chronic inflammatory demyelinating polyradiculoneuropathy would meet Rasch model's expectations. A total of 1065 patients were included from nine cohorts with the following diseases: Guillain-Barré syndrome (n = 480); myotonic dystrophy type-1 (n = 169); chronic inflammatory demyelinating polyradiculoneuropathy (n = 139); limb-girdle muscular dystrophy (n = 105); multifocal motor neuropathy (n = 102); Pompe's disease (n = 62) and monoclonal gammopathy of undetermined related polyneuropathy (n = 8). Medical Research Council data of 72 muscles were collected. Rasch analyses were performed on Medical Research Council data for each cohort separately and after pooling data at the muscle level to increase category frequencies, and on the Medical Research Council sum score in patients with Guillain-Barré syndrome and chronic inflammatory demyelinating polyradiculoneuropathy. Disordered thresholds were demonstrated in 74-79% of the muscles examined, indicating physicians' inability to discriminate between most Medical Research Council categories. Factors such as physicians' experience or illness type did not influence these findings. Thresholds were restored after rescoring the Medical Research Council grades from six to four options (0, paralysis; 1, severe weakness; 2, slight weakness; 3, normal strength). The Medical Research Council sum score acceptably fulfilled Rasch model expectations after rescoring the response options and creating subsets to resolve local dependency and item bias on diagnosis. In conclusion, a modified, Rasch-built four response category Medical Research Council grading system is proposed, resolving clinicians' inability to differentiate among its original response categories and improving clinical applicability. A modified Medical Research Council sum score at the interval level is presented and is recommended for future studies in Guillain-Barré syndrome and chronic inflammatory demyelinating polyradiculoneuropathy.

Project description:BackgroundAdapting interventions that have worked elsewhere can save resources associated with developing new interventions for each specific context. While a developing body of evidence shows benefits of adapted interventions compared with interventions transported without adaptation, there are also examples of interventions which have been extensively adapted, yet have not worked in the new context. Decisions on when, to what extent, and how to adapt interventions therefore are not straightforward, particularly when conceptualising intervention effects as contingent upon contextual interactions in complex systems. No guidance currently addresses these questions comprehensively. To inform development of an overarching guidance on adaptation of complex population health interventions, this systematic review synthesises the content of the existing guidance papers.MethodsWe searched for papers published between January 2000 and October 2018 in 7 bibliographic databases. We used citation tracking and contacted authors and experts to locate further papers. We double screened all the identified records. We extracted data into the following categories: descriptive information, key concepts and definitions, rationale for adaptation, aspects of adaptation, process of adaptation, evaluating and reporting adapted interventions. Data extraction was conducted independently by two reviewers, and retrieved data were synthesised thematically within pre-specified and emergent categories.ResultsWe retrieved 6694 unique records. Thirty-eight papers were included in the review representing 35 sources of guidance. Most papers were developed in the USA in the context of implementing evidence-informed interventions among different population groups within the country, such as minority populations. We found much agreement on how the papers defined key concepts, aims, and procedures of adaptation, including involvement of key stakeholders, but also identified gaps in scope, conceptualisation, and operationalisation in several categories.ConclusionsOur review found limitations that should be addressed in future guidance on adaptation. Specifically, future guidance needs to be reflective of adaptations in the context of transferring interventions across countries, including macro- (e.g. national-) level interventions, better theorise the role of intervention mechanisms and contextual interactions in the replicability of effects and accordingly conceptualise key concepts, such as fidelity to intervention functions, and finally, suggest evidence-informed strategies for adaptation re-evaluation and reporting.Trial registrationPROSPERO 2018, CRD42018112714.

Dataset Information

Using natural experiments to evaluate population health interventions: new Medical Research Council guidance.

Publications

Using natural experiments to evaluate population health interventions: new Medical Research Council guidance.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets