Dataset Information

Operational research as implementation science: definitions, challenges and research priorities.

ABSTRACT: Operational research (OR) is the discipline of using models, either quantitative or qualitative, to aid decision-making in complex implementation problems. The methods of OR have been used in healthcare since the 1950s in diverse areas such as emergency medicine and the interface between acute and community care; hospital performance; scheduling and management of patient home visits; scheduling of patient appointments; and many other complex implementation problems of an operational or logistical nature.To date, there has been limited debate about the role that operational research should take within implementation science. I detail three such roles for OR all grounded in upfront system thinking: structuring implementation problems, prospective evaluation of improvement interventions, and strategic reconfiguration. Case studies from mental health, emergency medicine, and stroke care are used to illustrate each role. I then describe the challenges for applied OR within implementation science at the organisational, interventional, and disciplinary levels. Two key challenges include the difficulty faced in achieving a position of mutual understanding between implementation scientists and research users and a stark lack of evaluation of OR interventions. To address these challenges, I propose a research agenda to evaluate applied OR through the lens of implementation science, the liberation of OR from the specialist research and consultancy environment, and co-design of models with service users. Operational research is a mature discipline that has developed a significant volume of methodology to improve health services. OR offers implementation scientists the opportunity to do more upfront system thinking before committing resources or taking risks. OR has three roles within implementation science: structuring an implementation problem, prospective evaluation of implementation problems, and a tool for strategic reconfiguration of health services. Challenges facing OR as implementation science include limited evidence and evaluation of impact, limited service user involvement, a lack of managerial awareness, effective communication between research users and OR modellers, and availability of healthcare data. To progress the science, a focus is needed in three key areas: evaluation of OR interventions, embedding the knowledge of OR in health services, and educating OR modellers about the aims and benefits of service user involvement.

SUBMITTER: Monks T

PROVIDER: S-EPMC4895878 | biostudies-other | 2016 Jun

REPOSITORIES: biostudies-other

ACCESS DATA

Similar Datasets

Project description:BackgroundChinese Center for Disease Control and Prevention (China CDC) introduced the Structured Operational Research Training Initiative (SORT IT) into China to build a special capacity and equip public health professionals with an effective tool to support developing countries in strengthening their operational research. The paper aims to investigate and analyze the implementation, outcomes and challenges of the first cycle of SORT IT in China.Main textAs a result of the successful implementation, SORT IT China, Cycle 1 has demonstrated fruitful outputs as exemplified by the 18-month follow-up to the post-training initiatives of the twelve participants, who all achieved the four milestones required by SORT IT. Eleven of twelve (92%) manuscripts generated that focused on the prevention and control of malaria, influenza, HIV/AIDS, hepatitis B, schistosomiasis, tuberculosis and Japanese encephalitis were published by peer-reviewed international journals with the impact factor ranging from 2.6 to 4.8. The most up-to-date citation count on February 19, 2021 was 53 times out of which 31 times were cited by Science Citation Index papers with 94.827 impact factor in total. Six senior professionals from China CDC also facilitated the whole SORT IT training scheme as co-mentors under the guidance of SORT IT mentors. The twelve participants who gained familiarity with the SORT IT courses and training principles are likely become potential mentors for future SORT IT, but they as the non-first language speakers/users of English also faced the challenge in thoroughly understanding the modules delivered in English and writing English academically to draft the manuscripts.ConclusionThe outcomes from the first cycle of SORT IT in China have led to studies contributing to narrowing the knowledge gap among numerous public health challenges nationally and internationally. It is believed the researchers who participated will continue to apply the skills learned within their domain and help build the training capacity for future operational research courses both in China and in developing countries with similar needs.

Project description:BackgroundCommon, operational definitions are crucial to assess interventions and outcomes related to pediatric mechanical ventilation. These definitions can reduce unnecessary variability among research and quality improvement efforts, to ensure findings are generalizable, and can be pooled to establish best practices.Research questionCan we establish operational definitions for key elements related to pediatric ventilator liberation using a combination of detailed literature review and consensus-based approaches?Study design and methodsA panel of 26 international experts in pediatric ventilator liberation, two methodologists, and two librarians conducted systematic reviews on eight topic areas related to pediatric ventilator liberation. Through a series of virtual meetings, we established draft definitions that were voted upon using an anonymous web-based process. Definitions were revised by incorporating extracted data gathered during the systematic review and discussed in another consensus meeting. A second round of voting was conducted to confirm the final definitions.ResultsIn eight topic areas identified by the experts, 16 preliminary definitions were established. Based on initial discussion and the first round of voting, modifications were suggested for 11 of the 16 definitions. There was significant variability in how these items were defined in the literature reviewed. The final round of voting achieved ≥ 80% agreement for all 16 definitions in the following areas: what constitutes respiratory support (invasive mechanical ventilation and noninvasive respiratory support), liberation and failed attempts to liberate from invasive mechanical ventilation, liberation from respiratory support, duration of noninvasive respiratory support, total duration of invasive mechanical ventilation, spontaneous breathing trials, extubation readiness testing, 28 ventilator-free days, and planned vs rescue use of post-extubation noninvasive respiratory support.InterpretationWe propose that these consensus-based definitions for elements of pediatric ventilator liberation, informed by evidence, be used for future quality improvement initiatives and research studies to improve generalizability and facilitate comparison.

Project description:Background: In Brazil, secondary data for epidemiology are largely available. However, they are insufficiently prepared for use in research, even when it comes to structured data since they were often designed for other purposes. To date, few publications focus on the process of preparing secondary data. The present findings can help in orienting future research projects that are based on secondary data. Objective: Describe the steps in the process of ensuring the adequacy of a secondary data set for a specific use and to identify the challenges of this process. Methods: The present study is qualitative and reports methodological issues about secondary data use. The study material was comprised of 6,059,454 live births and 73,735 infant death records from 2004 to 2013 of children whose mothers resided in the State of São Paulo - Brazil. The challenges and description of the procedures to ensure data adequacy were undertaken in 6 steps: (1) problem understanding, (2) resource planning, (3) data understanding, (4) data preparation, (5) data validation and (6) data distribution. For each step, procedures, and challenges encountered, and the actions to cope with them and partial results were described. To identify the most labor-intensive tasks in this process, the steps were assessed by adding the number of procedures, challenges, and coping actions. The highest values were assumed to indicate the most critical steps. Results: In total, 22 procedures and 23 actions were needed to deal with the 27 challenges encountered along the process of ensuring the adequacy of the study material for the intended use. The final product was an organized database for a historical cohort study suitable for the intended use. Data understanding and data preparation were identified as the most critical steps, accounting for about 70% of the challenges observed for data using. Conclusion: Significant challenges were encountered in the process of ensuring the adequacy of secondary health data for research use, mainly in the data understanding and data preparation steps. The use of the described steps to approach structured secondary data and the knowledge of the potential challenges along the process may contribute to planning health research.

Project description:BackgroundIn Uganda and other resource-poor countries, relevant research findings face a tortuous path to translation into policy and routine practice. Implementation science (ImSc) research could facilitate faster translation. Presently it is unclear what ImSc research capacity and possible training needs exist among Ugandan researchers. To assess both components, we interviewed potential trainees in Kampala, Uganda.MethodsWe used a cross-sectional design to survey potential ImSc trainees who had some research training and involvement in generating or utilizing research. Using a questionnaire, we documented eligibility for ImSc training, knowledge and interest in training, existing self-assessed confidence in initiating clinical research (SCICR) and self-assessed confidence in initiating ImSc research (SCIIR), availability for training and preferred modes of training. We developed scores from the Likert scales and used descriptive statistics, logistic regression and ordinal logistic regression to evaluate predictors of SCIIR.ResultsBetween November 2016 and April 2017, we interviewed 190 participants; 60% were men, with a median age of 37 years. Among participants, 33% comprised faculty, 37% were graduate students and 30% were project staff. The majority of respondents knew about ImSc (73%) and were research-trained (80%). Only 9% reported any ImSc-related training. Previous ImSc training was associated with higher odds of a SCIIR score ≥ 75th percentile. Previous ImSc training compared to not having any training was associated with higher odds of reporting abilities in behaviour change theory integration (OR: 3.3, 95% CI: 1.3-8.5, p = 0.01) and framework use in intervention design and implementation (OR: 2.9, 95% CI: 1.1-7.4, p = 0.03), accounting for age, sex and current employment. In addition, 53% of participants preferred in-person (face-to-face) short ImSc courses compared to a year-long training, while 33% preferred online courses. Participants reported median availability of 6 hours per week (IQR: 4, 10) for training.ConclusionMost participants had some understanding of ImSc research, had research training and were interested in ImSc training. Those with previous ImSc training had better skills and SCIIR, compared to those without previous training. A hybrid approach with modular face-to-face training and online sessions would suit the preferences of most potential trainees.

Project description:BackgroundMultiple theories, models and frameworks have been developed to assist implementation of evidence-based practice. However, to date there has been no review of implementation literature specific to adolescent healthcare. This integrative review therefore aimed to determine what implementation science theories, models and frameworks have been applied, what elements of these frameworks have been identified as influential in promoting the implementation and sustainability of service intervention, and to what extent, in what capacity and at what time points has the contribution of adolescent consumer perspectives on evidence implementation been considered. METHODS: An integrative design was used and reported based on a modified form of the PRISMA (2020) checklist. Seven databases were searched for English language primary research which included any implementation science theory, model or framework developed for/with adolescents or applied in relation to adolescent healthcare services within the past 10 years. Content and thematic analysis were applied with the Consolidated Framework for Implementation Research (CFIR) used to frame analysis of the barriers and facilitators to effective implementation of evidence-informed interventions within youth health settings.ResultsFrom 8717 citations, 13 papers reporting 12 studies were retained. Nine different implementation science theories, frameworks or approaches were applied; six of 12 studies used the CFIR, solely or with other models. All CFIR domains were represented as facilitators and barriers for implementation in included studies. However, there was little or no inclusion of adolescents in the development or review of these initiatives. Only three mentioned youth input, occurring in the pre-implementation or implementation stages.ConclusionsThe few studies found for this review highlight the internationally under-developed nature of this topic. Flagging the importance of the unique characteristics of this particular age group, and of the interventions and strategies to target it, the minimal input of adolescent consumers is cause for concern. Further research is clearly needed and must ensure that youth consumers are engaged from the start and consistently throughout; that their voice is prioritised and not tokenistic; that their contribution is taken seriously. Only then will age-appropriate evidence implementation enable innovations in youth health services to achieve the evidence-based outcomes they offer.Trial registrationPROSPERO 2020 CRD42020201142 https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=201142.

Dataset Information

Operational research as implementation science: definitions, challenges and research priorities.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets