Success and limiting factors in health service innovation: a theory-generating mixed methods evaluation of UK projects.
Ontology highlight
ABSTRACT: Objectives
To explore and explain success and limiting factors in UK health service innovation.Design
Mixed methods evaluation of a series of health service innovations involving a survey and interviews, with theory-generating analysis.Setting
The research explored innovations supported by one of the UK's Academic Health Science Networks which provides small grants, awards and structural support to health service innovators including clinical academics, health and social care professionals and third-sector organisations.Participants
All recipients of funding or support 2014-2018 were invited to participate. We analysed survey responses relating to 56 innovation projects.Results
Responses were used to conceptualise success along two axes: value creation for the intended beneficiaries and expansion beyond its original pilot. An analysis of variance between categories of success indicated that participation, motivation and evaluation were critical to value generation; organisational, educational and administrative support were critical to expansion; and leadership and collaborative expertise were critical to both value creation and expansion. Additional limiting factors derived from qualitative responses included difficulties navigating the boundaries and intersections between organisations, professions, sectors and cultures; a lack of support for innovation beyond the start-up phase; a lack of protected time; and staff burn-out and turnover.Conclusions
A nested hierarchy of innovation needs has been derived via an analysis of these factors, providing targeted suggestions to enhance the success of future innovations.
SUBMITTER: Leedham-Green K
PROVIDER: S-EPMC8154942 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundIn the home care industry, the assignment and tracking of care services are controlled by care centers that are centralized in nature and prone to inefficient information transmission. A lack of trust among the involved parties, information opaqueness, and large manual manipulation result in lower process efficiency.ObjectiveThis study aimed to explore and demonstrate the application of blockchain and smart contract technologies to innovate/renovate home care services for harvesting the desired blockchain benefits of process transparency, traceability, and interoperability.MethodsAn object-oriented analysis/design combined with a unified modeling language tool was used to construct the architecture of the proposed home care service system. System feasibility was evaluated via an implementation test, and a questionnaire survey was performed to collect opinions from home care service respondents knowledgeable about blockchain and smart contracts.ResultsAccording to the comparative analysis results, the proposed design outperformed the existing system in terms of traceability, system efficiency, and process automation. Moreover, for the questionnaire survey, the quantitative analysis results showed that the proposed blockchain-based system had significantly (P<.001) higher mean scores (when compared with the existing system) in terms of important factors, including timeliness, workflow efficiency, automatic notifications, insurance functionality, and auditable traceability. In summary, blockchain-based home care service participants will be able to enjoy improved efficiency, better transparency, and higher levels of process automation.ConclusionsBlockchain and smart contracts can provide valuable benefits to the home care service industry via distributed data management and process automation. The proposed system enhances user experiences by mitigating human intervention and improving service interoperability, transparency/traceability, and real-time response to home care service events. Efforts in exploring and integrating blockchain-based home care services with emerging technologies, such as the internet of things and artificial intelligence, are expected to provide further benefits and therefore are subject to future research.
| S-EPMC7420632 | biostudies-literature
Project description:BackgroundWhile health services and their clinicians might seek to be innovative, finite budgets, increased demands on health services, and ineffective implementation strategies create challenges to sustaining innovation. These challenges can be addressed by building staff capacity to design cost-effective, evidence-based innovations, and selecting appropriate implementation strategies. A bespoke university award qualification and associated program of activities was developed to build the capacity of staff at Australia's largest health service to implement and evaluate evidence-based practice (EBP): a Graduate Certificate in Health Science majoring in Health Services Innovation. The aim of this study was to establish the health service's pre-program capacity to implement EBP and to identify preliminary changes in capacity that have occurred as a result of the Health Services Innovation program.MethodsA mixed methods design underpinned by the Consolidated Framework for Implementation Research informed the research design, data collection, and analysis. Data about EBP implementation capacity aligned to the framework constructs were sought through qualitative interviews of university and health service executives, focus groups with students, and a quantitative survey of managers and students. The outcomes measured were knowledge of, attitudes towards, and use of EBP within the health service, as well as changes to practice which students identified had resulted from their participation in the program.ResultsThe Health Services Innovation program has contributed to short-term changes in health service capacity to implement EBP. Participating students have not only increased their individual skills and knowledge, but also changed their EPB culture and practice which has ignited and sustained health service innovations and improvements in the first 18 months of the program. Capacity changes observed across wider sections of the organization include an increase in connections and networks, use of a shared language, and use of robust implementation science methods such as stakeholder analyses.ConclusionThis is a unique study that assessed data from all stakeholders: university and health service executives, students, and their managers. By assembling multiple perspectives, we identified that developing the social capital of the organization through delivering a full suite of capacity-building initiatives was critical to the preliminary success of the program.
| S-EPMC9036712 | biostudies-literature
Project description:OBJECTIVES:Physical rehabilitation is a complex process, and trials of rehabilitation interventions are increasing in number but often report null results. This study aimed to establish treatment success rates in physical rehabilitation trials funded by the National Institute of Health Research Health Technology Assessment (NIHR HTA) programme and examine any relationship between treatment success and the quality of intervention development work undertaken. DESIGN:This is a mixed methods study. SETTING:This study was conducted in the UK. METHODS:The NIHR HTA portfolio was searched for all completed definitive randomised controlled trials of physical rehabilitation interventions from inception to July 2016. Treatment success was categorised according to criteria developed by Djulbegovic and colleagues. Detailed textual data regarding any intervention development work were extracted from trial reports and supporting publications and informed the development of quality ratings. Mixed methods integrative analysis was undertaken to explore the relationship between quantitative and qualitative data using joint displays. RESULTS:Fifteen trials were included in the review. Five reported a definitive finding, four of which were in favour of the 'new' intervention. Eight trials reported a true negative (no difference) outcome. Integrative analysis indicated those with lower quality intervention development work were less likely to report treatment success. CONCLUSIONS:Despite much effort and funding, most physical rehabilitation trials report equivocal findings. Greater focus on high quality intervention development may reduce the likelihood of a null result in the definitive trial, alongside high quality trial methods and conduct.
| S-EPMC6720467 | biostudies-other
Project description:To probe the complexity of modern diseases, multidisciplinary approaches are increasingly applied. Typically underpinning such studies are collaborations between wet bench experimentalists and dry lab bioinformaticians. Despite the need, bioinformatics collaborators remain difficult to find. Therefore, we undertook a study to understand the nature of this research, so that we may better understand how to meet the needs of future multidisciplinary projects. To accomplish this, we have performed a retrospective study of data from three years of projects performed by the UTHealth Bioinformatics Service Center. Based on this, we found that the bioinformatics in these collaborative projects are extremely diverse and require a high degree of intellectual engagement, while requiring only a small amount of publishable methods development. Very few of the specific skills, the strength of a service core, could be recycled across projects, which were generally exploratory and open-ended and required cycles of biological hypothesis development and (in silico) testing. We find that biomedical research requires bioinformaticians that are highly trained, having the ability to think biologically, but investigating using computational rather than bench experiments. This is in contrast to the activities that are typically the basis for an independent career in biomedical informatics, namely developing new software and algorithms. These findings suggest that to foster team-based multidisciplinary research, institutions must adopt policies that recognize contributions to research by applied bioinformatics scientists.
| S-EPMC6785826 | biostudies-literature
Project description:Service-learning (SL) helps engineering students to be involved in community activities and to be motivated by their studies. Although several reviews and research studies have been published about SL, it is not widespread in sciences and engineering at the university level. The purpose of this research is to analyze the different community services or projects where SL is implemented by engineering students and faculty and to identify the procedures that were usually implemented to assess SL-based courses and activities. Assessment could be considered as the evaluation of a specific module and the engineering competencies, the evaluation of the effectiveness of the SL program, the assessment of the participation of the student in those programs, and the assessment of whether students have achieved certain outcomes or gained specific skills. We conducted a systematic review with a search in three scientific databases: Scopus, Science Direct, and ERIC educational database to analyze the assessment methods and what that assessment covers. From 14,107 publications related to SL, 120 documents were analyzed to inform the conclusions of this study. We found that SL is widely used in several universities as experiential education, and it is considered an academic activity. The most widely used assessment technique is a survey to evaluate the engagement and attitudes of students and, to a lesser extent, teamwork presentations.
| S-EPMC8343223 | biostudies-literature
Project description:The Final Degree Project (FDP) is a module that, although intended for the completion of a bachelor thesis (BT), consists of theoretical and clinical teaching. Therefore, introducing service learning (SL) can support student adjustments to the real-world professional role. This study plans to evaluate a teaching innovation project that combines BT and SL through Kirkpatrick's four-level model (reaction, learning, behaviour and results). It takes the form of a convergent parallel mixed-methods design study. The participants were 15 final-year students obtaining a Bachelor of Nursing degree, 4 BT supervising mentors and 4 nurses. At the request of a hospital institution, in their BT, students completed a review of evidence-based nursing protocols. For data collection, the researchers used: an SL questionnaire, student narratives, mentor field diaries and nurse interviews. According to student opinion, the results showed high satisfaction rates (4.44 out of 5), the most developed skills were Independent Work and Information Management, but they signal the need to reinforce the research methodology skills. Finally, positive feedback from all participants is that using SL promotes both the opinion that the BT is useful and also promotes a collaboration between academic and clinical settings.
| S-EPMC9566517 | biostudies-literature
Project description:ObjectivesTo perform a mixed-methods study identifying motivators and deterrents to female doctors interested in core surgical training (CST). To provide tangible implementations based on the findings.DesignThis study used quantitative (questionnaires) and qualitative (semistructured interviews (SSIs)) analyses. Participants completed online questionnaires on Qualtrics and SSIs were conducted remotely on Microsoft Teams. Questions were derived from previous studies and a novel term, the gender impact rating (GIR), was coined to assess the impact of gender on opportunities available during CST application.SettingParticipants were working in the UK National Health Service and data collected from December 2020 to January 2021.ParticipantsA total of 100 female surgical trainees in the UK ranging from Foundation Year 2 to Core Training Year 2.Main outcome measuresParticipants ranked factors by their influence on their CST application. Of the 100 trainees, 21 were randomly selected for an SSI to explore their questionnaire responses. Statistical analyses were performed using MATLAB and SPSS, alongside a thematic analysis of the interviews.ResultsA total of 44 out of 100 questionnaire respondents ranked early exposure to surgery as the most influential motivator, while 43% selected work-life balance as the greatest deterrent and 33% suggested mentoring schemes to encourage women to apply to CST. The median GIR was 3 out of 5, indicating a moderate perceived impact of gender on opportunities available during CST application. Qualitative analysis found four overarching themes: institutional factors (including mentorship schemes), organisational culture (including active engagement), social factors and personal factors.ConclusionThematic analysis suggested that seniors involving women in theatre and a supportive work environment would encourage entry of more female surgeons. Therefore, the proposed implementations are the active engagement of women in theatre and destigmatising less than full-time training. Further research into ethnicity and personality on motivations to enter surgery is advised.
| S-EPMC9723904 | biostudies-literature
Project description:BACKGROUND:Mental health service managers must take into account multiple factors when making decisions about the best way to deliver care to clients across increasingly larger service areas. This task is made more difficult by the lack of evidence and tools historically available to inform these decisions. In recent decades, the increasing availability of epidemiological and service use data for mental illness has solved the problem of evidence, but there still exists a challenge to make these data easily accessible and understandable for managers. OBJECTIVE:This study aims to develop a simulation modeling tool to allow managers to explore various service configurations in virtual reality, enabling predictions to be made about the cost and quality of care. METHODS:This is a longitudinal, mixed-methods case study, comprising overlapping intervention and evaluation phases. In partnership with senior managers of a mental health program, the researchers will develop a series of simulation models in Arena to address key strategic issues facing the service. Thematic and content analyses of semistructured interviews, meeting observations, and document analysis will be used to evaluate the process of model implementation and the outcomes for both researchers and managers. The study is being conducted in Australia. RESULTS:Data collection has been ongoing since late 2013. To date, 3 prototype simulation models have been developed and presented to senior managers, and 18 evaluation interviews have been conducted. The project is expected to conclude in late 2018. CONCLUSIONS:Findings of this study have the potential to shape decision making in mental health service delivery, by providing key examples of how to integrate patient data using simulation modeling. In addition, the results will provide key insights into how researchers and consultants can effectively implement simulation modeling in real-world health care organizations. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID):RR1-10.2196/11119.
| S-EPMC6301811 | biostudies-other
Project description:BackgroundClinician-educator (CE) careers in academic medicine are heterogeneous. Expectations for CEs have grown, along with a need to better prepare CEs for these roles.ObjectiveTo assess whether advanced education training is associated with productivity and success.DesignWe used a sequential mixed methods approach, collecting quantitative survey data and qualitative focus groups data. We developed a three-tiered categorization of advanced training to reflect intensity by program type.ParticipantsWe surveyed CEs in the Society of General Internal Medicine (SGIM) and conducted two focus groups at an SGIM annual meeting.Main measuresPrimary outcomes were academic productivity (manuscripts, presentations, etc.) and leadership role attainment. Secondary analysis examined the interactive effect of gender and training intensity on these outcomes.Key resultsA total of 198 completed the survey (response rate 53%). Compared with medium- or low-intensity training, high-intensity training was associated with a greater likelihood of publishing ≥ 3 first- or senior-author manuscripts (adjusted OR 2.6; CI 0.8-8.6; p = 0.002), teaching ≥ 3 lectures/workshops at the regional/national/international level (adjusted OR 5.7; CI 1.5-21.3; p = 0.001), and having ≥ 3 regional/national committee memberships (adjusted OR 3.4; CI 1.0-11.7; p = 0.04). Among participants in the "no training" and "high-intensity training" categories, men were more likely to have ≥ 3 publications (OR 4.87 and 3.17, respectively), while women in the high intensity category had a likelihood similar to men with no training (OR 4.81 vs. OR 4.87). Participants felt the value of advanced training exists not only in content but also in networking opportunities that programs provide.ConclusionsWhile opinions were divided as to whether advanced training is necessary to position oneself for education roles, it is associated with greater academic productivity and reduced gender disparity in the publication domain. Institutions should consider providing opportunities for CEs to pursue advanced education training.
| S-EPMC7728987 | biostudies-literature
Project description:BackgroundCOVID-19 required mental health services to quickly switch from face-to-face service delivery to telehealth (telephone and videoconferencing). This evaluation explored implementation of a telehealth mental health response in a regional public mental health provider.MethodsA mixed methods approach, combining service use data, brief satisfaction surveys, and qualitative interviews/focus groups was undertaken. Number and types of contacts from de-identified mental health service data were compared between April-May 2020 and April-May 2019. Mental health consumers and providers completed brief online satisfaction surveys after videoconferencing sessions. Attitudes and perspectives on the implementation of telehealth were further explored by applying a descriptive qualitative framework to the analysis of interview and focus group data supplied by consumers and providers. Template thematic analysis was used to elucidate key themes relating to the barriers and enablers of telehealth uptake and future implementation recommendations.ResultsTotal contacts decreased by 13% from 2019 to 2020. Face-to-face contacts decreased from 55% of total in 2019 to 24% in 2020. In 2019, 45% of contacts were by telephone, increasing to 70% in 2020. Only four videoconferencing contacts were made in 2019; increasing to 886 in 2020. Consumer surveys (n = 26) rated videoconferencing as good or excellent for technical quality (92%), overall experience (86%), and satisfaction with personal comfort (82%). Provider surveys (n = 88) rated technical quality as good or excellent (68%) and 86% could achieve assessment/treatment goals with videoconferencing. Provider focus groups/interviews (n = 32) identified that videoconferencing was well-suited to some clinical tasks. Consumers interviewed (n = 6) endorsed the ongoing availability of telehealth within a blended approach to service delivery. Both groups reflected on videoconferencing limitations due to infrastructure (laptops, phones, internet access), cumbersome platform and privacy concerns, with many reverting to telephone use.ConclusionsWhile videoconferencing increased, technical and other issues led to telephone being the preferred contact method. Satisfaction surveys indicated improvement opportunities in videoconferencing. Investment in user-friendly platforms, telehealth infrastructure and organisational guidelines are needed for successful integration of videoconferencing in public mental health systems.
| S-EPMC9388972 | biostudies-literature