Dataset Information

How research data deliver non-academic impacts: A secondary analysis of UK Research Excellence Framework impact case studies.

ABSTRACT: This study investigates how research data contributes to non-academic impacts using a secondary analysis of high-scoring impact case studies from the UK's Research Excellence Framework (REF). A content analysis was conducted to identify patterns, linking research data and impact. The most prevalent type of research data-driven impact related to "practice" (45%), which included changing how professionals operate, changing organizational culture and improving workplace productivity or outcomes. The second most common category was "government impacts", including reducing government service costs and enhancing government effectiveness or efficiency. Impacts from research data were developed most frequently through "improved institutional processes or methods" (40%) and developing impact via pre-analyzed or curated information in reports (32%), followed by "analytic software or methods" (26%). The analysis found that research data on their own rarely generate impacts. Instead they require analysis, curation, product development or other forms of significant intervention to leverage broader non-academic impacts.

SUBMITTER: Jensen EA

PROVIDER: S-EPMC8912237 | biostudies-literature | 2022

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

How research data deliver non-academic impacts: A secondary analysis of UK Research Excellence Framework impact case studies.

Jensen Eric A EA Wong Paul P Reed Mark S MS

PloS one 20220310 3

This study investigates how research data contributes to non-academic impacts using a secondary analysis of high-scoring impact case studies from the UK's Research Excellence Framework (REF). A content analysis was conducted to identify patterns, linking research data and impact. The most prevalent type of research data-driven impact related to "practice" (45%), which included changing how professionals operate, changing organizational culture and improving workplace productivity or outcomes. Th ...[more]

PMID: 35271630

Similar Datasets

Project description:IntroductionAn impactful clinical trial will have real-life benefits for patients and society beyond the academic environment. This study analyses case studies of cancer trials to understand how impact is evidenced for cancer trials and how impact evaluation can be more routinely adopted and improved.MethodsThe United Kingdom (UK) Government allocates research funding to higher-education institutions based on an assessment of the institutions' previous research efforts, in an exercise known as the Research Excellence Framework (REF). In addition to each institution's journal publications and research environment, for the first time in 2014, allocation of funding was also dependent on an evaluation of the wider, societal impact of research conducted. In the REF2014, impact assessment was performed by evaluation of impact case studies. In this study, case studies (n = 6637) submitted by institutions for the REF2014 were accessed and those focussing on cancer trials were identified. Manual content analysis was then used to assess the characteristics of the cancer trials discussed in the case studies, the impact described and the methods used by institutions to demonstrate impact.ResultsForty-six case studies describing 106 individual cancer trials were identified. The majority were phase III randomised controlled trials and those recruiting patients with breast cancer. A list of indicators of cancer trial impact was generated using the previous literature and developed inductively using these case studies. The most common impact from a cancer trial identified in the case studies was on policy, in particular citation of trial findings in clinical guidelines. Impact on health outcomes and the economy were less frequent and health outcomes were often predicted rather than evidenced. There were few descriptions identified of trialists making efforts to maximise trial impact.DiscussionCancer trial impact narratives for the next REF assessment exercise in 2021 can be improved by evidencing actual rather than predicted Impact, with a clearer identification of the beneficiaries of cancer trials and the processes through which trial results are used. Clarification of the individuals responsible for performing impact evaluations of cancer trials and the provision of resources to do so needs to be addressed if impact evaluation is to be sustainable.

Project description:Impactful academic research plays a stellar role in society, pressing to ask the question of how one measures the impact created by different areas of academic research. Measuring the societal, cultural, economic and scientific impact of research is currently the priority of the National Science Foundation, European Commission and several research funding agencies. The recently concluded United Kingdom's national research quality exercise, the Research Excellence Framework (REF) 2014, which piloted impact assessment as part of the overall evaluation offers a lens to view how impact of research in different disciplines can be measured. Overall research quality was assessed through quality of outputs, 'impact' and research environment. We performed two studies using the REF 2014 as a case study. The first study on 363 Impact Case Studies (ICSs) submitted in 5 research areas (UoAs) reveals that, in general, the impact scores were constructed upon a combination of factors i.e. quantity of quartile-one (Q1) publications, quantity and value of grants/income, number of researchers stated in the ICSs, spin-offs created, discoveries/patents and presentation of esteem data, informing researchers/ academics of the factors to consider in order to achieve a better impact score in research impact assessments. However, there were differences among disciplines in terms of the role played by the factors in achieving their overall scores for the ICSs. The outcome of this study is thus a set of impact indicators, and their relationship with the overall score of impact of research in different disciplines as determined in REF2014, which would in the first instance provide some answers to impact measures that would be useful for researchers in different disciplines. The second study extracts the general themes of impact reported by universities by performing a word frequency analysis in all the ICSs submitted in the five chosen research areas, which were substantially varied owing to their fields.

Project description:BackgroundClinical research has been central to the global response to COVID-19, and the United Kingdom (UK), with its research system embedded within the National Health Service (NHS), has been singled out globally for the scale and speed of its COVID-19 research response. This paper explores the impacts of COVID-19 on clinical research in an NHS Trust and how the embedded research system was adapted and repurposed to support the COVID-19 response.Methods and findingsUsing a multi-method qualitative case study of a research-intensive NHS Trust in London UK, we collected data through a questionnaire (n = 170) and semi-structured interviews (n = 24) with research staff working in four areas: research governance; research leadership; research delivery; and patient and public involvement. We also observed key NHS Trust research prioritisation meetings (40 hours) and PPI activity (4.5 hours) and analysed documents produced by the Trust and national organisation relating to COVID-19 research. Data were analysed for a descriptive account of the Trust's COVID-19 research response and research staff's experiences. Data were then analysed thematically. Our analysis identifies three core themes: centralisation; pace of work; and new (temporary) work practices. By centralising research prioritisation at both national and Trust levels, halting non-COVID-19 research and redeploying research staff, an increased pace in the setup and delivery of COVID-19-related research was possible. National and Trust-level responses also led to widescale changes in working practices by adapting protocols and developing local processes to maintain and deliver research. These were effective practical solutions borne out of necessity and point to how the research system was able to adapt to the requirements of the pandemic.ConclusionThe Trust and national COVID-19 response entailed a rapid large-scale reorganisation of research staff, research infrastructures and research priorities. The Trust's local processes that enabled them to enact national policy prioritising COVID-19 research worked well, especially in managing finite resources, and also demonstrate the importance and adaptability of the research workforce. Such findings are useful as we consider how to adapt our healthcare delivery and research practices both at the national and global level for the future. However, as the pandemic continues, research leaders and policymakers must also take into account the short and long term impact of COVID-19 prioritisation on non-COVID-19 health research and the toll of the emergency response on research staff.

Dataset Information

How research data deliver non-academic impacts: A secondary analysis of UK Research Excellence Framework impact case studies.

Publications

How research data deliver non-academic impacts: A secondary analysis of UK Research Excellence Framework impact case studies.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets