Dataset Information

The clinical relevance and newsworthiness of NIHR HTA-funded research: a cohort study.

ABSTRACT:

Objective

To assess the clinical relevance and newsworthiness of the UK National Institute for Health Research (NIHR) Health Technology Assessment (HTA) Programme funded reports.

Study design

Retrospective cohort study.

Setting

The cohort included 311 NIHR HTA Programme funded reports publishing in HTA in the period 1 January 2007-31 December 2012. The McMaster Online Rating of Evidence (MORE) system independently identified the clinical relevance and newsworthiness of NIHR HTA publications and non-NIHR HTA publications. The MORE system involves over 4000 physicians rating publications on a scale of relevance (the extent to which articles are relevant to practice) and a scale of newsworthiness (the extent to which articles contain news or something clinicians are unlikely to know).

Main outcome measures

The proportion of reports published in HTA meeting MORE inclusion criteria and mean average relevance and newsworthiness ratings were calculated and compared with publications from the same studies publishing outside HTA and non-NIHR HTA funded publications.

Results

286/311 (92.0%) of NIHR HTA reports were assessed by MORE, of which 192 (67.1%) passed MORE criteria. The average clinical relevance rating for NIHR HTA reports was 5.48, statistically higher than the 5.32 rating for non-NIHR HTA publications (mean difference=0.16, 95% CI 0.04 to 0.29, p=0.01). Average newsworthiness ratings were similar between NIHR HTA reports and non-NIHR HTA publications (4.75 and 4.70, respectively; mean difference=0.05, 95% CI -0.18 to 0.07, p=0.402). NIHR HTA-funded original research reports were statistically higher for newsworthiness than reviews (5.05 compared with 4.64) (mean difference=0.41, 95% CI 0.18 to 0.64, p=0.001).

Conclusions

Funding research of clinical relevance is important in maximising the value of research investment. The NIHR HTA Programme is successful in funding projects that generate outputs of clinical relevance.

SUBMITTER: Wright D

PROVIDER: S-EPMC4024580 | biostudies-literature | 2014 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The clinical relevance and newsworthiness of NIHR HTA-funded research: a cohort study.

Wright D D Young A A Iserman E E Maeso R R Turner S S Haynes R B RB Milne R R

BMJ open 20140507 5

<h4>Objective</h4>To assess the clinical relevance and newsworthiness of the UK National Institute for Health Research (NIHR) Health Technology Assessment (HTA) Programme funded reports.<h4>Study design</h4>Retrospective cohort study.<h4>Setting</h4>The cohort included 311 NIHR HTA Programme funded reports publishing in HTA in the period 1 January 2007-31 December 2012. The McMaster Online Rating of Evidence (MORE) system independently identified the clinical relevance and newsworthiness of NIHR ...[more]

PMID: 24812191

Similar Datasets

Project description:BackgroundA systematic review, with or without a meta-analysis, should be undertaken to determine if the research question of interest has already been answered before a new trial begins. There has been limited research on how systematic reviews are used within the design of new trials, the aims of this study were to investigate how systematic reviews of earlier trials are used in the planning and design of new randomised trials.MethodsDocumentation from the application process for all randomised trials funded by the National Institute for Health Research Health Technology Assessment (NIHR HTA) between 2006 and 2008 were obtained. This included the: commissioning brief (if appropriate), outline application, minutes of the Board meeting in which the outline application was discussed, full application, detailed project description, referee comments, investigator response to referee comments, Board minutes on the full application and the trial protocol. Data were extracted on references to systematic reviews and how any such reviews had been used in the planning and design of the trial.Results50 randomised trials were funded by NIHR HTA during this period and documentation was available for 48 of these. The cohort was predominately individually randomised parallel trials aiming to detect superiority between two treatments for a single primary outcome. 37 trials (77.1%) referenced a systematic review within the application and 20 of these (i.e. 41.7% of the total) used information contained in the systematic review in the design or planning of the new trial. The main areas in which systematic reviews were used were in the selection or definition of an outcome to be measured in the trial (7 of 37, 18.9%), the sample size calculation (7, 18.9%), the duration of follow up (8, 21.6%) and the approach to describing adverse events (9, 24.3%). Boards did not comment on the presence/absence or use of systematic reviews in any application.ConclusionsSystematic reviews were referenced in most funded applications but just over half of these used the review to inform the design. There is an expectation from funders that applicants will use a systematic review to justify the need for a new trial but no expectation regarding further use of a systematic review to aid planning and design of the trial. Guidelines for applicants and funders should be developed to promote the use of systematic reviews in the design and planning of randomised trials, to optimise delivery of new studies informed by the most up-to-date evidence base and to minimise waste in research.

Project description:BACKGROUND:The mechanisms and pathways to impacts from public health research in the UK have not been widely studied. Through the lens of one funder (NIHR), our aims are to map the diversity of public health research, in terms of funding mechanisms, disciplinary contributions, and public health impacts, identify examples of impacts, and pathways to impact that existing reporting mechanisms may not otherwise have captured, and provide illustrations of how public health researchers perceive the generation of non-academic impact from their work. METHODS:A total of 1386 projects were identified as 'public health research' by the NIHR and listed in the NIHR Public Health Overview database (2000-2016). From these, a subset of 857 projects were matched as potentially having begun reporting impacts via an external data-gathering platform (Researchfish). Data on the 857 projects were analyzed quantitatively, and nine projects were selected to investigate further through semi-structured interviews with principal investigators. Two workshops took place to validate emerging and final findings and facilitate analysis. RESULTS:In addition to the NIHR School for Public Health Research and the NIHR Public Health Research Programme, 89% of projects contained in the NIHR Public Health Overview portfolio as 'public health research' are funded via other NIHR research programmes, suggesting significant diversity in disciplines contributing to public health research and outcomes. The pathways to impact observed in our in-depth case studies include contributing to debates on what constitutes appropriate evidence for national policy change, acknowledging local 'unintended' impacts, building trusted relationships with stakeholders across health and non-health sectors and actors, collaborating with local authorities, and using non-academic dissemination channels. CONCLUSIONS:Public health as a discipline contributes substantially to impact beyond academia. To support the diversity of these impacts, we need to recognise localized smaller-scale impacts, and the difference in types of evidence required for community and local authority-based impacts. This will also require building capacity and resources to enable impact to take place from public health research. Finally, support is required for engagement with local authorities and working with non-health sectors that contribute to health outcomes.

Project description:ObjectiveIn 2017, the National Institute for Health Research (NIHR) academy produced a strategic review of training, which reported the variation in application characteristics associated with success rates. It was noted that variation in applicant characteristic was not independent of one another. Therefore, the aim of this secondary analysis was to investigate the inter-relationships in order to identify factors (or groups of factors) most associated with application numbers and success rates.DesignRetrospective data were gathered from 4388 applications to NIHR Academy between 2007 and 2016. Multinominal logistic regression models quantified the likelihood of success depending on changes in the explanatory factors; relative risk ratios with 95% CIs. A classification tree analysis was built using exhaustive χ2 automatic interaction detection to better understand the effect of interactions between explanatory variables on application success rates.Results936 (21.3%) applications were awarded. Applications from males and females were equally likely to be successful (p=0.71). There was an overall reduction in numbers of applications from females as award seniority increased from predoctoral to professorship. Applications from institutions with a medical school had a 2.6-fold increase in likelihood of success (p<0.001). Classification tree analysis revealed key predictors of application success: award level, type of programme, previous NIHR award experience and applying form a medical school.ConclusionSuccess rates did not differ according to gender, and doctors were not more likely to be successful than applications from other professions. Taken together, these findings suggest an essential fairness in how the quality of a submitted application is assessed, but they also raise questions about variation in the opportunity to submit a high-quality application. The companion qualitative study (Burkshaw et al. (2021) BMJ Open) provides valuable insight into potential candidate mechanisms and discusses how research capacity development initiatives might be targeted in the future.

Project description:ObjectivesThe UK National Institute for Health Research (NIHR) training programmes were created to build and sustain research capacity in healthcare. Following the training programme 10-year strategic review, this qualitative study aimed to deepen understanding of facilitators and barriers for those progressing through NIHR-supported research careers.DesignSemistructured qualitative study.Data collection and analysisTelephone interviews conducted between May and August 2017 were digitally recorded, transcribed and analysed using Framework Approach.SettingUK National Health Service (NHS) Trusts, university medical schools, District General Hospitals, Integrated Academic Training Programme centres and Research Design Services across the North East, North West, South East and South West of England, London and the Midlands.ParticipantsFourteen women and eight men, of whom, 14 were previous or current NIHR personal awardees (seven doctors and seven allied health professionals (AHPs) or nurses) and eight were managers (staff within clinical or university training-related roles).Results(1) NIHR awards were viewed as transformative for research careers; (2) however, there were perceptions of a biased 'playing field'. (3) Inequalities were perceived for AHPs and nurses, those outside of established research institutes and those in 'unfashionable' specialisms. (4) While support for NIHR awards contributed to a healthy research culture, (5) short-term awards were perceived as a barrier to continuing an independent research career.ConclusionsParticipants perceived many strengths of the NIHR training programmes in terms of developing individual careers and research capacity. Areas in which improvement could enhance the ability to attract, develop and retain researcher were identified. Our findings are of relevance to schemes in other countries, where healthcare researchers experience similar challenges. Further work is needed to overcome barriers and ensure equity of access to, and success within, clinical research training schemes to sustain the research workforce needed to address future global health challenges.

Project description:Quantifying the value of investment in medical research can inform decision-making on the prioritisation of research programmes. Existing methodologies to estimate the rate of return of medical research are inappropriate for early-phase translational research due to censoring of health benefits and time lags. A strategy to improve the process of translational research for patient benefit has been initiated as part of the UK National Institute for Health Research (NIHR) investment in Biomedical Research Centres (BRCs) in England. By providing a platform for partnership between universities, NHS trusts and industry, successful BRCs should reduce time lags within translational research whilst also providing an impetus for local economic growth through industry collaboration. We present a novel contribution in the assessment of early-phase biomedical research by estimating the impact of the Oxford Biomedical Research Centre (OxBRC) on income and job creation following the initial NIHR investment. We adopt a macroeconomic assessment approach using Input-Output Analysis to estimate the value of medical research in terms of income and job creation during the early pathway towards translational biomedical research. Inter-industry linkages are assessed by building a model economy for the South East England region to estimate the return on investment of the OxBRC. The results from the input-output model estimate that the return on investment in biomedical research within the OxBRC is 46%. Each £1 invested in the OxBRC generates an additional £0.46 through income and job creation alone. Multiplicative employment effects following a marginal investment in the OxBRC of £98m during the period 2007-2017 result in an estimated additional 196 full time equivalent positions being created within the local economy on top of direct employment within OxBRC. Results from input-output analyses can be used to inform the prioritisation of biomedical research programmes when compared against national minimum thresholds of investment.

Dataset Information

The clinical relevance and newsworthiness of NIHR HTA-funded research: a cohort study.

Objective

Study design

Setting

Main outcome measures

Results

Conclusions

Publications

The clinical relevance and newsworthiness of NIHR HTA-funded research: a cohort study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets