Dataset Information

Percentile ranking and citation impact of a large cohort of National Heart, Lung, and Blood Institute-funded cardiovascular R01 grants.

ABSTRACT: RATIONALE:Funding decisions for cardiovascular R01 grant applications at the National Heart, Lung, and Blood Institute (NHLBI) largely hinge on percentile rankings. It is not known whether this approach enables the highest impact science. OBJECTIVE:Our aim was to conduct an observational analysis of percentile rankings and bibliometric outcomes for a contemporary set of funded NHLBI cardiovascular R01 grants. METHODS AND RESULTS:We identified 1492 investigator-initiated de novo R01 grant applications that were funded between 2001 and 2008 and followed their progress for linked publications and citations to those publications. Our coprimary end points were citations received per million dollars of funding, citations obtained <2 years of publication, and 2-year citations for each grant's maximally cited paper. In 7654 grant-years of funding that generated $3004 million of total National Institutes of Health awards, the portfolio yielded 16 793 publications that appeared between 2001 and 2012 (median per grant, 8; 25th and 75th percentiles, 4 and 14; range, 0-123), which received 2 224 255 citations (median per grant, 1048; 25th and 75th percentiles, 492 and 1932; range, 0-16 295). We found no association between percentile rankings and citation metrics; the absence of association persisted even after accounting for calendar time, grant duration, number of grants acknowledged per paper, number of authors per paper, early investigator status, human versus nonhuman focus, and institutional funding. An exploratory machine learning analysis suggested that grants with the best percentile rankings did yield more maximally cited papers. CONCLUSIONS:In a large cohort of NHLBI-funded cardiovascular R01 grants, we were unable to find a monotonic association between better percentile ranking and higher scientific impact as assessed by citation metrics.

SUBMITTER: Danthi N

PROVIDER: S-EPMC3959724 | biostudies-literature | 2014 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Percentile ranking and citation impact of a large cohort of National Heart, Lung, and Blood Institute-funded cardiovascular R01 grants.

Danthi Narasimhan N Wu Colin O CO Shi Peibei P Lauer Michael M

Circulation research 20140109 4

<h4>Rationale</h4>Funding decisions for cardiovascular R01 grant applications at the National Heart, Lung, and Blood Institute (NHLBI) largely hinge on percentile rankings. It is not known whether this approach enables the highest impact science.<h4>Objective</h4>Our aim was to conduct an observational analysis of percentile rankings and bibliometric outcomes for a contemporary set of funded NHLBI cardiovascular R01 grants.<h4>Methods and results</h4>We identified 1492 investigator-initiated de ...[more]

PMID: 24406983

Similar Datasets

Project description:BACKGROUND:Rapid publication of clinical trials is essential in order for the findings to yield maximal benefits for public health and scientific progress. Factors affecting the speed of publication of the main results of government-funded trials have not been well characterized. METHODS:We analyzed 244 extramural randomized clinical trials of cardiovascular interventions that were supported by the National Heart, Lung, and Blood Institute (NHLBI). We selected trials for which data collection had been completed between January 1, 2000, and December 31, 2011. Our primary outcome measure was the time between completion of the trial and publication of the main results in a peer-reviewed journal. RESULTS:As of March 31, 2012, the main results of 156 trials (64%) had been published (Kaplan-Meier median time to publication, 25 months, with 57% published within 30 months). Trials that focused on clinical events were published more rapidly than those that focused on surrogate measures (median, 9 months vs. 31 months; P<0.001). The only independent predictors of more rapid publication were a focus on clinical events rather than surrogate end points (adjusted publication rate ratio, 2.11; 95% confidence interval, 1.26 to 3.53; P=0.004) and higher costs of conducting the trial, up to a threshold of approximately $5 million (P<0.001). The 37 trials that focused on clinical events and cost at least $5 million accounted for 67% of the funds spent on clinical trials but received 82% of the citations. After adjustment of the analysis for a focus on clinical events and for cost, trial results that were classified as positive were published more quickly than those classified as negative. CONCLUSIONS:Results of less than two thirds of NHLBI-funded randomized clinical trials of cardiovascular interventions were published within 30 months after completion of the trial. Trials that focused on clinical events were published more quickly than those that focused on surrogate end points. (Funded by the National Heart, Lung, and Blood Institute.).

Project description:The National Institute of Academic Anaesthesia (NIAA) was founded in 2008 to lead a UK strategy for developing academic anaesthesia. We aimed to assess the distribution of applications and quantify the academic returns of NIAA-supported research grants, as this has hitherto not been analysed. We sought data on the baseline characteristics of all grant applicants and recipients. Every grant recipient from 2008 to 2015 was contacted to ascertain the status of their supported research projects. We also examined Google Scholar, Scopus® database and InCites Journal Citation Reports for citation, author and journal metrics, respectively. In total, 495 research project applications were made, with 150 grants being awarded. Data on 121 out of 150 (80.7%) grant awards, accounting for £3.5 million, were collected, of which 91 completed studies resulted in 140 publications and 2759 citations. The median (IQR [range]) time to first or only publication was 3 (2-4 [0-9]) years. The overall cost per publication was £14,970 (£7457-£24,998 [£2212-£73,755]) and the cost per citation was £1515 (£323-£3785 [£70-£36,182]), with 1 (0-2 [0-8]) publication and 4 (0-25 [0-265]) citations resulting per grant. The impact factor of journals in which publications arose was 4.7 (2.5-6.2 [0-47.8]), with the highest impact arising from clinical and basic science studies, particularly in the fields of pain and peri-operative medicine. Grants were most frequently awarded to clinical and basic science categories of study, but in terms of specialty, critical care medicine and peri-operative medicine received the greatest number of grants. Superficially, there seemed a geographical disparity, with 123 (82%) grants being awarded to researchers in England, London receiving 48 (32%) of these. However, this was in proportion to the number of grant applications received by country or city of application, such that there was no significant difference in overall success rates. There was no significant difference in productivity in terms of publications and citations from grants awarded to each city. The 150 grants were awarded to 107 recipients (identified as the most senior applicant for each grant), 27 of whom received ≥ two grants. Recipients had a median career total of 21 (8-76 [0-254]) publications and 302 (44-1320 [0-8167]) citations, with an h-index of 8 (3-22 [0-54]). We conclude that a key determinant of grant success is simply applying. This is the first study to report the distribution and scholarly output of individual anaesthesia research grants, particularly from a collaborative body such as the NIAA, and can be used as a benchmark to further develop academic anaesthesia in the UK and beyond.

Dataset Information

Percentile ranking and citation impact of a large cohort of National Heart, Lung, and Blood Institute-funded cardiovascular R01 grants.

Publications

Percentile ranking and citation impact of a large cohort of National Heart, Lung, and Blood Institute-funded cardiovascular R01 grants.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets