Toward Better Reproducibility in Experimental Research on New Agents for Pulmonary Hypertension. An Analysis of Data from Four Hundred Animal Studies.
Ontology highlight
ABSTRACT: Purpose
Pre-clinical data can provide a rationale for subsequent clinical trials and they are the first step in drug development; however, the therapeutic effect observed during animal studies does not necessarily translate to similar results in humans.Methods
Taking the example of pulmonary hypertension, the present study explores whether the methodological aspects of preclinical experiments can determine the final result.Results
The present paper describes a systematic analysis of 409 studies conducted on a variety of animal models to identify potential drug candidates for PH treatment; it explores the influence of various aspects of study design on the final outcome, e.g. type of animal model of PH, dosage schedules of tested agents, type of anesthesia, measurement of exercise intolerance or animal survival.Conclusions
The animal models of PH used for pre-clinical studies are diverse and there are several methodological items within the established protocols that can determine the obtained result. Graphical abstract.
SUBMITTER: Jasinska-Stroschein M
PROVIDER: S-EPMC8266793 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundDue to scientific and technical advancements in the field, published hypertension research has developed substantially during the last decade. Given the amount of scientific material published in this field, identifying the relevant information is difficult. We used topic modeling, which is a strong approach for extracting useful information from enormous amounts of unstructured text.ObjectiveThis study aims to use a machine learning algorithm to uncover hidden topics and subtopics from 100 years of peer-reviewed hypertension publications and identify temporal trends.MethodsThe titles and abstracts of hypertension papers indexed in PubMed were examined. We used the latent Dirichlet allocation model to select 20 primary subjects and then ran a trend analysis to see how popular they were over time.ResultsWe gathered 581,750 hypertension-related research articles from 1900 to 2018 and divided them into 20 topics. These topics were broadly categorized as preclinical, epidemiology, complications, and therapy studies. Topic 2 (evidence review) and topic 19 (major cardiovascular events) are the key (hot topics). Most of the cardiopulmonary disease subtopics show little variation over time, and only make a small contribution in terms of proportions. The majority of the articles (414,206/581,750; 71.2%) had a negative valency, followed by positive (119, 841/581,750; 20.6%) and neutral valency (47,704/581,750; 8.2%). Between 1980 and 2000, negative sentiment articles fell somewhat, while positive and neutral sentiment articles climbed substantially.ConclusionsThe number of publications has been increasing exponentially over the period. Most of the uncovered topics can be grouped into four categories (ie, preclinical, epidemiology, complications, and treatment-related studies).
| S-EPMC9161044 | biostudies-literature
Project description:Scientists who perform major survival surgery on laboratory animals face a dual welfare and methodological challenge: how to choose surgical anesthetics and post-operative analgesics that will best control animal suffering, knowing that both pain and the drugs that manage pain can all affect research outcomes. Scientists who publish full descriptions of animal procedures allow critical and systematic reviews of data, demonstrate their adherence to animal welfare norms, and guide other scientists on how to conduct their own studies in the field. We investigated what information on animal pain management a reasonably diligent scientist might find in planning for a successful experiment. To explore how scientists in a range of fields describe their management of this ethical and methodological concern, we scored 400 scientific articles that included major animal survival surgeries as part of their experimental methods, for the completeness of information on anesthesia and analgesia. The 400 articles (250 accepted for publication pre-2011, and 150 in 2014-15, along with 174 articles they reference) included thoracotomies, craniotomies, gonadectomies, organ transplants, peripheral nerve injuries, spinal laminectomies and orthopedic procedures in dogs, primates, swine, mice, rats and other rodents. We scored articles for Publication Completeness (PC), which was any mention of use of anesthetics or analgesics; Analgesia Use (AU) which was any use of post-surgical analgesics, and Analgesia Completeness (a composite score comprising intra-operative analgesia, extended post-surgical analgesia, and use of multimodal analgesia). 338 of 400 articles were PC. 98 of these 338 were AU, with some mention of analgesia, while 240 of 338 mentioned anesthesia only but not post-surgical analgesia. Journals' caliber, as measured by their 2013 Impact Factor, had no effect on PC or AU. We found no effect of whether a journal instructs authors to consult the ARRIVE publishing guidelines published in 2010 on PC or AC for the 150 mouse and rat articles in our 2014-15 dataset. None of the 302 articles that were silent about analgesic use included an explicit statement that analgesics were withheld, or a discussion of how pain management or untreated pain might affect results. We conclude that current scientific literature cannot be trusted to present full detail on use of animal anesthetics and analgesics. We report that publication guidelines focus more on other potential sources of bias in experimental results, under-appreciate the potential for pain and pain drugs to skew data, and thus mostly treat pain management as solely an animal welfare concern, in the jurisdiction of animal care and use committees. At the same time, animal welfare regulations do not include guidance on publishing animal data, even though publication is an integral part of the cycle of research and can affect the welfare of animals in studies building on published work, leaving it to journals and authors to voluntarily decide what details of animal use to publish. We suggest that journals, scientists and animal welfare regulators should revise current guidelines and regulations, on treatment of pain and on transparent reporting of treatment of pain, to improve this dual welfare and data-quality deficiency.
| S-EPMC4865140 | biostudies-literature
Project description:Single-laboratory studies conducted under highly standardized conditions are the gold standard in preclinical animal research. Using simulations based on 440 preclinical studies across 13 different interventions in animal models of stroke, myocardial infarction, and breast cancer, we compared the accuracy of effect size estimates between single-laboratory and multi-laboratory study designs. Single-laboratory studies generally failed to predict effect size accurately, and larger sample sizes rendered effect size estimates even less accurate. By contrast, multi-laboratory designs including as few as 2 to 4 laboratories increased coverage probability by up to 42 percentage points without a need for larger sample sizes. These findings demonstrate that within-study standardization is a major cause of poor reproducibility. More representative study samples are required to improve the external validity and reproducibility of preclinical animal research and to prevent wasting animals and resources for inconclusive research.
| S-EPMC5823461 | biostudies-literature
Project description:The fields of applied and translational microRNA research have exploded in recent years as microRNAs have been implicated across a spectrum of diseases. MicroRNA biomarkers, microRNA therapeutics, microRNA regulation of cellular physiology and even xenomiRs have stimulated great interest, which have brought many researchers into the field. Despite many successes in determining general mechanisms of microRNA generation and function, the application of microRNAs in translational areas has not had as much success. It has been a challenge to localize microRNAs to a given cell type within tissues and assay them reliably. At supraphysiologic levels, microRNAs may regulate hosts of genes that are not the physiologic biochemical targets. Thus the applied and translational microRNA literature is filled with pitfalls and claims that are neither scientifically rigorous nor reproducible. This review is focused on increasing awareness of the challenges of working with microRNAs in translational research and recommends better practices in this area of discovery.
| S-EPMC5100345 | biostudies-literature
Project description:Because of the importance of testing reproducibility of results, we present our findings regarding screening agents in preclinical chemoprevention studies in rodent models performed by the Chemopreventive Agent Development Research Group (CADRG) of the Division of Cancer Prevention of the NCI. These studies were performed via contracts to various commercial and academic laboratories. Primarily, results with positive agents are reported because positive agents may progress to the clinics. In testing reproducibility, a limited number of direct repeats of our standard screening assays were performed; which entailed initiating treatment shortly after carcinogen administration or in young transgenic mice and continuing treatment until the end of the study. However, three additional protocols were employed relating to reproducibility: (i) testing agents at lower doses to determine efficacy and reduced toxicity; (ii) testing agents later in tumor progression when microscopic lesions existed and, (iii) testing multiple agents of the same mechanistic class. Data with six models that were routinely employed are presented: MNU-induced ER-positive mammary cancer in rats; MMTV-Neu ER-negative mammary cancers in transgenic mice; AOM-induced colon tumors in rats; intestinal adenomas in Min mice; OH-BBN-induced invasive rat urinary bladder cancers in rats; and UV-induced skin squamous carcinomas in mice. It was found that strongly positive results were highly reproducible in the preclinical models evaluated. Cancer Prev Res; 11(10); 595-606. ©2018 AACR.
| S-EPMC6186395 | biostudies-literature
Project description:The lack of reproducibility of animal experimental results between laboratories, particularly in studies investigating the microbiota, has raised concern among the scientific community. Factors such as environment, stress and sex have been identified as contributors, whereas dietary composition has received less attention. This study firstly evaluated the use of commercially available rodent diets across research institutions, with 28 different diets reported by 45 survey respondents. Secondly, highly variable ingredient, FODMAP (Fermentable Oligo-, Di-, Mono-saccharides And Polyols) and gluten content was found between different commercially available rodent diets. Finally, 40 mice were randomized to four groups, each receiving a different commercially available rodent diet, and the dietary impact on cecal microbiota, short- and branched-chain fatty acid profiles was evaluated. The gut microbiota composition differed significantly between diets and sexes, with significantly different clusters in ?-diversity. Total BCFA were highest (p?=?0.01) and SCFA were lowest (p?=?0.03) in mice fed a diet lower in FODMAPs and gluten. These results suggest that nutritional composition of commercially available rodent diets impact gut microbiota profiles and fermentation patterns, with major implications for the reproducibility of results across laboratories. However, further studies are required to elucidate the specific dietary factors driving these changes.
| S-EPMC7575541 | biostudies-literature
Project description:In light of the hotly discussed 'reproducibility crisis', a rethinking of current methodologies appears essential. Implementing multi-laboratory designs has been shown to enhance the external validity and hence the reproducibility of findings from animal research. We here aimed at proposing a new experimental strategy that transfers this logic into a single-laboratory setting. We systematically introduced heterogeneity into our study population by splitting an experiment into several 'mini-experiments' spread over different time points a few weeks apart. We hypothesised to observe improved reproducibility in such a 'mini-experiment' design in comparison to a conventionally standardised design, according to which all animals are tested at one specific point in time. By comparing both designs across independent replicates, we could indeed show that the use of such a 'mini-experiment' design improved the reproducibility and accurate detection of exemplary treatment effects (behavioural and physiological differences between four mouse strains) in about half of all investigated strain comparisons. Thus, we successfully implemented and empirically validated an easy-to-handle strategy to tackle poor reproducibility in single-laboratory studies. Since other experiments within different life science disciplines share the main characteristics with the investigation reported here, these studies are likely to also benefit from this approach.
| S-EPMC7538440 | biostudies-literature
Project description:Biomineralization plays a fundamental role in the global silicon cycle. Grasses are known to mobilize significant quantities of Si in the form of silica biominerals and dominate the terrestrial realm today, but they have relatively recent origins and only rose to taxonomic and ecological prominence within the Cenozoic Era. This raises questions regarding when and how the biological silica cycle evolved. To address these questions, we examined silica abundances of extant members of early-diverging land plant clades, which show that silica biomineralization is widespread across terrestrial plant linages. Particularly high silica abundances are observed in lycophytes and early-diverging ferns. However, silica biomineralization is rare within later-evolving gymnosperms, implying a complex evolutionary history within the seed plants. Electron microscopy and X-ray spectroscopy show that the most common silica-mineralized tissues include the vascular system, epidermal cells, and stomata, which is consistent with the hypothesis that biomineralization in plants is frequently coupled to transpiration. Furthermore, sequence, phylogenetic, and structural analysis of nodulin 26-like intrinsic proteins from diverse plant genomes points to a plastic and ancient capacity for silica accumulation within terrestrial plants. The integration of these two comparative biology approaches demonstrates that silica biomineralization has been an important process for land plants over the course of their >400 My evolutionary history.
| S-EPMC4418875 | biostudies-literature
Project description:Given the complexity of ERP recording and processing pipeline, the resulting variability of methodological options, and the potential for these decisions to influence study outcomes, it is important to understand how ERP studies are conducted in practice and to what extent researchers are transparent about their data collection and analysis procedures. The review gives an overview of methodology reporting in a sample of 132 ERP papers, published between January 1980 - June 2018 in journals included in two large databases: Web of Science and PubMed. Because ERP methodology partly depends on the study design, we focused on a well-established component (the N400) in the most commonly assessed population (healthy neurotypical adults), in one of its most common modalities (visual images). The review provides insights into 73 properties of study design, data pre-processing, measurement, statistics, visualization of results, and references to supplemental information across studies within the same subfield. For each of the examined methodological decisions, the degree of consistency, clarity of reporting and deviations from the guidelines for best practice were examined. Overall, the results show that each study had a unique approach to ERP data recording, processing and analysis, and that at least some details were missing from all papers. In the review, we highlight the most common reporting omissions and deviations from established recommendations, as well as areas in which there was the least consistency. Additionally, we provide guidance for a priori selection of the N400 measurement window and electrode locations based on the results of previous studies.
| S-EPMC9381463 | biostudies-literature
Project description:BackgroundLack of reproducibility of preclinical studies has been identified as an impediment for translation of basic mechanistic research into effective clinical therapies. Indeed, the National Institutes of Health has revised its grant application process to require more rigorous study design, including sample size calculations, blinding procedures, and randomization steps. We hypothesized that the reporting of such metrics of study design rigor has increased over time for animal-experimental research published in anesthesia journals.MethodsPubMed was searched for animal-experimental studies published in 2005, 2010, and 2015 in primarily English-language anesthesia journals. A total of 1466 publications were graded on the performance of sample size estimation, randomization, and blinding. Cochran-Armitage test was used to assess linear trends over time for the primary outcome of whether or not a metric was reported. Interrater agreement for each of the 3 metrics (power, randomization, and blinding) was assessed using the weighted κ coefficient in a 10% random sample of articles rerated by a second investigator blinded to the ratings of the first investigator.ResultsA total of 1466 manuscripts were analyzed. Reporting for all 3 metrics of experimental design rigor increased over time (2005 to 2010 to 2015): for power analysis, from 5% (27/516), to 12% (59/485), to 17% (77/465); for randomization, from 41% (213/516), to 50% (243/485), to 54% (253/465); and for blinding, from 26% (135/516), to 38% (186/485), to 47% (217/465). The weighted κ coefficients and 98.3% confidence interval indicate almost perfect agreement between the 2 raters beyond that which occurs by chance alone (power, 0.93 [0.85, 1.0], randomization, 0.91 [0.85, 0.98], and blinding, 0.90 [0.84, 0.96]).ConclusionsOur hypothesis that reported metrics of rigor in animal-experimental studies in anesthesia journals have increased during the past decade was confirmed. More consistent reporting, or explicit justification for absence, of sample size calculations, blinding techniques, and randomization procedures could better enable readers to evaluate potential sources of bias in animal-experimental research manuscripts. Future studies should assess whether such steps lead to improved translation of animal-experimental anesthesia research into successful clinical trials.
| S-EPMC5548642 | biostudies-literature