Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Enabling EASEY Deployment of Containerized Applications for Future HPC Systems

ABSTRACT: The upcoming exascale era will push the changes in computing architecture from classical CPU-based systems towards hybrid GPU-heavy systems with much higher levels of complexity. While such clusters are expected to improve the performance of certain optimized HPC applications, it will also increase the difficulties for those users who have yet to adapt their codes or are starting from scratch with new programming paradigms. Since there are still no comprehensive automatic assistance mechanisms to enhance application performance on such systems, we propose a support framework for future HPC architectures, called EASEY (Enable exASclae for EverYone). Our solution builds on a layered software architecture, which offers different mechanisms on each layer for different tasks of tuning, including a workflow management system. This enables users to adjust the parameters on each of the layers, thereby enhancing specific characteristics of their codes. We introduce the framework with a Charliecloud-based solution, showcasing the LULESH benchmark on the upper layers of our framework. Our approach can automatically deploy optimized container computations with negligible overhead and at the same time reduce the time a scientist needs to spent on manual job submission configurations.

SUBMITTER: Krzhizhanovskaya V

PROVIDER: S-EPMC7302254 | biostudies-literature | 2020 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

YAMP: a containerized workflow enabling reproducibility in metagenomics research.

Project description:YAMP ("Yet Another Metagenomics Pipeline") is a user-friendly workflow that enables the analysis of whole shotgun metagenomic data while using containerization to ensure computational reproducibility and facilitate collaborative research. YAMP can be executed on any UNIX-like system and offers seamless support for multiple job schedulers as well as for the Amazon AWS cloud. Although YAMP was developed to be ready to use by nonexperts, bioinformaticians will appreciate its flexibility, modularization, and simple customization.

| S-EPMC6047416 | biostudies-literature

Enabling the Development and Deployment of Next Generation Point-of-Care Diagnostics.

Project description: Not available

| S-EPMC4431858 | biostudies-literature

Additively manufactured nano-mechanical energy harvesting systems: advancements, potential applications, challenges and future perspectives.

Project description:Additively manufactured nano-MEH systems are widely used to harvest energy from renewable and sustainable energy sources such as wind, ocean, sunlight, raindrops, and ambient vibrations. A comprehensive study focusing on in-depth technology evolution, applications, problems, and future trends of specifically 3D printed nano-MEH systems with an energy point of view is rarely conducted. Therefore, this paper looks into the state-of-the-art technologies, energy harvesting sources/methods, performance, implementations, emerging applications, potential challenges, and future perspectives of additively manufactured nano-mechanical energy harvesting (3DP-NMEH) systems. The prevailing challenges concerning renewable energy harvesting capacities, optimal energy scavenging, power management, material functionalization, sustainable prototyping strategies, new materials, commercialization, and hybridization are discussed. A novel solution is proposed for renewable energy generation and medicinal purposes based on the sustainable utilization of recyclable municipal and medical waste generated during the COVID-19 pandemic. Finally, recommendations for future research are presented concerning the cutting-edge issues hurdling the optimal exploitation of renewable energy resources through NMEHs. China and the USA are the most significant leading forces in enhancing 3DP-NMEH technology, with more than 75% contributions collectively. The reported output energy capacities of additively manufactured nano-MEH systems were 0.5-32 mW, 0.0002-45.6 mW, and 0.3-4.67 mW for electromagnetic, piezoelectric, and triboelectric nanogenerators, respectively. The optimal strategies and techniques to enhance these energy capacities are compiled in this paper.

| S-EPMC8633623 | biostudies-literature

Enabling Technologies for the Future of Chemical Synthesis.

Project description:Technology is evolving at breakneck pace, changing the way we communicate, travel, find out information, and live our lives. Yet chemistry as a science has been slower to adapt to this rapidly shifting world. In this Outlook we use highlights from recent literature reports to describe how progresses in enabling technologies are altering this trend, permitting chemists to incorporate new advances into their work at all levels of the chemistry development cycle. We discuss the benefits and challenges that have arisen, impacts on academic-industry relationships, and future trends in the area of chemical synthesis.

| S-EPMC4827522 | biostudies-other

Performance analysis of electronic structure codes on HPC systems: a case study of SIESTA.

Project description:We report on scaling and timing tests of the SIESTA electronic structure code for ab initio molecular dynamics simulations using density-functional theory. The tests are performed on six large-scale supercomputers belonging to the PRACE Tier-0 network with four different architectures: Cray XE6, IBM BlueGene/Q, BullX, and IBM iDataPlex. We employ a systematic strategy for simultaneously testing weak and strong scaling, and propose a measure which is independent of the range of number of cores on which the tests are performed to quantify strong scaling efficiency as a function of simulation size. We find an increase in efficiency with simulation size for all machines, with a qualitatively different curve depending on the supercomputer topology, and discuss the connection of this functional form with weak scaling behaviour. We also analyze the absolute timings obtained in our tests, showing the range of system sizes and cores favourable for different machines. Our results can be employed as a guide both for running SIESTA on parallel architectures, and for executing similar scaling tests of other electronic structure codes.

| S-EPMC3991679 | biostudies-literature

Future applications: gene therapy.

Project description:Gene therapy for brain disorders is one of the most promising frontiers in the practice of restorative neurosurgery. There are significant experimental gene therapy initiatives underway that have led to currently active clinical trials using direct intracerebral delivery of viral vectors, and these treatments have been reported as safe and well tolerated. In the future, other clinical trials will likely use viral vectors to transfer genes that bestow on recipient tissue a desired enzymatic or neurotrophic activity relevant to the treatment of other neurodegenerative diseases, stroke, and traumatic brain injury.

| S-EPMC3030700 | biostudies-literature

HPC: Hierarchical phylogeny construction.

Project description:Rapid improvements in DNA sequencing technology have resulted in long genome sequences for a large number of similar isolates with a wide range of single nucleotide polymorphism (SNP) rates, where some isolates can have thousands of times lower SNP rates than others. Genome sequences of this kind are a challenge to existing methods for construction of phylogenetic trees. We address the issues by developing a hierarchical approach to phylogeny construction. In this method, the construction is performed at multiple levels, where at each level, groups of isolates with similar levels of similarity are identified and their phylogenetic trees are constructed. Time savings are achieved by using a sufficiently large number of columns from the input alignment, instead of all its columns. Our results show that the new approach is 20-60 times more efficient than existing programs and more accurate in situations where highly similar isolates have a wide range of SNP rates.

| S-EPMC6705828 | biostudies-literature

Enabling Precision Cardiology Through Multiscale Biology and Systems Medicine.

Project description:The traditional paradigm of cardiovascular disease research derives insight from large-scale, broadly inclusive clinical studies of well-characterized pathologies. These insights are then put into practice according to standardized clinical guidelines. However, stagnation in the development of new cardiovascular therapies and variability in therapeutic response implies that this paradigm is insufficient for reducing the cardiovascular disease burden. In this state-of-the-art review, we examine 3 interconnected ideas we put forth as key concepts for enabling a transition to precision cardiology: 1) precision characterization of cardiovascular disease with machine learning methods; 2) the application of network models of disease to embrace disease complexity; and 3) using insights from the previous 2 ideas to enable pharmacology and polypharmacology systems for more precise drug-to-patient matching and patient-disease stratification. We conclude by exploring the challenges of applying a precision approach to cardiology, which arise from a deficit of the required resources and infrastructure, and emerging evidence for the clinical effectiveness of this nascent approach.

| S-EPMC6034501 | biostudies-literature

HPC-REDItools: a novel HPC-aware tool for improved large scale RNA-editing analysis.

Project description:BackgroundRNA editing is a widespread co-/post-transcriptional mechanism that alters primary RNA sequences through the modification of specific nucleotides and it can increase both the transcriptome and proteome diversity. The automatic detection of RNA-editing from RNA-seq data is computational intensive and limited to small data sets, thus preventing a reliable genome-wide characterisation of such process.ResultsIn this work we introduce HPC-REDItools, an upgraded tool for accurate RNA-editing events discovery from large dataset repositories.Availabilityhttps://github.com/BioinfoUNIBA/REDItools2 .ConclusionsHPC-REDItools is dramatically faster than the previous version, REDItools, enabling big-data analysis by means of a MPI-based implementation and scaling almost linearly with the number of available cores.

| S-EPMC7446188 | biostudies-literature

SPIM workflow manager for HPC.

Project description:SummaryHere we introduce a Fiji plugin utilizing the HPC-as-a-Service concept, significantly mitigating the challenges life scientists face when delegating complex data-intensive processing workflows to HPC clusters. We demonstrate on a common Selective Plane Illumination Microscopy image processing task that execution of a Fiji workflow on a remote supercomputer leads to improved turnaround time despite the data transfer overhead. The plugin allows the end users to conveniently transfer image data to remote HPC resources, manage pipeline jobs and visualize processed results directly from the Fiji graphical user interface.Availability and implementationThe code is distributed free and open source under the MIT license. Source code: https://github.com/fiji-hpc/hpc-workflow-manager/, documentation: https://imagej.net/SPIM_Workflow_Manager_For_HPC.Supplementary informationSupplementary data are available at Bioinformatics online.

| S-EPMC6761944 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data