Browse
Submit Data
Databases
API
Help

Dataset Information

17 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Dynamic performance-Energy tradeoff consolidation with contention-aware resource provisioning in containerized clouds.

ABSTRACT: Containers have emerged as a more portable and efficient solution than virtual machines for cloud infrastructure providing both a flexible way to build and deploy applications. The quality of service, security, performance, energy consumption, among others, are essential aspects of their deployment, management, and orchestration. Inappropriate resource allocation can lead to resource contention, entailing reduced performance, poor energy efficiency, and other potentially damaging effects. In this paper, we present a set of online job allocation strategies to optimize quality of service, energy savings, and completion time, considering contention for shared on-chip resources. We consider the job allocation as the multilevel dynamic bin-packing problem that provides a lightweight runtime solution that minimizes contention and energy consumption while maximizing utilization. The proposed strategies are based on two and three levels of scheduling policies with container selection, capacity distribution, and contention-aware allocation. The energy model considers joint execution of applications of different types on shared resources generalized by the job concentration paradigm. We provide an experimental analysis of eighty-six scheduling heuristics with scientific workloads of memory and CPU-intensive jobs. The proposed techniques outperform classical solutions in terms of quality of service, energy savings, and completion time by 21.73-43.44%, 44.06-92.11%, and 16.38-24.17%, respectively, leading to a cost-efficient resource allocation for cloud infrastructures.

SUBMITTER: Canosa-Reyes RM

PROVIDER: S-EPMC8775309 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

Cost-aware orchestration of applications over heterogeneous clouds.

Project description:The orchestration of applications and their components over heterogeneous clouds is recognized as being critical in solving the problem of vendor lock-in with regards to distributed and cloud computing. There have been recent strides made in the area of cloud application orchestration with emergence of the TOSCA standard being a definitive one. Although orchestration by itself provides a considerable amount of benefit to consumers of cloud computing services, it remains impractical without a compelling reason to ensure its utilization by cloud computing consumers. If there is no measurable benefit in using orchestration, then it is likely that clients may opt out of using it altogether. In this paper, we present an approach to cloud orchestration that aims to combine an orchestration model with a cost and policy model in order to allow for cost-aware application orchestration across heterogeneous clouds. Our approach takes into consideration the operating cost of the application on each provider, while performing a forward projection of the operating cost over a period of time to ensure that cost constraints remain unviolated. This allows us to leverage the existing state of the art with regards to orchestration and model-driven approaches as well as tie it to the operations of cloud clients in order to improve utility. Through this study, we were able to show that our approach was capable of providing not only scaling features but also orchestration features of application components distributed across heterogeneous cloud platforms.

| S-EPMC7028274 | biostudies-literature

VM Capacity-Aware Scheduling within Budget Constraints in IaaS Clouds.

Project description:Recently, cloud computing has drawn significant attention from both industry and academia, bringing unprecedented changes to computing and information technology. The infrastructure-as-a-Service (IaaS) model offers new abilities such as the elastic provisioning and relinquishing of computing resources in response to workload fluctuations. However, because the demand for resources dynamically changes over time, the provisioning of resources in a way that a given budget is efficiently utilized while maintaining a sufficing performance remains a key challenge. This paper addresses the problem of task scheduling and resource provisioning for a set of tasks running on IaaS clouds; it presents novel provisioning and scheduling algorithms capable of executing tasks within a given budget, while minimizing the slowdown due to the budget constraint. Our simulation study demonstrates a substantial reduction up to 70% in the overall task slowdown rate by the proposed algorithms.

| S-EPMC4976937 | biostudies-literature

Dynamic Voltage Frequency Scaling Simulator for Real Workflows Energy-Aware Management in Green Cloud Computing.

Project description:Nowadays, the growing computational capabilities of Cloud systems rely on the reduction of the consumed power of their data centers to make them sustainable and economically profitable. The efficient management of computing resources is at the heart of any energy-aware data center and of special relevance is the adaptation of its performance to workload. Intensive computing applications in diverse areas of science generate complex workload called workflows, whose successful management in terms of energy saving is still at its beginning. WorkflowSim is currently one of the most advanced simulators for research on workflows processing, offering advanced features such as task clustering and failure policies. In this work, an expected power-aware extension of WorkflowSim is presented. This new tool integrates a power model based on a computing-plus-communication design to allow the optimization of new management strategies in energy saving considering computing, reconfiguration and networks costs as well as quality of service, and it incorporates the preeminent strategy for on host energy saving: Dynamic Voltage Frequency Scaling (DVFS). The simulator is designed to be consistent in different real scenarios and to include a wide repertory of DVFS governors. Results showing the validity of the simulator in terms of resources utilization, frequency and voltage scaling, power, energy and time saving are presented. Also, results achieved by the intra-host DVFS strategy with different governors are compared to those of the data center using a recent and successful DVFS-based inter-host scheduling strategy as overlapped mechanism to the DVFS intra-host technique.

| S-EPMC5234838 | biostudies-literature

ERP: An elastic resource provisioning approach for cloud applications.

Project description:Elasticity is the key technique to provisioning resources dynamically in order to flexibly meet the users' demand. Namely, the elasticity is aimed at meeting the demand at any time. However, the aforementioned approaches usually provision virtual machines (VMs) in a coarse-grained manner just by the CPU utilization. Actually, two or more elements are needed for the performance metric, including the CPU and the memory. It is challenging to determine a suitable threshold to efficiently scale the resources up or down. In this paper we present an elastic scaling framework that is implemented by the cloud layer model. First we propose the elastic resource provisioning (ERP) approach on the performance threshold. The proposed threshold is based on the Grey relational analysis (GRA) policy, including the CPU and the memory. Secondly, according to the fixed threshold, we scale up the resources from different granularities, such as in the physical machine level (PM-level) or virtual machine level (VM-level). In contrast, we scale down the resources and shut down the spare machines. Finally, we evaluate the effectiveness of the proposed approach in real workloads. The extensive experiments show that the ERP algorithm performs the elastic strategy efficiently by reducing the overhead and response time.

| S-EPMC6485711 | biostudies-literature

Resource-aware construct design in mammalian cells.

Project description:Resource competition can be the cause of unintended coupling between co-expressed genetic constructs. Here we report the quantification of the resource load imposed by different mammalian genetic components and identify construct designs with increased performance and reduced resource footprint. We use these to generate improved synthetic circuits and optimise the co-expression of transfected cassettes, shedding light on how this can be useful for bioproduction and biotherapeutic applications. This work provides the scientific community with a framework to consider resource demand when designing mammalian constructs to achieve robust and optimised gene expression.

| S-EPMC10275982 | biostudies-literature

The energy-speed-accuracy tradeoff in sensory adaptation.

Project description:Adaptation is the essential process by which an organism becomes better suited to its environment. The benefits of adaptation are well documented, but the cost it incurs remains poorly understood. Here, by analysing a stochastic model of a minimum feedback network underlying many sensory adaptation systems, we show that adaptive processes are necessarily dissipative, and continuous energy consumption is required to stabilize the adapted state. Our study reveals a general relation among energy dissipation rate, adaptation speed and the maximum adaptation accuracy. This energy-speed-accuracy relation is tested in the Escherichia coli chemosensory system, which exhibits near-perfect chemoreceptor adaptation. We identify key requirements for the underlying biochemical network to achieve accurate adaptation with a given energy budget. Moreover, direct measurements confirm the prediction that adaptation slows down as cells gradually de-energize in a nutrient-poor medium without compromising adaptation accuracy. Our work provides a general framework to study cost-performance tradeoffs for cellular regulatory functions and information processing.

| S-EPMC3378065 | biostudies-literature

Body and Wing Allometries Reveal Flight-Fecundity Tradeoff in Response to Larval Provisioning in Osmia lignaria (Hymenoptera: Megachilidae).

Project description:Variation in body size has important implications for physical performance and fitness. For insects, adult size and morphology are determined by larval growth and metamorphosis. Female blue orchard bees, Osmia lignaria, (Say) provision a finite quantity of food to their offspring. In this study, we asked how provision-dependent variation in size changes adult morphology. We performed a diet manipulation in which some larvae were starved in the final instar and some were given unlimited food. We examined the consequences on adult morphology in two ways. First, allometric relationships between major body regions (head, thorax, abdomen) and total body mass were measured to determine relative growth of these structures. Second, morphometrics that are critical for flight (wing area, wing loading, and extra flight power index) were quantified. Head and thorax mass had hyperallometric relationships with body size, indicating these parts become disproportionately large in adults when larvae are given copious provisions. However, abdominal mass and wing area increased hypoallometrically with body size. Thus, large adults had disproportionately lighter abdomens and smaller wing areas than smaller adults. Though both males and females followed these general patterns, allometric patterns were affected by sex. For flight metrics, small adults had reduced wing loading and an increased extra flight power index. These results suggest that diet quantity alters development in ways that affect the morphometric trait relationships in adult O. lignaria and may lead to functional differences in performance.

| S-EPMC8192885 | biostudies-literature

SparkGIS: Resource Aware Efficient In-Memory Spatial Query Processing.

Project description:Much effort has been devoted to support high performance spatial queries on large volumes of spatial data in distributed spatial computing systems, especially in the MapReduce paradigm. Recent works have focused on extending spatial MapReduce frameworks to leverage high performance in-memory distributed processing capabilities of systems such as Spark. However, the performance advantage comes with the requirement of having enough memory and comprehensive configuration. Failing to fulfill this falls back to disk IO, defeating the purpose of such systems or in worst case gets out of memory and fails the job. The problem is aggravated further for spatial processing since the underlying in-memory systems are oblivious of spatial data features and characteristics. In this paper we present SparkGIS - an in-memory oriented spatial data querying system for high throughput and low latency spatial query handling by adapting Apache Spark's distributed processing capabilities. It supports basic spatial queries including containment, spatial join and k-nearest neighbor and allows extending these to complex query pipelines. SparkGIS mitigates skew in distributed processing by supporting several dynamic partitioning algorithms suitable for a rich set of contemporary application scenarios. Multilevel global and local, pre-generated and on-demand in-memory indexes, allow SparkGIS to prune input data and apply compute intensive operations on a subset of relevant spatial objects only. Finally, SparkGIS employs dynamic query rewriting to gracefully manage large spatial query workflows that exceed available distributed resources. Our comparative evaluation has shown that the performance of SparkGIS is on par with contemporary Spark based platforms for relatively smaller queries and outperforms them for larger data and memory intensive workflows by dynamic query rewriting and efficient spatial data management.

| S-EPMC6054321 | biostudies-literature

An innovative time-cost-quality tradeoff modeling of building construction project based on resource allocation.

Project description:The time, quality, and cost are three important but contradictive objectives in a building construction project. It is a tough challenge for project managers to optimize them since they are different parameters. This paper presents a time-cost-quality optimization model that enables managers to optimize multiobjectives. The model is from the project breakdown structure method where task resources in a construction project are divided into a series of activities and further into construction labors, materials, equipment, and administration. The resources utilized in a construction activity would eventually determine its construction time, cost, and quality, and a complex time-cost-quality trade-off model is finally generated based on correlations between construction activities. A genetic algorithm tool is applied in the model to solve the comprehensive nonlinear time-cost-quality problems. Building of a three-storey house is an example to illustrate the implementation of the model, demonstrate its advantages in optimizing trade-off of construction time, cost, and quality, and help make a winning decision in construction practices. The computational time-cost-quality curves in visual graphics from the case study prove traditional cost-time assumptions reasonable and also prove this time-cost-quality trade-off model sophisticated.

| S-EPMC3929567 | biostudies-other

Glycolytic strategy as a tradeoff between energy yield and protein cost.

Project description:Contrary to the textbook portrayal of glycolysis as a single pathway conserved across all domains of life, not all sugar-consuming organisms use the canonical Embden-Meyerhoff-Parnass (EMP) glycolytic pathway. Prokaryotic glucose metabolism is particularly diverse, including several alternative glycolytic pathways, the most common of which is the Entner-Doudoroff (ED) pathway. The prevalence of the ED pathway is puzzling as it produces only one ATP per glucose--half as much as the EMP pathway. We argue that the diversity of prokaryotic glucose metabolism may reflect a tradeoff between a pathway's energy (ATP) yield and the amount of enzymatic protein required to catalyze pathway flux. We introduce methods for analyzing pathways in terms of thermodynamics and kinetics and show that the ED pathway is expected to require several-fold less enzymatic protein to achieve the same glucose conversion rate as the EMP pathway. Through genomic analysis, we further show that prokaryotes use different glycolytic pathways depending on their energy supply. Specifically, energy-deprived anaerobes overwhelmingly rely upon the higher ATP yield of the EMP pathway, whereas the ED pathway is common among facultative anaerobes and even more common among aerobes. In addition to demonstrating how protein costs can explain the use of alternative metabolic strategies, this study illustrates a direct connection between an organism's environment and the thermodynamic and biochemical properties of the metabolic pathways it employs.

| S-EPMC3683749 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data