Adaptive Resource Utilization Prediction System for Infrastructure as a Service Cloud.
Ontology highlight
ABSTRACT:
SUBMITTER: Zia Ullah Q
PROVIDER: S-EPMC5547731 | biostudies-other | 2017
REPOSITORIES: biostudies-other
Similar Datasets
Project description:This paper contains data on Performance Prediction for Cloud Service Selection. To measure the performance metrics of any system you need to analyze the features that affect these performance, these features are called " workload parameters". The data described here is collected from the KSA Ministry of Finance that contains 28,147 instances from 13 cloud nodes. It was recorded during the period from March 1, 2016, to February 20, 2017, in continuous time slots. In this article we selected 9 workload parameters: Number of Jobs in a Minute, Number of Jobs in 5?min, Number of Jobs in 15?min, Memory Capacity, Disk Capacity,: Number of CPU Cores, CPU Speed per Core, Average Receive for Network Bandwidth in Kbps and Average Transmit for Network Bandwidth in Kbps. Moreover, we selected 3 performance metrics: Memory utilization, CPU utilization and response time in milliseconds. This data article is related to the research article titled "An Automated Performance Prediction Model for Cloud Service Selection from Smart Data" (Al-Faifi et al., 2018) [1].
| S-EPMC6138836 | biostudies-other
Project description:Cloud computing offers significant research and economic benefits to healthcare organisations. Cloud services provide a safe place for storing and managing large amounts of such sensitive data. Under conventional flow of gene information, gene sequence laboratories send out raw and inferred information via Internet to several sequence libraries. DNA sequencing storage costs will be minimised by use of cloud service. In this study, the authors put forward a novel genomic informatics system using Amazon Cloud Services, where genomic sequence information is stored and accessed for processing. True identification of exon regions in a DNA sequence is a key task in bioinformatics, which helps in disease identification and design drugs. Three base periodicity property of exons forms the basis of all exon identification techniques. Adaptive signal processing techniques found to be promising in comparison with several other methods. Several adaptive exon predictors (AEPs) are developed using variable normalised least mean square and its maximum normalised variants to reduce computational complexity. Finally, performance evaluation of various AEPs is done based on measures such as sensitivity, specificity and precision using various standard genomic datasets taken from National Center for Biotechnology Information genomic sequence database.
| S-EPMC5830887 | biostudies-literature
Project description:The increasing availability and decreasing cost of high-throughput sequencing has transformed academic medical microbiology, delivering an explosion in available genomes while also driving advances in bioinformatics. However, many microbiologists are unable to exploit the resulting large genomics datasets because they do not have access to relevant computational resources and to an appropriate bioinformatics infrastructure. Here, we present the Cloud Infrastructure for Microbial Bioinformatics (CLIMB) facility, a shared computing infrastructure that has been designed from the ground up to provide an environment where microbiologists can share and reuse methods and data.
| S-EPMC5537631 | biostudies-literature
Project description:The cloud is a shared pool of systems that provides multiple resources through the Internet, users can access a lot of computing power using their computer. However, with the strong migration rate of multiple applications towards the cloud, more disks and servers are required to store huge data. Most of the cloud storage service providers are replicating full copies of data over multiple data centers to ensure data availability. Further, the replication is not only a costly process but also a wastage of energy resources. Furthermore, erasure codes reduce the storage cost by splitting data in n chunks and storing these chunks into n + k different data centers, to tolerate k failures. Moreover, it also needs extra computation cost to regenerate the data object. Cache-A Replica On Modification (CAROM) is a hybrid file system that gets combined benefits from both the replication and erasure codes to reduce access latency and bandwidth consumption. However, in the literature, no formal analysis of CAROM is available which can validate its performance. To address this issue, this research firstly presents a colored Petri net based formal model of CAROM. The research proceeds by presenting a formal analysis and simulation to validate the performance of the proposed system. This paper contributes towards the utilization of resources in clouds by presenting a comprehensive formal analysis of CAROM.
| S-EPMC7959626 | biostudies-literature
Project description:MapReduce is the preferred cloud computing framework used in large data analysis and application processing. MapReduce frameworks currently in place suffer performance degradation due to the adoption of sequential processing approaches with little modification and thus exhibit underutilization of cloud resources. To overcome this drawback and reduce costs, we introduce a Parallel MapReduce (PMR) framework in this paper. We design a novel parallel execution strategy of Map and Reduce worker nodes. Our strategy enables further performance improvement and efficient utilization of cloud resources execution of Map and Reduce functions to utilize multicore environments available with computing nodes. We explain in detail makespan modeling and working principle of the PMR framework in the paper. Performance of PMR is compared with Hadoop through experiments considering three biomedical applications. Experiments conducted for BLAST, CAP3, and DeepBind biomedical applications report makespan time reduction of 38.92%, 18.00%, and 34.62% considering the PMR framework against Hadoop framework. Experiments' results prove that the PMR cloud computing platform proposed is robust, cost-effective, and scalable, which sufficiently supports diverse applications on public and private cloud platforms. Consequently, overall presentation and results indicate that there is good matching between theoretical makespan modeling presented and experimental values investigated.
| S-EPMC6207866 | biostudies-literature
Project description:ObjectivesPediatric protocols to guide allocation of limited resources during a disaster lack data to validate their use. The 2011 Pediatric Emergency Mass Critical Care Task Force recommended that expected duration of critical care be incorporated into resource allocation algorithms. We aimed to determine whether currently available pediatric illness severity scores can predict duration of critical care resource use.DesignRetrospective cohort study.SettingSeattle Children's Hospital.PatientsPICU patients admitted 2016-2018 for greater than or equal to 12 hours (n = 3,206).InterventionsNone.Measurements and main resultsWe developed logistic and linear regression models in two-thirds of the cohort to predict need for and duration of PICU resources based on Pediatric Risk of Mortality-III, Pediatric Index of Mortality-3, and serial Pediatric Logistic Organ Dysfunction-2 scores. We tested the predictive accuracy of the models with the highest area under the receiver operating characteristic curve (need for each resource) and R (duration of use) in a validation cohort of the remaining one of three of the sample and among patients admitted during one-third of the sample and among patients admitted during surges of respiratory illness. Pediatric Logistic Organ Dysfunction score calculated 12 hours postadmission had higher predictive accuracy than either Pediatric Risk of Mortality or Pediatric Index of Mortality scores. Models incorporating 12-hour Pediatric Logistic Organ Dysfunction score, age, Pediatric Overall Performance Category, Pediatric Cerebral Performance Category, chronic mechanical ventilation, and postoperative status had an area under the receiver operating characteristic curve = 0.8831 for need for any PICU resource (positive predictive value 80.2%, negative predictive value 85.9%) and area under the receiver operating characteristic curve = 0.9157 for mechanical ventilation (positive predictive value 85.7%, negative predictive value 89.2%) within 7 days of admission. Models accurately predicted greater than or equal to 24 hours of any resource use for 78.9% of patients and greater than or equal to 24 hours of ventilation for 83.1%. Model fit and accuracy improved for prediction of resource use within 3 days of admission, and was lower for noninvasive positive pressure ventilation, vasoactive infusions, continuous renal replacement therapy, extracorporeal membrane oxygenation, and length of stay.ConclusionsA model incorporating 12-hour Pediatric Logistic Organ Dysfunction score performed well in estimating how long patients may require PICU resources, especially mechanical ventilation. A pediatric disaster triage algorithm that includes both likelihood for survival and for requiring critical care resources could minimize subjectivity in resource allocation decision-making.
| S-EPMC7199765 | biostudies-literature
Project description:The strain on healthcare resources brought forth by the recent COVID-19 pandemic has highlighted the need for efficient resource planning and allocation through the prediction of future consumption. Machine learning can predict resource utilization such as the need for hospitalization based on past medical data stored in electronic medical records (EMR). We conducted this study on 3194 patients (46% male with mean age 56.7 (±16.8), 56% African American, 7% Hispanic) flagged as COVID-19 positive cases in 12 centers under Emory Healthcare network from February 2020 to September 2020, to assess whether a COVID-19 positive patient's need for hospitalization can be predicted at the time of RT-PCR test using the EMR data prior to the test. Five main modalities of EMR, i.e., demographics, medication, past medical procedures, comorbidities, and laboratory results, were used as features for predictive modeling, both individually and fused together using late, middle, and early fusion. Models were evaluated in terms of precision, recall, F1-score (within 95% confidence interval). The early fusion model is the most effective predictor with 84% overall F1-score [CI 82.1-86.1]. The predictive performance of the model drops by 6 % when using recent clinical data while omitting the long-term medical history. Feature importance analysis indicates that history of cardiovascular disease, emergency room visits in the past year prior to testing, and demographic factors are predictive of the disease trajectory. We conclude that fusion modeling using medical history and current treatment data can forecast the need for hospitalization for patients infected with COVID-19 at the time of the RT-PCR test.
| S-EPMC8175333 | biostudies-literature
Project description:The article examines the subject-system interaction session, where the system is understood as a base station, and the subject is understood as a mobile communication device. The peculiarity of the study is taking into account the phenomenon relevant to modern communication infrastructures, which is that the base station supports the division of information traffic into a subspace of guaranteed personalized traffic and a subspace of general-purpose traffic. The study considers a highly critical empirical emergency when the general-purpose traffic subspace may cease to be available at any time. The presented mathematical apparatus describes the impact of such an emergency on the active communication sessions supported by the system in receiving new incoming requests of increasing intensity. To characterize this emergency situation, expressions adapted for practical application are presented to calculate such qualitative parameters as the probability of stability, the probability of failure, and unavailability.
| S-EPMC9292092 | biostudies-literature
Project description:A wealth of viral data sits untapped in publicly available metagenomic data sets when it might be extracted to create a usable index for the virological research community. We hypothesized that work of this complexity and scale could be done in a hackathon setting. Ten teams comprised of over 40 participants from six countries, assembled to create a crowd-sourced set of analysis and processing pipelines for a complex biological data set in a three-day event on the San Diego State University campus starting 9 January 2019. Prior to the hackathon, 141,676 metagenomic data sets from the National Center for Biotechnology Information (NCBI) Sequence Read Archive (SRA) were pre-assembled into contiguous assemblies (contigs) by NCBI staff. During the hackathon, a subset consisting of 2953 SRA data sets (approximately 55 million contigs) was selected, which were further filtered for a minimal length of 1 kb. This resulted in 4.2 million (Mio) contigs, which were aligned using BLAST against all known virus genomes, phylogenetically clustered and assigned metadata. Out of the 4.2 Mio contigs, 360,000 contigs were labeled with domains and an additional subset containing 4400 contigs was screened for virus or virus-like genes. The work yielded valuable insights into both SRA data and the cloud infrastructure required to support such efforts, revealing analysis bottlenecks and possible workarounds thereof. Mainly: (i) Conservative assemblies of SRA data improves initial analysis steps; (ii) existing bioinformatic software with weak multithreading/multicore support can be elevated by wrapper scripts to use all cores within a computing node; (iii) redesigning existing bioinformatic algorithms for a cloud infrastructure to facilitate its use for a wider audience; and (iv) a cloud infrastructure allows a diverse group of researchers to collaborate effectively. The scientific findings will be extended during a follow-up event. Here, we present the applied workflows, initial results, and lessons learned from the hackathon.
| S-EPMC6771016 | biostudies-literature
Project description:Increasingly prevalent extreme weather events have caused resilience to become an essential sustainable development component for resource and infrastructure networks. Existing resilience metrics require detailed knowledge of the system and potential disruptions, which is not available in the early design stage. The lack of quantitative tools to guide the early stages of design for resilience, forces engineers to rely on heuristics (use physical redundancy, localized capacity, etc.). This research asserts that the required quantitative guidelines can be developed using the architecting principles of biological ecosystems, which maintain a unique balance between pathway redundancy and efficiency, enabling them to be both productive under normal circumstances and survive disruptions. Ecologists quantify this network characteristic using the ecological fitness function. This paper presents the required reformulation required to enable the use of this metric in the design and analysis of resource and infrastructure networks with multiple distinct, but interdependent, interactions. The proposed framework is validated by comparing the resilience characteristics of two notional supply chain designs: one designed for minimum shipping cost and the other designed using the proposed bio-inspired framework. The results support using the proposed bio-inspired framework to guide designers in creating resilient and sustainable resource and infrastructure networks.
| S-EPMC7385727 | biostudies-literature