Browse
Submit Data
Databases
API
Help

Dataset Information

23 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Big data: survey, technologies, opportunities, and challenges.

ABSTRACT: Big Data has gained much attention from the academia and the IT industry. In the digital and computing world, information is generated and collected at a rate that rapidly exceeds the boundary range. Currently, over 2 billion people worldwide are connected to the Internet, and over 5 billion individuals own mobile phones. By 2020, 50 billion devices are expected to be connected to the Internet. At this point, predicted data production will be 44 times greater than that in 2009. As information is transferred and shared at light speed on optic fiber and wireless networks, the volume of data and the speed of market growth increase. However, the fast growth rate of such large data generates numerous challenges, such as the rapid growth of data, transfer speed, diverse data, and security. Nonetheless, Big Data is still in its infancy stage, and the domain has not been reviewed in general. Hence, this study comprehensively surveys and classifies the various attributes of Big Data, including its nature, definitions, rapid growth rate, volume, management, analysis, and security. This study also proposes a data life cycle that uses the technologies and terminologies of Big Data. Future research directions in this field are determined based on opportunities and several open issues in Big Data domination. These research directions facilitate the exploration of the domain and the development of optimal techniques to address Big Data.

SUBMITTER: Khan N

PROVIDER: S-EPMC4127205 | biostudies-other | 2014

REPOSITORIES: biostudies-other

ACCESS DATA

Json Xml

Similar Datasets

Circulating Tumor Cell Detection Technologies and Clinical Utility: Challenges and Opportunities.

Project description:The potential clinical utility of circulating tumor cells (CTCs) in the diagnosis and management of cancer has drawn a lot of attention in the past 10 years. CTCs disseminate from tumors into the bloodstream and are believed to carry vital information about tumor onset, progression, and metastasis. In addition, CTCs reflect different biological aspects of the primary tumor they originate from, mainly in their genetic and protein expression. Moreover, emerging evidence indicates that CTC liquid biopsies can be extended beyond prognostication to pharmacodynamic and predictive biomarkers in cancer patient management. A key challenge in harnessing the clinical potential and utility of CTCs is enumerating and isolating these rare heterogeneous cells from a blood sample while allowing downstream CTC analysis. That being said, there have been serious doubts regarding the potential value of CTCs as clinical biomarkers for cancer due to the low number of promising outcomes in the published results. This review aims to present an overview of the current preclinical CTC detection technologies and the advantages and limitations of each sensing platform, while surveying and analyzing the published evidence of the clinical utility of CTCs.

| S-EPMC7409125 | biostudies-literature

Vaccine Technologies and Platforms for Infectious Diseases: Current Progress, Challenges, and Opportunities.

Project description:Vaccination is a key component of public health policy with demonstrated cost-effective benefits in protecting both human and animal populations. Vaccines can be manufactured under multiple forms including, inactivated (killed), toxoid, live attenuated, Virus-like Particles, synthetic peptide, polysaccharide, polysaccharide conjugate (glycoconjugate), viral vectored (vector-based), nucleic acids (DNA and mRNA) and bacterial vector/synthetic antigen presenting cells. Several processes are used in the manufacturing of vaccines and recent developments in medical/biomedical engineering, biology, immunology, and vaccinology have led to the emergence of innovative nucleic acid vaccines, a novel category added to conventional and subunit vaccines. In this review, we have summarized recent advances in vaccine technologies and platforms focusing on their mechanisms of action, advantages, and possible drawbacks.

| S-EPMC8708925 | biostudies-literature

Data-driven challenges and opportunities in crystallography.

Project description:Structural biology is in the midst of a revolution fueled by faster and more powerful instruments capable of delivering orders of magnitude more data than their predecessors. This increased pace in data gathering introduces new experimental and computational challenges, frustrating real-time processing and interpretation of data and requiring long-term solutions for data archival and retrieval. This combination of challenges and opportunities is driving the exploration of new areas of structural biology, including studies of macromolecular dynamics and the investigation of molecular ensembles in search of a better understanding of conformational landscapes. The next generation of instruments promises to yield even greater data rates, requiring a concerted effort by institutions, centers and individuals to extract meaning from every bit and make data accessible to the community at large, facilitating data mining efforts by individuals or groups as analysis tools improve.

| S-EPMC7289006 | biostudies-literature

Accelerometry data in health research: challenges and opportunities.

Project description:Wearable accelerometers provide detailed, objective, and continuous measurements of physical activity (PA). Recent advances in technology and the decreasing cost of wearable devices led to an explosion in the popularity of wearable technology in health research. An ever-increasing number of studies collect high-throughput, sub-second level raw acceleration data. In this paper, we discuss problems related to the collection and analysis of raw accelerometry data and refer to published solutions. In particular, we describe the size and complexity of the data, the within- and between-subject variability, and the effects of sensor location on the body. We also discuss challenges related to sampling frequency, device calibration, data labeling and multiple PA monitors synchronization. We illustrate these points using the Developmental Epidemiological Cohort Study (DECOS), which collected raw accelerometry data on individuals both in a controlled and the free-living environment.

| S-EPMC6874221 | biostudies-literature

Challenges and Opportunities for the Translation of Single-Cell RNA Sequencing Technologies to Dermatology.

Project description:Skin is a complex and heterogeneous organ at the cellular level. This complexity is beginning to be understood through the application of single-cell genomics and computational tools. A large number of datasets that shed light on how the different human skin cell types interact in homeostasis-and what ceases to work in diverse dermatological diseases-have been generated and are publicly available. However, translation of these novel aspects to the clinic is lacking. This review aims to summarize the state-of-the-art of skin biology using single-cell technologies, with a special focus on skin pathologies and the translation of mechanistic findings to the clinic. The main implications of this review are to summarize the benefits and limitations of single-cell analysis and thus help translate the emerging insights from these novel techniques to the bedside.

| S-EPMC8781146 | biostudies-literature

Normalizing single-cell RNA sequencing data: challenges and opportunities.

Project description:Single-cell transcriptomics is becoming an important component of the molecular biologist's toolkit. A critical step when analyzing data generated using this technology is normalization. However, normalization is typically performed using methods developed for bulk RNA sequencing or even microarray data, and the suitability of these methods for single-cell transcriptomics has not been assessed. We here discuss commonly used normalization approaches and illustrate how these can produce misleading results. Finally, we present alternative approaches and provide recommendations for single-cell RNA sequencing users.

| S-EPMC5549838 | biostudies-literature

Opportunities and challenges in long-read sequencing data analysis.

Project description:Long-read technologies are overcoming early limitations in accuracy and throughput, broadening their application domains in genomics. Dedicated analysis tools that take into account the characteristics of long-read data are thus required, but the fast pace of development of such tools can be overwhelming. To assist in the design and analysis of long-read sequencing projects, we review the current landscape of available tools and present an online interactive database, long-read-tools.org, to facilitate their browsing. We further focus on the principles of error correction, base modification detection, and long-read transcriptomics analysis and highlight the challenges that remain.

| S-EPMC7006217 | biostudies-literature

Privacy challenges and research opportunities for genomic data sharing.

Project description:The sharing of genomic data holds great promise in advancing precision medicine and providing personalized treatments and other types of interventions. However, these opportunities come with privacy concerns, and data misuse could potentially lead to privacy infringement for individuals and their blood relatives. With the rapid growth and increased availability of genomic datasets, understanding the current genome privacy landscape and identifying the challenges in developing effective privacy-protecting solutions are imperative. In this work, we provide an overview of major privacy threats identified by the research community and examine the privacy challenges in the context of emerging direct-to-consumer genetic-testing applications. We additionally present general privacy-protection techniques for genomic data sharing and their potential applications in direct-to-consumer genomic testing and forensic analyses. Finally, we discuss limitations in current privacy-protection methods, highlight possible mitigation strategies and suggest future research opportunities for advancing genomic data sharing.

| S-EPMC7761157 | biostudies-literature

Challenges and opportunities of a paperless baseline survey in Sri Lanka.

Project description:Personal digital assistants (PDAs) have been shown to reduce costs associated with survey implementation and digitisation, and to improve data quality when compared to traditional paper based data collection. Few studies, however, have shared their experiences of the use of these devices in rural settings in Asia. This paper reports on our experiences of using a PDA device for data collection in Sri Lanka as part of a large cluster randomised control trial.We found that PDAs were useful for collecting data for a baseline survey of a large randomised control trial (54,000 households). We found that the PDA device and survey format was easy to use by inexperienced field staff, even though the survey was programmed in English. The device enabled the rapid digitisation of survey data, providing a good basis for continuous data quality assurance, supervision of staff and survey implementation. An unexpected advantage was the improved community opinion of the research project as a result of the device, because the use of the technology gave data collectors an elevated status amongst the community. In addition the global positioning system (GPS) functionality of the device allowed precise mapping of households, and hence distinct settlements to be identified as randomisation clusters. Future users should be mindful that to save costs the piloting should be completed before programming. In addition consideration of a local after-care service is important to avoid costs and time delays associated with sending devices back to overseas providers.Since the start of this study, PDA devices have rapidly developed and are increasingly used. The use of PDA or similar devices for research is not without its problems; however we believe that the universal lessons learnt as part of this study are even more important for the effective utilisation of these rapidly developing technologies in resource poor settings.

| S-EPMC4118630 | biostudies-literature

Enhancing big data in the social sciences with crowdsourcing: Data augmentation practices, techniques, and opportunities.

Project description:Proponents of big data claim it will fuel a social research revolution, but skeptics challenge its reliability and decontextualization. The largest subset of big data is not designed for social research. Data augmentation-systematic assessment of measurement against known quantities and expansion of extant data with new information-is an important tool to maximize such data's validity and research value. Using trained research assistants or specialized algorithms are common approaches to augmentation but may not scale to big data or appease skeptics. We consider a third alternative: data augmentation with online crowdsourcing. Three empirical cases illustrate strengths and limitations of crowdsourcing, using Amazon Mechanical Turk to verify automated coding, link online databases, and gather data on online resources. Using these, we develop best practice guidelines and a reporting template to enhance reproducibility. Carefully designed, correctly applied, and rigorously documented crowdsourcing help address concerns about big data's usefulness for social research.

| S-EPMC7286483 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data