Quantifying the scale effect in geospatial big data using semi-variograms.
Ontology highlight
ABSTRACT:
SUBMITTER: Chen L
PROVIDER: S-EPMC6855636 | biostudies-literature | 2019
REPOSITORIES: biostudies-literature
Publications
Quantifying the scale effect in geospatial big data using semi-variograms.
Chen Lei L Gao Yong Y Zhu Di D Yuan Yihong Y Liu Yu Y
PloS one 20191114 11
The scale effect is an important research topic in the field of geography. When aggregating individual-level data into areal units, encountering the scale problem is inevitable. This problem is more substantial when mining collective patterns from big geo-data due to the characteristics of extensive spatial data. Although multi-scale models were constructed to mitigate this issue, most studies still arbitrarily choose a single scale to extract spatial patterns. In this research, we introduce the ...[more]
Similar Datasets
Project description:BackgroundEnabling the use of spatial context is vital to understanding today's digital health problems. Any given location is associated with many different contexts. The strategic transformation of population health, epidemiology, and eHealth studies requires vast amounts of integrated digital data. Needed is a novel analytical framework designed to leverage location to create new contextual knowledge. The Geospatial Analytical Research Knowledgebase (GeoARK), a web-based research resource has robust, locationally integrated, social, environmental, and infrastructural information to address today's complex questions, investigate context, and spatially enable health investigations. GeoARK is different from other Geographic Information System (GIS) resources in that it has taken the layered world of the GIS and flattened it into a big data table that ties all the data and information together using location and developing its context.ObjectiveIt is paramount to build a robust spatial data analytics framework that integrates social, environmental, and infrastructural knowledge to empower health researchers' use of geospatial context to timely answer population health issues. The goal is twofold in that it embodies an innovative technological approach and serves to ease the educational burden for health researchers to think spatially about their problems.MethodsA unique analytical tool using location as the key was developed. It allows integration across source, geography, and time to create a geospatial big table with over 162 million individual locations (X-Y points that serve as rows) and 5549 attributes (represented as columns). The concept of context (adjacency, proximity, distance, etc) is quantified through geoanalytics and captured as new distance, density, or neighbor attributes within the system. Development of geospatial analytics permits contextual extraction and investigator-initiated eHealth and mobile health (mHealth) analysis across multiple attributes.ResultsWe built a unique geospatial big data ecosystem called GeoARK. Analytics on this big table occur across resolution groups, sources, and geographies for extraction and analysis of information to gain new insights. Case studies, including telehealth assessment in North Carolina, national income inequality and health outcome disparity, and a Missouri COVID-19 risk assessment, demonstrate the capability to support robust and efficient geospatial understanding of a wide spectrum of population health questions.ConclusionsThis research identified, compiled, transformed, standardized, and integrated multifaceted data required to better understand the context of health events within a large location-enabled database. The GeoARK system empowers health professionals to engage more complex research where the synergisms of health and geospatial information will be robustly studied beyond what could be accomplished today. No longer is the need to know how to perform geospatial processing an impediment to the health researcher, but rather the development of how to think spatially becomes the greater challenge.
| S-EPMC9021952 | biostudies-literature
Project description:The pattern of sleep stages across a night (sleep architecture) is influenced by biological, behavioral, and clinical variables. However, traditional measures of sleep architecture such as stage proportions, fail to capture sleep dynamics. Here we quantify the impact of individual differences on the dynamics of sleep architecture and determine which factors or set of factors best predict the next sleep stage from current stage information. We investigated the influence of age, sex, body mass index, time of day, and sleep time on static (e.g. minutes in stage, sleep efficiency) and dynamic measures of sleep architecture (e.g. transition probabilities and stage duration distributions) using a large dataset of 3202 nights from a non-clinical population. Multi-level regressions show that sex effects duration of all Non-Rapid Eye Movement (NREM) stages, and age has a curvilinear relationship for Wake After Sleep Onset (WASO) and slow wave sleep (SWS) minutes. Bayesian network modeling reveals sleep architecture depends on time of day, total sleep time, age and sex, but not BMI. Older adults, and particularly males, have shorter bouts (more fragmentation) of Stage 2, SWS, and they transition less frequently to these stages. Additionally, we showed that the next sleep stage and its duration can be optimally predicted by the prior 2 stages and age. Our results demonstrate the potential benefit of big data and Bayesian network approaches in quantifying static and dynamic architecture of normal sleep.
| S-EPMC5894981 | biostudies-literature
Project description:The largest digitized dataset of land plant distributions in Australia assembled to date (750,741 georeferenced herbarium records; 6,043 species) was used to partition the Australian continent into phytogeographical regions. We used a set of six widely distributed vascular plant groups and three non-vascular plant groups which together occur in a variety of landscapes/habitats across Australia. Phytogeographical regions were identified using quantitative analyses of species turnover, the rate of change in species composition between sites, calculated as Simpson's beta. We propose six major phytogeographical regions for Australia: Northern, Northern Desert, Eremaean, Eastern Queensland, Euronotian and South-Western. Our new phytogeographical regions show a spatial agreement of 65% with respect to previously defined phytogeographical regions of Australia. We also confirm that these new regions are in general agreement with the biomes of Australia and other contemporary biogeographical classifications. To assess the meaningfulness of the proposed phytogeographical regions, we evaluated how they relate to broad scale environmental gradients. Physiographic factors such as geology do not have a strong correspondence with our proposed regions. Instead, we identified climate as the main environmental driver. The use of an unprecedentedly large dataset of multiple plant groups, coupled with an explicit quantitative analysis, makes this study novel and allows an improved historical bioregionalization scheme for Australian plants. Our analyses show that: (1) there is considerable overlap between our results and older biogeographic classifications; (2) phytogeographical regions based on species turnover can be a powerful tool to further partition the landscape into meaningful units; (3) further studies using phylogenetic turnover metrics are needed to test the taxonomic areas.
| S-EPMC3962426 | biostudies-other
Project description:Low-temperature thermochronology is a powerful tool for constraining the thermal evolution of rocks and minerals in relation to a breadth of tectonic, geodynamic, landscape evolution, and natural resource formation processes through deep time. However, complexities inherent to these analytical techniques can make interpreting the significance of results challenging, requiring them to be placed in their geological context in 4-dimensions (3D + time). We present a novel tool for the geospatial archival, analysis and dissemination of fission-track and (U-Th)/He data, built as an extension to the open-access AusGeochem platform ( https://ausgeochem.auscope.org.au ) and freely accessible to scientists from around the world. To demonstrate the power of the platform, three regional datasets from Kenya, Australia and the Red Sea are placed in their 4D geological, geochemical, and geographic contexts, revealing insights into the tectono-thermal evolutions of these areas. Beyond facilitating data interpretation, the archival of fission track and (U-Th)/He (meta-)data in relational schemas unlocks future potential for greater integration of thermochronology and numerical geoscience techniques. The power of formatting data to interface with external tools is demonstrated through the integration of GPlates Web Service with AusGeochem, enabling thermochronology data to be readily viewed in their paleogeographic context through deep time from within the platform.
| S-EPMC10219985 | biostudies-literature
Project description:BackgroundSimple Sequence Repeats (SSRs) are short tandem repeats of nucleotide sequences. It has been shown that SSRs are associated with human diseases and are of medical relevance. Accordingly, a variety of computational methods have been proposed to mine SSRs from genomes. Conventional methods rely on a high-quality complete genome to identify SSRs. However, the sequenced genome often misses several highly repetitive regions. Moreover, many non-model species have no entire genomes. With the recent advances of next-generation sequencing (NGS) techniques, large-scale sequence reads for any species can be rapidly generated using NGS. In this context, a number of methods have been proposed to identify thousands of SSR loci within large amounts of reads for non-model species. While the most commonly used NGS platforms (e.g., Illumina platform) on the market generally provide short paired-end reads, merging overlapping paired-end reads has become a common way prior to the identification of SSR loci. This has posed a big data analysis challenge for traditional stand-alone tools to merge short read pairs and identify SSRs from large-scale data.ResultsIn this study, we present a new Hadoop-based software program, termed BigFiRSt, to address this problem using cutting-edge big data technology. BigFiRSt consists of two major modules, BigFLASH and BigPERF, implemented based on two state-of-the-art stand-alone tools, FLASH and PERF, respectively. BigFLASH and BigPERF address the problem of merging short read pairs and mining SSRs in the big data manner, respectively. Comprehensive benchmarking experiments show that BigFiRSt can dramatically reduce the execution times of fast read pairs merging and SSRs mining from very large-scale DNA sequence data.ConclusionsThe excellent performance of BigFiRSt mainly resorts to the Big Data Hadoop technology to merge read pairs and mine SSRs in parallel and distributed computing on clusters. We anticipate BigFiRSt will be a valuable tool in the coming biological Big Data era.
| S-EPMC8805145 | biostudies-literature
Project description:Single-cell RNA sequencing significantly deepened our insights into complex tissues and latest techniques are capable to analyze ten-thousands of cells simultaneously. With bigSCale, we provide an analytical framework being scalable to analyze millions of cells, addressing challenges of future large data sets. Unlike other methods, bigSCale does not constrain data to fit an a priori-defined distribution and instead uses an accurate numerical model of noise. We evaluate the performance of bigSCale using a biological model of aberrant gene expression and simulated data sets, which underlined its speed and accuracy. We further apply bigSCale to analyze 1.3 million cells from the mouse developing forebrain. The directed down-sampling strategy identified rare populations, such as Reelin positive Cajal-Retzius neurons, for which we determined a previously not recognized heterogeneity associated to distinct differentiation stages, spatial organization and cellular function. Together, bigSCale presents a perfect solution to address future challenges of large single-cell data sets.
2018-04-15 | GSE102934 | GEO
Project description:Promoting research on urban park use is important for developing the ecological and environmental health benefits of parks. This study proposes uniquely integrated methods combined with big data to measure urban park use. It combines comprehensive geographic detectors and multiscale geographically weighted regression from a geospatial perspective to quantify the individual and interactive effects of the parks' characteristics, accessibility, and surrounding environment features on weekday and weekend park use. The study also explores the degree of influence of spatial changes. The results indicate that the park-surrounding facilities and services factor contributed most to use, while its interaction effect with park service capacity had the greatest impact on park use. The interaction effects showed binary or nonlinear enhancement. This suggests that park use should be promoted within multiple dimensions. Many influencing factors had significant changes in the geographic space, suggesting that city-level park zoning construction should be adopted. Finally, park use was found to be affected by users' subjective preference on weekends and convenience factors on weekdays. These findings provide a theoretical basis for the influencing mechanisms of urban park use, which can help urban planners and policymakers formulate more specific policies to successfully manage and plan urban parks.
| S-EPMC10002407 | biostudies-literature
Project description:Despite the increasing resolution, forcing on the mean circulation by resolved waves in general circulation models is not yet converging. Parameterization of the forcing remains a major source of model uncertainty. This study examines the scale invariance of zonal spectra of momentum flux and wave forcing, and shows that it can be used to quantify the forcing by unresolved waves with knowledge of the resolved ones in global models. The result reveals the leading order importance of the small-scale wave forcing, which is in general agreement with that required for obtaining the zonal mean wind climatology. It is also found that wave and mean flow interaction is important in maintaining the robust spectral structure. This method may provide a strategy to design physically consistent and scale-aware parameterization schemes for scale invariant quantities, when a model has sufficient resolution to partially resolve their spectra.
| S-EPMC6565739 | biostudies-literature
Project description:Single-cell RNA sequencing (scRNA-seq) has significantly deepened our insights into complex tissues, with the latest techniques capable of processing tens of thousands of cells simultaneously. Analyzing increasing numbers of cells, however, generates extremely large data sets, extending processing time and challenging computing resources. Current scRNA-seq analysis tools are not designed to interrogate large data sets and often lack sensitivity to identify marker genes. With bigSCale, we provide a scalable analytical framework to analyze millions of cells, which addresses the challenges associated with large data sets. To handle the noise and sparsity of scRNA-seq data, bigSCale uses large sample sizes to estimate an accurate numerical model of noise. The framework further includes modules for differential expression analysis, cell clustering, and marker identification. A directed convolution strategy allows processing of extremely large data sets, while preserving transcript information from individual cells. We evaluated the performance of bigSCale using both a biological model of aberrant gene expression in patient-derived neuronal progenitor cells and simulated data sets, which underlines the speed and accuracy in differential expression analysis. To test its applicability for large data sets, we applied bigSCale to assess 1.3 million cells from the mouse developing forebrain. Its directed down-sampling strategy accumulates information from single cells into index cell transcriptomes, thereby defining cellular clusters with improved resolution. Accordingly, index cell clusters identified rare populations, such as reelin (Reln)-positive Cajal-Retzius neurons, for which we report previously unrecognized heterogeneity associated with distinct differentiation stages, spatial organization, and cellular function. Together, bigSCale presents a solution to address future challenges of large single-cell data sets.
| S-EPMC5991513 | biostudies-literature
Project description:Timely and accurate forecasts of dengue cases are of great importance for guiding disease prevention strategies, but still face challenges from (1) time-effectiveness due to time-consuming satellite data downloading and processing, (2) weak spatial representation capability due to data dependence on administrative unit-based statistics or weather station-based observations, and (3) stagnant accuracy without the application of historical case information. Geospatial big data, cloud computing platforms (e.g., Google Earth Engine, GEE), and emerging deep learning algorithms (e.g., long short term memory, LSTM) provide new opportunities for advancing these efforts. Here, we focused on the dengue epidemics in the urban agglomeration of the Federal District of Brazil (FDB) during 2007-2019. A new framework was proposed using geospatial big data analysis in the Google Earth Engine (GEE) platform and long short term memory (LSTM) modeling for dengue case forecasts over an epidemiological week basis. We first defined a buffer zone around an impervious area as the main area of dengue transmission by considering the impervious area as a human-dominated area and used the maximum distance of the flight range of Aedes aegypti and Aedes albopictus as a buffer distance. Those zones were used as units for further attribution analyses of dengue epidemics by aggregating the pixel values into the zones. The near weekly composite of potential driving factors was generated in GEE using the epidemiological weeks during 2007-2019, from the relevant geospatial data with daily or sub-daily temporal resolution. A multi-step-ahead LSTM model was used, and the time-differenced natural log-transformed dengue cases were used as outcomes. Two modeling scenarios (with and without historical dengue cases) were set to examine the potential of historical information on dengue forecasts. The results indicate that the performance was better when historical dengue cases were used and the 5-weeks-ahead forecast had the best performance, and the peak of a large outbreak in 2019 was accurately forecasted. The proposed framework in this study suggests the potential of the GEE platform, the LSTM algorithm, as well as historical information for dengue risk forecasting, which can easily be extensively applied to other regions or globally for timely and practical dengue forecasts.
| S-EPMC8869738 | biostudies-literature