Dataset Information

A topic modeling framework for spatio-temporal information management.

ABSTRACT: Real-time processing and learning of conflicting data, especially messages coming from different ideas, locations, and time, in a dynamic environment such as Twitter is a challenging task that recently gained lots of attention. This paper introduces a framework for managing, processing, analyzing, detecting, and tracking topics in streaming data. We propose a model selector procedure with a hybrid indicator to tackle the challenge of online topic detection. In this framework, we built an automatic data processing pipeline with two levels of cleaning. Regular and deep cleaning are applied using multiple sources of meta knowledge to enhance data quality. Deep learning and transfer learning techniques are used to classify health-related tweets, with high accuracy and improved F1-Score. In this system, we used visualization to have a better understanding of trending topics. To demonstrate the validity of this framework, we implemented and applied it to health-related twitter data from users originating in the USA over nine months. The results of this implementation show that this framework was able to detect and track the topics at a level comparable to manual annotation. To better explain the emerging and changing topics in various locations over time the result is graphically displayed on top of the United States map.

SUBMITTER: Asghari M

PROVIDER: S-EPMC7338024 | biostudies-literature | 2020 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A topic modeling framework for spatio-temporal information management.

Asghari Mohsen M Sierra-Sosa Daniel D Elmaghraby Adel S AS

Information processing & management 20200706 6

Real-time processing and learning of conflicting data, especially messages coming from different ideas, locations, and time, in a dynamic environment such as Twitter is a challenging task that recently gained lots of attention. This paper introduces a framework for managing, processing, analyzing, detecting, and tracking topics in streaming data. We propose a model selector procedure with a hybrid indicator to tackle the challenge of online topic detection. In this framework, we built an automat ...[more]

PMID: 32836694

Similar Datasets

Project description:Random forest and similar Machine Learning techniques are already used to generate spatial predictions, but spatial location of points (geography) is often ignored in the modeling process. Spatial auto-correlation, especially if still existent in the cross-validation residuals, indicates that the predictions are maybe biased, and this is suboptimal. This paper presents a random forest for spatial predictions framework (RFsp) where buffer distances from observation points are used as explanatory variables, thus incorporating geographical proximity effects into the prediction process. The RFsp framework is illustrated with examples that use textbook datasets and apply spatial and spatio-temporal prediction to numeric, binary, categorical, multivariate and spatiotemporal variables. Performance of the RFsp framework is compared with the state-of-the-art kriging techniques using fivefold cross-validation with refitting. The results show that RFsp can obtain equally accurate and unbiased predictions as different versions of kriging. Advantages of using RFsp over kriging are that it needs no rigid statistical assumptions about the distribution and stationarity of the target variable, it is more flexible towards incorporating, combining and extending covariates of different types, and it possibly yields more informative maps characterizing the prediction error. RFsp appears to be especially attractive for building multivariate spatial prediction models that can be used as "knowledge engines" in various geoscience fields. Some disadvantages of RFsp are the exponentially growing computational intensity with increase of calibration data and covariates and the high sensitivity of predictions to input data quality. The key to the success of the RFsp framework might be the training data quality-especially quality of spatial sampling (to minimize extrapolation problems and any type of bias in data), and quality of model validation (to ensure that accuracy is not effected by overfitting). For many data sets, especially those with lower number of points and covariates and close-to-linear relationships, model-based geostatistics can still lead to more accurate predictions than RFsp.

Project description:A key challenge in island biogeography is to quantity the role of dispersal in shaping biodiversity patterns among the islands of a given archipelago. Here, we propose such a framework. Dispersal within oceanic archipelagos may be conceptualized as a spatio-temporal process dependent on: (1) the spatial distribution of islands, because the probability of successful dispersal is inversely related to the spatial distance between islands and (2) the chronological sequence of island formation that determines the directional asymmetry of dispersal (hypothesized to be predominantly from older to younger islands). From these premises, directional network models may be constructed, representing putative connections among islands. These models may be translated to eigenfunctions in order to be incorporated into statistical analysis. The framework was tested with 12 datasets from the Hawaii, Azores, and Canaries. The explanatory power of directional network models for explaining species composition patterns, assessed by the Jaccard dissimilarity index, was compared with simpler time-isolation models. The amount of variation explained by the network models ranged from 5.5% (for Coleoptera in Hawaii) to 60.2% (for Pteridophytes in Canary Islands). In relation to the four studied taxa, the variation explained by network models was higher for Pteridophytes in the three archipelagos. By the contrary, small fractions of explained variation were observed for Coleoptera (5.5%) and Araneae (8.6%) in Hawaii. Time-isolation models were, in general, not statistical significant and explained less variation than the equivalent directional network models for all the datasets. Directional network models provide a way for evaluating the spatio-temporal signature of species dispersal. The method allows building scenarios against which hypotheses about dispersal within archipelagos may be tested. The new framework may help to uncover the pathways via which species have colonized the islands of a given archipelago and to understand the origins of insular biodiversity.

Project description:BackgroundAt present, dengue control focuses on reducing the density of the primary vector for the disease, Aedes aegypti, which is the only vulnerable link in the chain of transmission. The use of new approaches for dengue entomological surveillance is extremely important, since present methods are inefficient. With this in mind, the present study seeks to analyze the spatio-temporal dynamics of A. aegypti infestation with oviposition traps, using efficient computational methods. These methods will allow for the implementation of the proposed model and methodology into surveillance and monitoring systems.MethodsThe study area includes a region in the municipality of Rio de Janeiro, characterized by high population density, precarious domicile construction, and a general lack of infrastructure around it. Two hundred and forty traps were distributed in eight different sentinel areas, in order to continually monitor immature Aedes aegypti and Aedes albopictus mosquitoes. Collections were done weekly between November 2010 and August 2012. The relationship between egg number and climate and environmental variables was considered and evaluated through Bayesian zero-inflated spatio-temporal models. Parametric inference was performed using the Integrated Nested Laplace Approximation (INLA) method.ResultsInfestation indexes indicated that ovipositing occurred during the entirety of the study period. The distance between each trap and the nearest boundary of the study area, minimum temperature and accumulated rainfall were all significantly related to the number of eggs present in the traps. Adjusting for the interaction between temperature and rainfall led to a more informative surveillance model, as such thresholds offer empirical information about the favorable climatic conditions for vector reproduction. Data were characterized by moderate time (0.29 - 0.43) and spatial (21.23 - 34.19 m) dependencies. The models also identified spatial patterns consistent with human population density in all sentinel areas. The results suggest the need for weekly surveillance in the study area, using traps allocated between 18 and 24 m, in order to understand the dengue vector dynamics.ConclusionsAedes aegypti, due to it short generation time and strong response to climate triggers, tend to show an eruptive dynamics that is difficult to predict and understand through just temporal or spatial models. The proposed methodology allowed for the rapid and efficient implementation of spatio-temporal models that considered zero-inflation and the interaction between climate variables and patterns in oviposition, in such a way that the final model parameters contribute to the identification of priority areas for entomological surveillance.

Dataset Information

A topic modeling framework for spatio-temporal information management.

Publications

A topic modeling framework for spatio-temporal information management.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets