Dataset Information

Towards a standard sampling methodology on online social networks: collecting global trends on Twitter.

ABSTRACT: One of the most significant current challenges in large-scale online social networks, is to establish a concise and coherent method aimed to collect and summarize data. Sampling the content of an Online Social Network (OSN) plays an important role as a knowledge discovery tool. It is becoming increasingly difficult to ignore the fact that current sampling methods must cope with a lack of a full sampling frame i.e., there is an imposed condition determined by a limited data access. In addition, another key aspect to take into account is the huge amount of data generated by users of social networking services such as Twitter, which is perhaps the most influential microblogging service producing approximately 500 million tweets per day. In this context, due to the size of Twitter, which is problematic to be measured, the analysis of the entire network is infeasible and sampling is unavoidable. In addition, we strongly believe that there is a clear need to develop a new methodology to collect information on social networks (social mining). In this regard, we think that this paper introduces a set of random strategies that could be considered as a reliable alternative to gather global trends on Twitter. It is important to note that this research pretends to show some initial ideas in how convenient are random walks to extract information or global trends. The main purpose of this study, is to propose a suitable methodology to carry out an efficient collecting process via three random strategies: Brownian, Illusion and Reservoir. These random strategies will be applied through a Metropolis-Hastings Random Walk (MHRW). We show that interesting insights can be obtained by sampling emerging global trends on Twitter. The study also offers some important insights providing descriptive statistics and graphical description from the preliminary experiments.

SUBMITTER: Pina-Garcia CA

PROVIDER: S-EPMC6245126 | biostudies-other | 2016

REPOSITORIES: biostudies-other

ACCESS DATA

Publications

Towards a standard sampling methodology on online social networks: collecting global trends on Twitter.

Piña-García C A CA Gershenson Carlos C Siqueiros-García J Mario JM

Applied network science 20160601 1

One of the most significant current challenges in large-scale online social networks, is to establish a concise and coherent method aimed to collect and summarize data. Sampling the content of an Online Social Network (OSN) plays an important role as a knowledge discovery tool. It is becoming increasingly difficult to ignore the fact that current sampling methods must cope with a lack of a full sampling frame i.e., there is an imposed condition determined by a limited data access. In addition, a ...[more]

PMID: 30533495

Similar Datasets

Project description:BackgroundIn Italy, in recent years, vaccination coverage for key immunizations as MMR has been declining to worryingly low levels, with large measles outbreaks. As a response in 2017, the Italian government expanded the number of mandatory immunizations introducing penalties to unvaccinated children's families. During the 2018 general elections campaign, immunization policy entered the political debate with the government in-charge blaming oppositions for fuelling vaccine scepticism. A new government (formerly in the opposition) established in 2018 temporarily relaxed penalties and announced the introduction of forms of flexibility.Objectives and methodsFirst, we supplied a definition of disorientation, as the "lack of well-established and resilient opinions among individuals, therefore causing them to change their positions as a consequence of sufficient external perturbations". Second, procedures for testing for the presence of both short and longer-term collective disorientation in Twitter signals were proposed. Third, a sentiment analysis on tweets posted in Italian during 2018 on immunization topics, and related polarity evaluations, were used to investigate whether the contrasting announcements at the highest political level might have originated disorientation amongst the Italian public.ResultsVaccine-relevant tweeters' interactions peaked in response to main political events. Out of retained tweets, 70.0% resulted favourable to vaccination, 16.4% unfavourable, and 13.6% undecided, respectively. The smoothed time series of polarity proportions exhibit frequent large changes in the favourable proportion, superimposed to a clear up-and-down trend synchronized with the switch between governments in Spring 2018, suggesting evidence of disorientation among the public.ConclusionsThe reported evidence of disorientation for opinions expressed in online social media shows that critical health topics, such as vaccination, should never be used to achieve political consensus. This is worsened by the lack of a strong Italian institutional presence on Twitter, calling for efforts to contrast misinformation and the ensuing spread of hesitancy. It remains to be seen how this disorientation will impact future parents' vaccination decisions.

Project description:BACKGROUND:Although birth defects are the leading cause of infant mortality in the United States, methods for observing human pregnancies with birth defect outcomes are limited. OBJECTIVE:The primary objectives of this study were (i) to assess whether rare health-related events-in this case, birth defects-are reported on social media, (ii) to design and deploy a natural language processing (NLP) approach for collecting such sparse data from social media, and (iii) to utilize the collected data to discover a cohort of women whose pregnancies with birth defect outcomes could be observed on social media for epidemiological analysis. METHODS:To assess whether birth defects are mentioned on social media, we mined 432 million tweets posted by 112,647 users who were automatically identified via their public announcements of pregnancy on Twitter. To retrieve tweets that mention birth defects, we developed a rule-based, bootstrapping approach, which relies on a lexicon, lexical variants generated from the lexicon entries, regular expressions, post-processing, and manual analysis guided by distributional properties. To identify users whose pregnancies with birth defect outcomes could be observed for epidemiological analysis, inclusion criteria were (i) tweets indicating that the user's child has a birth defect, and (ii) accessibility to the user's tweets during pregnancy. We conducted a semi-automatic evaluation to estimate the recall of the tweet-collection approach, and performed a preliminary assessment of the prevalence of selected birth defects among the pregnancy cohort derived from Twitter. RESULTS:We manually annotated 16,822 retrieved tweets, distinguishing tweets indicating that the user's child has a birth defect (true positives) from tweets that merely mention birth defects (false positives). Inter-annotator agreement was substantial: ??=?0.79 (Cohen's kappa). Analyzing the timelines of the 646 users whose tweets were true positives resulted in the discovery of 195 users that met the inclusion criteria. Congenital heart defects are the most common type of birth defect reported on Twitter, consistent with findings in the general population. Based on an evaluation of 4169 tweets retrieved using alternative text mining methods, the recall of the tweet-collection approach was 0.95. CONCLUSIONS:Our contributions include (i) evidence that rare health-related events are indeed reported on Twitter, (ii) a generalizable, systematic NLP approach for collecting sparse tweets, (iii) a semi-automatic method to identify undetected tweets (false negatives), and (iv) a collection of publicly available tweets by pregnant users with birth defect outcomes, which could be used for future epidemiological analysis. In future work, the annotated tweets could be used to train machine learning algorithms to automatically identify users reporting birth defect outcomes, enabling the large-scale use of social media mining as a complementary method for such epidemiological research.

Dataset Information

Towards a standard sampling methodology on online social networks: collecting global trends on Twitter.

Publications

Towards a standard sampling methodology on online social networks: collecting global trends on Twitter.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets