A first public dataset from Brazilian twitter and news on COVID-19 in Portuguese.
Ontology highlight
ABSTRACT:
SUBMITTER: de Melo T
PROVIDER: S-EPMC7434436 | biostudies-literature | 2020 Oct
REPOSITORIES: biostudies-literature
Publications
A first public dataset from Brazilian twitter and news on COVID-19 in Portuguese.
de Melo Tiago T Figueiredo Carlos M S CMS
Data in brief 20200818
In this data article, we provide a collection of 3,925,366 tweets and 18,413 online news around the online discussion about COVID-19 in Brazil. The data from Twitter were collected through Twitterscraper Python library and we considered a set of keywords in Portuguese regarding to COVID-19. In order to facilitate the identification of tweets that have hashtags, media and retweets for researchers or data enthusiasts, we created three specific datasets for each of these categories. The news on COV ...[more]
Similar Datasets
Project description:Every day thousands of news are published on the web and filtering tools can be used to extract knowledge on specific topics. The categorization of news into a predefined set of topics is a subject widely studied in the literature, however, most works are restricted to documents in English. In this work, we make two contributions. First, we introduce a Portuguese news dataset collected from WikiNews an open-source media that provide news from different sources. Since there is a lack of datasets for Portuguese, and an existing one is from a single news channel, we aim to introduce a dataset from different news channels. The availability of comprehensive datasets plays a key role in advancing research. Second, we compare different architectures for Portuguese news classification, exploring different text representations (BoW, TF-IDF, Embedding) and classification techniques (SVM, CNN, DJINN, BERT) for documents in Portuguese, covering classical methods and current technologies. We show the trade-off between accuracy and training time for this application. We aim to show the capabilities of available algorithms and the challenges faced in the area.
| S-EPMC10817201 | biostudies-literature
Project description:The use of social media data, like Twitter, for biomedical research has been gradually increasing over the years. With the COVID-19 pandemic, researchers have turned to more nontraditional sources of clinical data to characterize the disease in near real-time, study the societal implications of interventions, as well as the sequelae that recovered COVID-19 cases present (Long-COVID). However, manually curated social media datasets are difficult to come by due to the expensive costs of manual annotation and the efforts needed to identify the correct texts. When datasets are available, they are usually very small and their annotations do not generalize well over time or to larger sets of documents. As part of the 2021 Biomedical Linked Annotation Hackathon, we release our dataset of over 120 million automatically annotated tweets for biomedical research purposes. Incorporating best practices, we identify tweets with potentially high clinical relevance. We evaluated our work by comparing several SpaCy-based annotation frameworks against a manually annotated gold-standard dataset. Selecting the best method to use for automatic annotation, we then annotated 120 million tweets and released them publicly for future downstream usage within the biomedical domain.
| S-EPMC8328063 | biostudies-literature
Project description:Vaccine hesitancy is considered as one main cause of the stagnant uptake ratio of COVID-19 vaccines in Europe and the US where vaccines are sufficiently supplied. A fast and accurate grasp of public attitudes toward vaccination is critical to addressing vaccine hesitancy, and social media platforms have proved to be an effective source of public opinions. In this paper, we describe the collection and release of a dataset of tweets related to COVID-19 vaccines. This dataset consists of the IDs of 2,198,090 tweets collected from Western Europe, 17,934 of which are annotated with the originators' vaccination stances. Our annotation will facilitate using and developing data-driven models to extract vaccination attitudes from social media posts and thus further confirm the power of social media in public health surveillance. To lay the groundwork for future research, we not only perform statistical analysis and visualization of our dataset, but also evaluate and compare the performance of established text-based benchmarks in vaccination stance extraction. We demonstrate one potential use of our data in practice in tracking the temporal changes in public COVID-19 vaccination attitudes.
| S-EPMC9343770 | biostudies-literature
Project description:The context of the COVID-19 pandemic has brought to light the infodemic phenomenon and the problem of misinformation. Agencies involved in managing COVID-19 immunization programs are also looking for ways to combat this problem, demanding analytical tools specialized in identifying patterns of misinformation and understanding how they have evolved in time and space to demonstrate their effects on public trust. The aim of this article is to present the results of a study applying topic analysis in space and time with respect to public opinion on the Brazilian COVID-19 immunization program. The analytical process involves applying topic discovery to tweets with geoinformation extracted from the COVID-19 vaccination theme. After extracting the topics, they were submitted to manual annotation, whereby the polarity labels pro, anti, and neutral were applied based on the support and trust in the COVID-19 vaccination. A space and time analysis was carried out using the topic and polarity distributions, making it possible to understand moments during which the most significant quantities of posts occurred and the cities that generated the most tweets. The analytical process describes a framework capable of meeting the needs of agencies for tools, providing indications of how misinformation has evolved and where its dissemination focuses, in addition to defining the granularity of this information according to what managers define as adequate. The following research outcomes can be highlighted. (1) We identified a specific date containing a peak that stands out among the other dates, indicating an event that mobilized public opinion about COVID-19 vaccination. (2) We extracted 23 topics, enabling the manual polarity annotation of each topic and an understanding of which polarities were associated with tweets. (3) Based on the association between polarities, topics, and tweets, it was possible to identify the Brazilian cities that produced the majority of tweets for each polarity and the amount distribution of tweets relative to cities populations.
| S-EPMC9783210 | biostudies-literature
Project description:As the SARS-CoV-2 (COVID-19) pandemic has run rampant worldwide, the dissemination of misinformation has sown confusion on a global scale. Thus, understanding the propagation of fake news and implementing countermeasures has become exceedingly important to the well-being of society. To assist this cause, we produce a valuable dataset called FibVID (Fake news information-broadcasting dataset of COVID-19), which addresses COVID-19 and non-COVID news from three key angles. First, we provide truth and falsehood (T/F) indicators of news items, as labeled and validated by several fact-checking platforms (e.g., Snopes and Politifact). Second, we collect spurious-claim-related tweets and retweets from Twitter, one of the world's largest social networks. Third, we provide basic user information, including the terms and characteristics of "heavy fake news" user to present a better understanding of T/F claims in consideration of COVID-19. FibVID provides several significant contributions. It helps to uncover propagation patterns of news items and themes related to identifying their authenticity. It further helps catalog and identify the traits of users who engage in fake news diffusion. We also provide suggestions for future applications of FibVID with a few exploratory analyses to examine the effectiveness of the approaches used.
| S-EPMC9759652 | biostudies-literature
Project description:Disinformation (fake news) is a major problem that affects modern populations, especially in an era when information can be spread from one corner of the world to another in just one click. The diffusion of misinformation becomes more problematic when it addresses issues related to health, as it can affect people at both the individual and population levels. Through the ideas proposed by cultural evolution theory, in this study, we seek to understand the dynamics of disseminating messages (cultural traits) with untrue content (maladaptive traits). For our investigation, we used the scenario caused by the Coronavirus Disease 2019 (COVID-19) pandemic as a model. The instability caused by the pandemic provides a good model for the study of adapted and maladaptive traits, as the information can directly affect individual and population fitness. Through data collected on the Twitter platform (259,176 tweets) and using machine learning techniques and web scraping, we built a predictive model to analyze the following questions: (1) Is false information more shared? (2) Is false information more adopted? (3) Do people with social prestige influence the dissemination of maladaptive traits of COVID-19? We observed that fake news features contained in messages with false information were shared and adopted as unblemished messages. We also observed that social prestige was not a determining factor for the diffusion of maladaptive traits. Even with the ability to allow connections between individuals participating in social media, some factors such as attachment to cultural traits and the formation of social bubbles can favor isolation and decrease connectivity between individuals. Consequently, in the scenario of isolation between groups and low connectivity between individuals, there is a reduction in cultural exchange between people, which interferes with the dynamics of the selection of cultural traits. Thus, maladaptive (harmful) traits are favored and maintained in the cultural system. We also argue that the local Brazilian cultural context can be a determining factor for maintaining maladaptive traits. We conclude that in an unstable (pandemic) scenario, the information transmitted on Twitter is not reliable in relation to the increase in fitness, which may occur because of the low cultural exchange promoted by the personalization of the social network and cultural context of the population.Supplementary informationThe online version contains supplementary material available at 10.1007/s42979-021-00836-w.
| S-EPMC8397611 | biostudies-literature
Project description:In this data article, a collection of 11,625,887 tweets on the topic of the COVID-19 pandemic are provided. The data from Twitter were collected through Twitter API from January 2020 to June 2020. In addition, we also provided subsets of tweets containing discourses on both COVID-19 and financial topics. In order to facilitate the research on sentiment analysis, the Sentiment140 dataset containing 1,600,000 tweets that were annotated as positive or negative sentiment was also provided (Go et al., 2009) We used Term Frequency-Inverse Document Frequency (TF-IDF) algorithm to transform documents to numeric vectors and used logistic regression classifier to train and predict sentiments of tweets. These datasets may garner interest from data science, economists, social science, natural language processing, epidemiology, and public health groups.
| S-EPMC9270199 | biostudies-literature
Project description:Along with the traditional news publishing policies, news agencies now share news over the internet since people nowadays prefer reading news online. Moreover, news media maintain YouTube channels to publish visual stories. Readers comment to share their opinions below the corresponding news item. These news and comments have been a great source of information and research. However, there is a lack of research in the Bengali news context. This article presents a dataset containing 7,62,678 public comments and replies from 16,016 video news published from 2017 to 2023 from a renowned Bengali news YouTube channel. The data withholds 15 properties of news that include video URL, title, likes, views, date of publishing, hashtags, description, comment author, comment time, comment, likes in the comment, reply author, reply time, reply, and likes in the responses. To ensure privacy, the commentator's name is encoded in the dataset. The dataset is open to use for researchers at https://data.mendeley.com/datasets/3c3j3bkxvn/4. A translated file for the raw dataset is also included. This data may help scholars to identify patterns in public opinion and analyze how public opinion changes over time.
| S-EPMC10762352 | biostudies-literature
Project description:BACKGROUND:SARS-CoV-2 (severe acute respiratory coronavirus 2) was spreading rapidly in South Korea at the end of February 2020 following its initial outbreak in China, making Korea the new center of global attention. The role of social media amid the current coronavirus disease (COVID-19) pandemic has often been criticized, but little systematic research has been conducted on this issue. Social media functions as a convenient source of information in pandemic situations. OBJECTIVE:Few infodemiology studies have applied network analysis in conjunction with content analysis. This study investigates information transmission networks and news-sharing behaviors regarding COVID-19 on Twitter in Korea. The real time aggregation of social media data can serve as a starting point for designing strategic messages for health campaigns and establishing an effective communication system during this outbreak. METHODS:Korean COVID-19-related Twitter data were collected on February 29, 2020. Our final sample comprised of 43,832 users and 78,233 relationships on Twitter. We generated four networks in terms of key issues regarding COVID-19 in Korea. This study comparatively investigates how COVID-19-related issues have circulated on Twitter through network analysis. Next, we classified top news channels shared via tweets. Lastly, we conducted a content analysis of news frames used in the top-shared sources. RESULTS:The network analysis suggests that the spread of information was faster in the Coronavirus network than in the other networks (Corona19, Shincheon, and Daegu). People who used the word "Coronavirus" communicated more frequently with each other. The spread of information was faster, and the diameter value was lower than for those who used other terms. Many of the news items highlighted the positive roles being played by individuals and groups, directing readers' attention to the crisis. Ethical issues such as deviant behavior among the population and an entertainment frame highlighting celebrity donations also emerged often. There was a significant difference in the use of nonportal (n=14) and portal news (n=26) sites between the four network types. The news frames used in the top sources were similar across the networks (P=.89, 95% CI 0.004-0.006). Tweets containing medically framed news articles (mean 7.571, SD 1.988) were found to be more popular than tweets that included news articles adopting nonmedical frames (mean 5.060, SD 2.904; N=40, P=.03, 95% CI 0.169-4.852). CONCLUSIONS:Most of the popular news on Twitter had nonmedical frames. Nevertheless, the spillover effect of the news articles that delivered medical information about COVID-19 was greater than that of news with nonmedical frames. Social media network analytics cannot replace the work of public health officials; however, monitoring public conversations and media news that propagates rapidly can assist public health professionals in their complex and fast-paced decision-making processes.
| S-EPMC7202309 | biostudies-literature
Project description:In recent years, biodiversity has emerged as a prominent and pressing topic due to the urgent need to address biodiversity loss and the recognition of its connections to climate change and sustainable development. Additionally, increased public awareness and the consideration of economic factors have further underscored the significance of biodiversity conservation. To investigate the sentiment of the Indonesian people towards biodiversity, we conducted a comprehensive data collection on Twitter, focusing on keywords we have set. We amassed a substantial dataset of 500,000 Indonesian tweets from January 2020 to March 2023. These tweets encompassed a wide range of discussions on biodiversity, including its subdomains such as food security, health, and environmental management. Three annotators labeled each tweet with a sentiment class (positive, negative, neutral), or label none for unrelated tweet. The final label was determined using the majority voting method. The tweets with the final label none and those with undecided sentiment class were considered invalid and excluded in the subsequent process. Before labeling, a team of 18 experts jointly developed a labeling guide. This document served as a reference in labeling. After going through a series of processes, including cleaning (removing duplications, irrelevant tweets, and tweets written other than in Indonesian) and preprocessing, we prepared a dataset containing 13,435 tweets. We measured the inter-annotator agreement level, made several models using different algorithms and the K-Fold cross-validation method, and evaluated the models. The Fleiss' Kappa value of the dataset was 0.62187 as the value of the inter-annotator agreement level, and the F1-score value with the best model using the pre-trained IndoBERT model was 0.7959. The Fleiss' Kappa and F1-score values suggest that the annotators have a substantial comprehension and agreement of how to label a tweet, thus ensuring consistency and reliability of our dataset, and the reusability of our dataset is quite suitable for further research on sentiment analysis on biodiversity, respectively. This dataset will benefit various research, including topic modeling, sentiment analysis, public opinion analysis on Twitter, etc., especially biodiversity-related policies.
| S-EPMC10749236 | biostudies-literature