Dataset Information

Evaluating the predictability of medical conditions from social media posts.

ABSTRACT: We studied whether medical conditions across 21 broad categories were predictable from social media content across approximately 20 million words written by 999 consenting patients. Facebook language significantly improved upon the prediction accuracy of demographic variables for 18 of the 21 disease categories; it was particularly effective at predicting diabetes and mental health conditions including anxiety, depression and psychoses. Social media data are a quantifiable link into the otherwise elusive daily lives of patients, providing an avenue for study and assessment of behavioral and environmental disease risk factors. Analogous to the genome, social media data linked to medical diagnoses can be banked with patients' consent, and an encoding of social media language can be used as markers of disease risk, serve as a screening tool, and elucidate disease epidemiology. In what we believe to be the first report linking electronic medical record data with social media data from consenting patients, we identified that patients' Facebook status updates can predict many health conditions, suggesting opportunities to use social media data to determine disease onset or exacerbation and to conduct social media-based health interventions.

SUBMITTER: Merchant RM

PROVIDER: S-EPMC6576767 | biostudies-literature | 2019

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Evaluating the predictability of medical conditions from social media posts.

Merchant Raina M RM Asch David A DA Crutchley Patrick P Ungar Lyle H LH Guntuku Sharath C SC Eichstaedt Johannes C JC Hill Shawndra S Padrez Kevin K Smith Robert J RJ Schwartz H Andrew HA

PloS one 20190617 6

We studied whether medical conditions across 21 broad categories were predictable from social media content across approximately 20 million words written by 999 consenting patients. Facebook language significantly improved upon the prediction accuracy of demographic variables for 18 of the 21 disease categories; it was particularly effective at predicting diabetes and mental health conditions including anxiety, depression and psychoses. Social media data are a quantifiable link into the otherwis ...[more]

PMID: 31206534

Similar Datasets

Project description:BackgroundPatient-based analysis of social media is a growing research field with the aim of delivering precision medicine but it requires accurate classification of posts relating to patients' experiences. We motivate the need for this type of classification as a pre-processing step for further analysis of social media data in the context of related work in this area. In this paper we present experiments for a three-way document classification by patient voice, professional voice or other. We present results for a convolutional neural network classifier trained on English data from two different data sources (Reddit and Twitter) and two domains (cardiovascular and skin diseases).ResultsWe found that document classification by patient voice, professional voice or other can be done consistently manually (0.92 accuracy). Annotators agreed roughly equally for each domain (cardiovascular and skin) but they agreed more when annotating Reddit posts compared to Twitter posts. Best classification performance was obtained when training two separate classifiers for each data source, one for Reddit and one for Twitter posts, when evaluating on in-source test data for both test sets combined with an overall accuracy of 0.95 (and macro-average F1 of 0.92) and an F1-score of 0.95 for patient voice only.ConclusionThe main conclusion resulting from this work is that combining social media data from platforms with different characteristics for training a patient and professional voice classifier does not result in best possible performance. We showed that it is best to train separate models per data source (Reddit and Twitter) instead of a model using the combined training data from both sources. We also found that it is preferable to train separate models per domain (cardiovascular and skin) while showing that the difference to the combined model is only minor (0.01 accuracy). Our highest overall F1-score (0.95) obtained for classifying posts as patient voice is a very good starting point for further analysis of social media data reflecting the experience of patients.

Project description:BACKGROUND:Mental illness affects a significant portion of the worldwide population. Online mental health forums can provide a supportive environment for those afflicted and also generate a large amount of data that can be mined to predict mental health states using machine learning methods. OBJECTIVE:This study aimed to benchmark multiple methods of text feature representation for social media posts and compare their downstream use with automated machine learning (AutoML) tools. We tested on datasets that contain posts labeled for perceived suicide risk or moderator attention in the context of self-harm. Specifically, we assessed the ability of the methods to prioritize posts that a moderator would identify for immediate response. METHODS:We used 1588 labeled posts from the Computational Linguistics and Clinical Psychology (CLPsych) 2017 shared task collected from the Reachout.com forum. Posts were represented using lexicon-based tools, including Valence Aware Dictionary and sEntiment Reasoner, Empath, and Linguistic Inquiry and Word Count, and also using pretrained artificial neural network models, including DeepMoji, Universal Sentence Encoder, and Generative Pretrained Transformer-1 (GPT-1). We used Tree-based Optimization Tool and Auto-Sklearn as AutoML tools to generate classifiers to triage the posts. RESULTS:The top-performing system used features derived from the GPT-1 model, which was fine-tuned on over 150,000 unlabeled posts from Reachout.com. Our top system had a macroaveraged F1 score of 0.572, providing a new state-of-the-art result on the CLPsych 2017 task. This was achieved without additional information from metadata or preceding posts. Error analyses revealed that this top system often misses expressions of hopelessness. In addition, we have presented visualizations that aid in the understanding of the learned classifiers. CONCLUSIONS:In this study, we found that transfer learning is an effective strategy for predicting risk with relatively little labeled data and noted that fine-tuning of pretrained language models provides further gains when large amounts of unlabeled text are available.

Project description:BackgroundIn December 2019, pneumonia cases of unknown origin were reported in Wuhan City, Hubei Province, China. Identified as the coronavirus disease (COVID-19), the number of cases grew rapidly by human-to-human transmission in Wuhan. Social media, especially Sina Weibo (a major Chinese microblogging social media site), has become an important platform for the public to obtain information and seek help.ObjectiveThis study aims to analyze the characteristics of suspected or laboratory-confirmed COVID-19 patients who asked for help on Sina Weibo.MethodsWe conducted data mining on Sina Weibo and extracted the data of 485 patients who presented with clinical symptoms and imaging descriptions of suspected or laboratory-confirmed cases of COVID-19. In total, 9878 posts seeking help on Sina Weibo from February 3 to 20, 2020 were analyzed. We used a descriptive research methodology to describe the distribution and other epidemiological characteristics of patients with suspected or laboratory-confirmed SARS-CoV-2 (severe acute respiratory syndrome coronavirus 2) infection. The distance between patients' home and the nearest designated hospital was calculated using the geographic information system ArcGIS.ResultsAll patients included in this study who sought help on Sina Weibo lived in Wuhan, with a median age of 63.0 years (IQR 55.0-71.0). Fever (408/485, 84.12%) was the most common symptom. Ground-glass opacity (237/314, 75.48%) was the most common pattern on chest computed tomography; 39.67% (167/421) of families had suspected and/or laboratory-confirmed family members; 36.58% (154/421) of families had 1 or 2 suspected and/or laboratory-confirmed members; and 70.52% (232/329) of patients needed to rely on their relatives for help. The median time from illness onset to real-time reverse transcription-polymerase chain reaction (RT-PCR) testing was 8 days (IQR 5.0-10.0), and the median time from illness onset to online help was 10 days (IQR 6.0-12.0). Of 481 patients, 32.22% (n=155) lived more than 3 kilometers away from the nearest designated hospital.ConclusionsOur findings show that patients seeking help on Sina Weibo lived in Wuhan and most were elderly. Most patients had fever symptoms, and ground-glass opacities were noted in chest computed tomography. The onset of the disease was characterized by family clustering and most families lived far from the designated hospital. Therefore, we recommend the following: (1) the most stringent centralized medical observation measures should be taken to avoid transmission in family clusters; and (2) social media can help these patients get early attention during Wuhan's lockdown. These findings can help the government and the health department identify high-risk patients and accelerate emergency responses following public demands for help.

Dataset Information

Evaluating the predictability of medical conditions from social media posts.

Publications

Evaluating the predictability of medical conditions from social media posts.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets