Dataset Information

Abusive Language Detection in Online Conversations by Combining Content- and Graph-Based Features.

ABSTRACT: In recent years, online social networks have allowed world-wide users to meet and discuss. As guarantors of these communities, the administrators of these platforms must prevent users from adopting inappropriate behaviors. This verification task, mainly done by humans, is more and more difficult due to the ever growing amount of messages to check. Methods have been proposed to automatize this moderation process, mainly by providing approaches based on the textual content of the exchanged messages. Recent work has also shown that characteristics derived from the structure of conversations, in the form of conversational graphs, can help detecting these abusive messages. In this paper, we propose to take advantage of both sources of information by proposing fusion methods integrating content- and graph-based features. Our experiments on raw chat logs show not only that the content of the messages, but also their dynamics within a conversation contain partially complementary information, allowing performance improvements on an abusive message classification task with a final F-measure of 93.26%.

SUBMITTER: Cecillon N

PROVIDER: S-EPMC7931951 | biostudies-literature | 2019

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Abusive Language Detection in Online Conversations by Combining Content- and Graph-Based Features.

Cécillon Noé N Labatut Vincent V Dufour Richard R Linarès Georges G

Frontiers in big data 20190604

In recent years, online social networks have allowed world-wide users to meet and discuss. As guarantors of these communities, the administrators of these platforms must prevent users from adopting inappropriate behaviors. This verification task, mainly done by humans, is more and more difficult due to the ever growing amount of messages to check. Methods have been proposed to automatize this moderation process, mainly by providing approaches based on the textual content of the exchanged message ...[more]

PMID: 33693331

Similar Datasets

Project description:Variability in expressive and receptive language, difficulty with pragmatic language, and prosodic difficulties are all features of autism spectrum disorder (ASD). Quantifying language and voice characteristics is an important step for measuring outcomes for autistic people, yet clinical measurement is cumbersome and costly. Using natural language processing (NLP) methods and a harmonic model of speech, we analyzed language transcripts and audio recordings to automatically classify individuals as ASD or non-ASD. One-hundred fifty-eight participants (88 ASD, 70 non-ASD) ages 7 to 17 were evaluated with the autism diagnostic observation schedule (ADOS-2), module 3. The ADOS-2 was transcribed following modified SALT guidelines. Seven automated language measures (ALMs) and 10 automated voice measures (AVMs) for each participant were generated from the transcripts and audio of one ADOS-2 task. The measures were analyzed using support vector machine (SVM; a binary classifier) and receiver operating characteristic (ROC). The AVM model resulted in an ROC area under the curve (AUC) of 0.7800, the ALM model an AUC of 0.8748, and the combined model a significantly improved AUC of 0.9205. The ALM model better detected ASD participants who were younger and had lower language skills and shorter activity time. ASD participants detected by the AVM model had better language profiles than those detected by the language model. In combination, automated measurement of language and voice characteristics successfully differentiated children with and without autism. This methodology could help design robust outcome measures for future research. LAY SUMMARY: People with autism often struggle with communication differences which traditional clinical measures and language tests cannot fully capture. Using language transcripts and audio recordings from 158 children ages 7 to 17, we showed that automated, objective language and voice measurements successfully predict the child's diagnosis. This methodology could help design improved outcome measures for research.

Project description:BackgroundApproximately one-third of Japanese couples currently worry or previously worried about infertility. To develop strategies for the primary prevention of infertility as a population approach, it is important for the general population to be knowledgeable about fertility and infertility. The internet may contribute to the dissemination of information regarding infertility and fertility. However, few studies have examined online information about fertility.ObjectiveThis study aimed to quantitatively examine online Japanese-language information about lifestyle factors associated with reduced fertility.MethodsWe conducted online searches, using the 10 search terms with the highest numbers of searches that people hoping to conceive are likely to input in two major search engines in Japan (Google Japan and Yahoo! Japan). From the 2200 retrieved websites, 1181 duplicates and 500 websites unrelated to our objective were excluded, resulting in a final dataset of 519 websites. Coding guidelines were developed for the following lifestyle factors associated with reduced fertility: sexually transmitted diseases, psychological stress, cigarette smoking, alcohol use, nutrition and diet, physical activity and exercise, underweight, overweight and obesity, and environmental pollutants.ResultsIn terms of the website author's professional expertise, 69.6 % of the coding instances for the selected lifestyle factors were mentioned by hospitals, clinics, or the media, whereas only 1.7% were mentioned by laypersons. Psychological stress (20.1%) and sexually transmitted diseases (18.8%) were the most frequently mentioned lifestyle factors associated with reduced fertility. In contrast, cigarette smoking, alcohol use, nutrition and diet, physical activity and exercise, underweight, overweight and obesity, and environmental pollutants were mentioned relatively infrequently. The association between reduced fertility and sexually transmitted diseases was mentioned significantly more frequently by hospitals and clinics than by the media (P<.001). The association between reduced fertility and nutrition and diet was mentioned significantly more frequently by the media than by hospitals and clinics (P=.008). With regard to the sex of the target audience for the information, female-specific references to psychological stress, sexually transmitted diseases, nutrition and diet, underweight, physical activity and exercise, and overweight and obesity were significantly more frequent than were male-specific references to these lifestyle factors (psychological stress: P=.002, sexually transmitted diseases: P<.001, nutrition and diet: P<.001, underweight: P<.001, physical activity and exercise: P<.001, overweight and obesity: P<.001).ConclusionsOf the lifestyle factors known to be related to reduced fertility, cigarette smoking, alcohol use, and male-specific lifestyle factors are mentioned relatively infrequently in online information sources in Japan, and these factors should be discussed more in information published on websites.

Project description:BackgroundReminiscence is the act of thinking or talking about personal experiences that occurred in the past. It is a central task of old age that is essential for healthy aging, and it serves multiple functions, such as decision-making and introspection, transmitting life lessons, and bonding with others. The study of social reminiscence behavior in everyday life can be used to generate data and detect reminiscence from general conversations.ObjectiveThe aims of this original paper are to (1) preprocess coded transcripts of conversations in German of older adults with natural language processing (NLP), and (2) implement and evaluate learning strategies using different NLP features and machine learning algorithms to detect reminiscence in a corpus of transcripts.MethodsThe methods in this study comprise (1) collecting and coding of transcripts of older adults' conversations in German, (2) preprocessing transcripts to generate NLP features (bag-of-words models, part-of-speech tags, pretrained German word embeddings), and (3) training machine learning models to detect reminiscence using random forests, support vector machines, and adaptive and extreme gradient boosting algorithms. The data set comprises 2214 transcripts, including 109 transcripts with reminiscence. Due to class imbalance in the data, we introduced three learning strategies: (1) class-weighted learning, (2) a meta-classifier consisting of a voting ensemble, and (3) data augmentation with the Synthetic Minority Oversampling Technique (SMOTE) algorithm. For each learning strategy, we performed cross-validation on a random sample of the training data set of transcripts. We computed the area under the curve (AUC), the average precision (AP), precision, recall, as well as F1 score and specificity measures on the test data, for all combinations of NLP features, algorithms, and learning strategies.ResultsClass-weighted support vector machines on bag-of-words features outperformed all other classifiers (AUC=0.91, AP=0.56, precision=0.5, recall=0.45, F1=0.48, specificity=0.98), followed by support vector machines on SMOTE-augmented data and word embeddings features (AUC=0.89, AP=0.54, precision=0.35, recall=0.59, F1=0.44, specificity=0.94). For the meta-classifier strategy, adaptive and extreme gradient boosting algorithms trained on word embeddings and bag-of-words outperformed all other classifiers and NLP features; however, the performance of the meta-classifier learning strategy was lower compared to other strategies, with highly imbalanced precision-recall trade-offs.ConclusionsThis study provides evidence of the applicability of NLP and machine learning pipelines for the automated detection of reminiscence in older adults' everyday conversations in German. The methods and findings of this study could be relevant for designing unobtrusive computer systems for the real-time detection of social reminiscence in the everyday life of older adults and classifying their functions. With further improvements, these systems could be deployed in health interventions aimed at improving older adults' well-being by promoting self-reflection and suggesting coping strategies to be used in the case of dysfunctional reminiscence cases, which can undermine physical and mental health.

Dataset Information

Abusive Language Detection in Online Conversations by Combining Content- and Graph-Based Features.

Publications

Abusive Language Detection in Online Conversations by Combining Content- and Graph-Based Features.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets