Dataset Information

Induced lexico-syntactic patterns improve information extraction from online medical forums.

ABSTRACT:

Objective

To reliably extract two entity types, symptoms and conditions (SCs), and drugs and treatments (DTs), from patient-authored text (PAT) by learning lexico-syntactic patterns from data annotated with seed dictionaries.

Background and significance

Despite the increasing quantity of PAT (eg, online discussion threads), tools for identifying medical entities in PAT are limited. When applied to PAT, existing tools either fail to identify specific entity types or perform poorly. Identification of SC and DT terms in PAT would enable exploration of efficacy and side effects for not only pharmaceutical drugs, but also for home remedies and components of daily care.

Materials and methods

We use SC and DT term dictionaries compiled from online sources to label several discussion forums from MedHelp (http://www.medhelp.org). We then iteratively induce lexico-syntactic patterns corresponding strongly to each entity type to extract new SC and DT terms.

Results

Our system is able to extract symptom descriptions and treatments absent from our original dictionaries, such as 'LADA', 'stabbing pain', and 'cinnamon pills'. Our system extracts DT terms with 58-70% F1 score and SC terms with 66-76% F1 score on two forums from MedHelp. We show improvements over MetaMap, OBA, a conditional random field-based classifier, and a previous pattern learning approach.

Conclusions

Our entity extractor based on lexico-syntactic patterns is a successful and preferable technique for identifying specific entity types in PAT. To the best of our knowledge, this is the first paper to extract SC and DT entities from PAT. We exhibit learning of informal terms often used in PAT but missing from typical dictionaries.

SUBMITTER: Gupta S

PROVIDER: S-EPMC4147618 | biostudies-literature | 2014 Sep-Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Induced lexico-syntactic patterns improve information extraction from online medical forums.

Gupta Sonal S MacLean Diana L DL Heer Jeffrey J Manning Christopher D CD

Journal of the American Medical Informatics Association : JAMIA 20140626 5

<h4>Objective</h4>To reliably extract two entity types, symptoms and conditions (SCs), and drugs and treatments (DTs), from patient-authored text (PAT) by learning lexico-syntactic patterns from data annotated with seed dictionaries.<h4>Background and significance</h4>Despite the increasing quantity of PAT (eg, online discussion threads), tools for identifying medical entities in PAT are limited. When applied to PAT, existing tools either fail to identify specific entity types or perform poorly. ...[more]

PMID: 24970840

Similar Datasets

Project description:BACKGROUND:Online health forums are widely used, but the quality of advice differs as much as the knowledge backgrounds of the audience members who receive the advice. It is important to understand how people judge the information given online. In line with the communication accommodation theory (CAT), online forums represent specific social contexts of communication which can present either accommodative or nonaccommodative language to an audience. Accordingly, use of accommodative or nonaccommodative language might affect people's perceived trust in the communicator. OBJECTIVE:The objective of this study was to investigate how experts who use accommodative (vs nonaccommodative) language are evaluated by passive users of an online forum. METHODS:Participants (n=98) took part in an online experiment and read experts' posts about 10 nutrition myths. Following a 2 x 2 mixed design, experts' posts were written using either low or high amounts of medical technical jargon (MTJ) (within factor) and were directed at different audiences (mainly other medical experts [in a professional forum] vs a user group mainly comprising laypersons [in an advisory forum]) (between factor). Accommodation occurred where experts used high amounts of MTJ to address other medical experts in the professional forum; it also occurred when experts used low amounts of MTJ to address laypersons in the advisory forum. Conversely, nonaccommodation occurred when experts used high amounts of MTJ in the advisory forum and low amounts of MTJ in the professional forum. In each condition, participants evaluated the credibility of the information, the trustworthiness of the experts, and the accommodation by the experts. RESULTS:Overall, participants judged the credibility of information to be higher when experts used MTJ that was accommodative to the designated audience, F1,95=3.10, P=.04, ?p2=.031. In addition, participants judged the experts in professional forums to be more trustworthy than experts in advisory forums (all F1,96?3.54, P ?.03, ?p2?.036). Moreover, participants rated experts who used high amounts of MTJ to have higher competence (F1,96=37.54, P<.001, ?p2=.28], lower integrity (F1,96=10.77, P=.001, ?p2=.101), and lower benevolence (F1,96=9.75, P=.002, ?p2=.092), as well as to have lower perceived accommodation to the audience (all F1,96?72.17, P<.001, ?p2?.43) compared with experts who used low MTJ. CONCLUSIONS:To provide health information online that is perceived as credible, experts should consider using similar language as the language used by the addressed audience. As it is often impossible to determine the exact makeup of an online audience, further research might investigate whether having experts explicitly declare which audience they intend to address can help people to more reliably assess an expert's trustworthiness. Furthermore, as people assess information differently depending on the context of online communication, it would be valuable for research to consider other aspects of the context beyond those of the audience.

Project description:Increasingly, individuals experiencing loneliness are seeking support on online forums-some of which focus specifically on discussions around loneliness (loneliness forums); loneliness may influence how these individuals communicate in other online forums not focused on loneliness (non-loneliness forums). In order to provide effective and appropriate online interventions around loneliness, it is important to understand how users who publish posts in a loneliness forum communicate in the loneliness forum and non-loneliness forums they belong to. In this paper, using language features, the following analyses are conducted: (1) Posts published on an online loneliness forum on Reddit, /r/Lonely are compared to posts (published by the same users and around the same time period) on two Reddit online forums i.e. an advice seeking forum, /r/AskReddit and a forum focused on discussions around depression (depression forum), /r/depression. (2) Interventions related to loneliness may vary depending on if an individual is lonely and depressed or lonely but not depressed; language use differences in posts published in /r/Lonely by the following set of users are identified: (a) users who post in both /r/Lonely and a depression forum and (b) users who post in /r/Lonely but not in the depression forum. The findings from this work gain new insights, for example: (i) /r/Lonely users tend to seek advice/ask questions related to relationships in the advice seeking forum, /r/AskReddit and (ii) users who are members of the loneliness forum but not the depression forum tend to publish posts (on the loneliness forum) on topic themes related to work/job, however, those who are members of the loneliness and depression forums tend to use more words associated with anger, negation, death, and post on topic themes related to affection relative to relationships in their loneliness forum posts. Some of the findings from this work also align with prior work e.g. users who express loneliness in online forums tend to make more reference to self. These findings aid in gaining insights into how users communicate on these forums and their support needs, thereby informing loneliness interventions.

Project description:BACKGROUND:Patient education materials given to breast cancer survivors may not be a good fit for their information needs. Needs may change over time, be forgotten, or be misreported, for a variety of reasons. An automated content analysis of survivors' postings to online health forums can identify expressed information needs over a span of time and be repeated regularly at low cost. Identifying these unmet needs can guide improvements to existing education materials and the creation of new resources. OBJECTIVE:The primary goals of this project are to assess the unmet information needs of breast cancer survivors from their own perspectives and to identify gaps between information needs and current education materials. METHODS:This approach employs computational methods for content modeling and supervised text classification to data from online health forums to identify explicit and implicit requests for health-related information. Potential gaps between needs and education materials are identified using techniques from information retrieval. RESULTS:We provide a new taxonomy for the classification of sentences in online health forum data. 260 postings from two online health forums were selected, yielding 4179 sentences for coding. After annotation of data and training alternative one-versus-others classifiers, a random forest-based approach achieved F1 scores from 66% (Other, dataset2) to 90% (Medical, dataset1) on the primary information types. 136 expressions of need were used to generate queries to indexed education materials. Upon examination of the best two pages retrieved for each query, 12% (17/136) of queries were found to have relevant content by all coders, and 33% (45/136) were judged to have relevant content by at least one. CONCLUSIONS:Text from online health forums can be analyzed effectively using automated methods. Our analysis confirms that breast cancer survivors have many information needs that are not covered by the written documents they typically receive, as our results suggest that at most a third of breast cancer survivors' questions would be addressed by the materials currently provided to them.

Dataset Information

Induced lexico-syntactic patterns improve information extraction from online medical forums.

Objective

Background and significance

Materials and methods

Results

Conclusions

Publications

Induced lexico-syntactic patterns improve information extraction from online medical forums.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets