Dataset Information

Applying MetaMap to Medline for identifying novel associations in a large clinical dataset: a feasibility analysis.

ABSTRACT:

Objective

We describe experiments designed to determine the feasibility of distinguishing known from novel associations based on a clinical dataset comprised of International Classification of Disease, V.9 (ICD-9) codes from 1.6 million patients by comparing them to associations of ICD-9 codes derived from 20.5 million Medline citations processed using MetaMap. Associations appearing only in the clinical dataset, but not in Medline citations, are potentially novel.

Methods

Pairwise associations of ICD-9 codes were independently identified in both the clinical and Medline datasets, which were then compared to quantify their degree of overlap. We also performed a manual review of a subset of the associations to validate how well MetaMap performed in identifying diagnoses mentioned in Medline citations that formed the basis of the Medline associations.

Results

The overlap of associations based on ICD-9 codes in the clinical and Medline datasets was low: only 6.6% of the 3.1 million associations found in the clinical dataset were also present in the Medline dataset. Further, a manual review of a subset of the associations that appeared in both datasets revealed that co-occurring diagnoses from Medline citations do not always represent clinically meaningful associations.

Discussion

Identifying novel associations derived from large clinical datasets remains challenging. Medline as a sole data source for existing knowledge may not be adequate to filter out widely known associations.

Conclusions

In this study, novel associations were not readily identified. Further improvements in accuracy and relevance for tools such as MetaMap are needed to realize their expected utility.

SUBMITTER: Hanauer DA

PROVIDER: S-EPMC4147617 | biostudies-literature | 2014 Sep-Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Applying MetaMap to Medline for identifying novel associations in a large clinical dataset: a feasibility analysis.

Hanauer David A DA Saeed Mohammed M Zheng Kai K Mei Qiaozhu Q Shedden Kerby K Aronson Alan R AR Ramakrishnan Naren N

Journal of the American Medical Informatics Association : JAMIA 20140613 5

<h4>Objective</h4>We describe experiments designed to determine the feasibility of distinguishing known from novel associations based on a clinical dataset comprised of International Classification of Disease, V.9 (ICD-9) codes from 1.6 million patients by comparing them to associations of ICD-9 codes derived from 20.5 million Medline citations processed using MetaMap. Associations appearing only in the clinical dataset, but not in Medline citations, are potentially novel.<h4>Methods</h4>Pairwis ...[more]

PMID: 24928177

Similar Datasets

Project description:BRCA1-associated protein-1 (BAP1) expression is commonly lost in several tumors including malignant pleural mesothelioma (MPM). Presence or absence of immunohistochemical BAP1 nuclear staining in tumor cells is currently used for differential diagnosis of MPM. In this study, a large cohort of 596 MPM tumors with available clinical data was analyzed to examine associations of BAP1 staining pattern with clinical and molecular features that may reflect the impact of BAP1 mutation on MPM biology. Cases were classified according to the BAP1 staining pattern of tumor cells. Exome and RNA-sequencing data were available for subsets of cases. Levels of mRNA encoding claudin 15 (CLDN15) and vimentin (VIM) were determined using RT-qPCR on 483 cases to estimate the relative proportions of epithelial-like and mesenchymal-like components in each tumor. Four BAP1 staining patterns were observed: single-pattern nuclear staining (36%), single-pattern cytoplasmic staining (25%), single-pattern absent staining (12%), and combinations of these staining patterns (27%). This study confirmed prior reports that nuclear BAP1 is more frequently associated with wild-type BAP1 and sarcomatoid histology. However, no associations between BAP1 staining pattern(s) and mutations in specific protein domains and/or mutation type were observed. BAP1 staining patterns were significantly associated (p?<?0.001) with BAP1 gene expression, MPM histologic subtypes, molecular clusters, and markers of epithelial-to-mesenchymal transition. Frequent observation of combinations of BAP1 staining patterns in MPM tumors indicated intra-tumoral heterogeneity of BAP1 status. Cytoplasmic BAP1 staining was identified as a putative indicator of favorable prognosis in non-epithelioid MPM. In conclusion, novel significant associations among different BAP1 staining patterns and subgroups of MPM tumors were observed, suggesting that the role of BAP1 in tumor progression may be more complex than its presumed tumor suppressor function. Cytoplasmic staining was identified as a putative indicator of favorable prognosis in non-epithelioid MPM, potentially addressing a critical need in clinical decision-making in this disease. © 2020 The Authors. The Journal of Pathology published by John Wiley & Sons, Ltd. on behalf of The Pathological Society of Great Britain and Ireland.

Project description:BACKGROUND:Systematic reviews often investigate the effectiveness of interventions for one sex. However, identifying interventions with data presented according to the sex of study participants can be challenging due to suboptimal indexing in bibliographic databases and poor reporting in titles and abstracts. The purposes of this study were to develop a highly sensitive search filter to identify literature relevant to men's health and to assess the performance of a range of sex-specific search terms used individually and in various combinations. METHODS:Comprehensive electronic searches were undertaken across a range of databases to inform a series of systematic reviews investigating obesity management for men. The included studies formed a reference standard set. A set of sex-specific search terms, identified from database-specific controlled vocabularies and from natural language used in the titles and abstracts of relevant papers, was investigated in MEDLINE and Embase. Sensitivity, precision, number needed to read (NNR) and percent reduction in results compared to searching without sex-specific terms were calculated. RESULTS:The reference standard set comprised 57 papers in MEDLINE and 63 in Embase. Seven sex-specific search terms were identified. Searching without sex-specific terms returned 31,897 results in MEDLINE and 37,351 in Embase and identified 84% (MEDLINE) and 83% (Embase) of the reference standard sets. The best performing individual sex-specific term achieved 100%/98% sensitivity (MEDLINE/Embase), NNR 544/609 (MEDLINE/Embase) and reduced the number of results by 18%/17% (MEDLINE/Embase), relative to searching without sex-specific terms. The best performing filter, compromising different combinations of controlled vocabulary terms and natural language, achieved higher sensitivity (MEDLINE and Embase 100%), greater reduction in number of results (MEDLINE/Embase 24%/20%) and greater reduction in NNR (MEDLINE/Embase 506/578) than the best performing individual sex-specific term. CONCLUSIONS:The proposed MEDLINE and Embase filters achieved high sensitivity and a reduction in the number of search results and NNR, indicating that they are useful tools for efficient, comprehensive literature searching but their performance is partially dependent on the appropriate use of database controlled vocabularies and index terms.

Dataset Information

Applying MetaMap to Medline for identifying novel associations in a large clinical dataset: a feasibility analysis.

Objective

Methods

Results

Discussion

Conclusions

Publications

Applying MetaMap to Medline for identifying novel associations in a large clinical dataset: a feasibility analysis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure