Reading Akkadian cuneiform using natural language processing.
Ontology highlight
ABSTRACT:
SUBMITTER: Gordin S
PROVIDER: S-EPMC7592802 | biostudies-literature | 2020
REPOSITORIES: biostudies-literature
Publications
Reading Akkadian cuneiform using natural language processing.
Gordin Shai S Gutherz Gai G Elazary Ariel A Romach Avital A Jiménez Enrique E Berant Jonathan J Cohen Yoram Y
PloS one 20201028 10
In this paper we present a new method for automatic transliteration and segmentation of Unicode cuneiform glyphs using Natural Language Processing (NLP) techniques. Cuneiform is one of the earliest known writing system in the world, which documents millennia of human civilizations in the ancient Near East. Hundreds of thousands of cuneiform texts were found in the nineteenth and twentieth centuries CE, most of which are written in Akkadian. However, there are still tens of thousands of texts to ...[more]
Similar Datasets
Project description:BackgroundMedical notes are a rich source of patient data; however, the nature of unstructured text has largely precluded the use of these data for large retrospective analyses. Transforming clinical text into structured data can enable large-scale research studies with electronic health records (EHR) data. Natural language processing (NLP) can be used for text information retrieval, reducing the need for labor-intensive chart review. Here we present an application of NLP to large-scale analysis of medical records at 2 large hospitals for patients hospitalized with COVID-19.ObjectiveOur study goal was to develop an NLP pipeline to classify the discharge disposition (home, inpatient rehabilitation, skilled nursing inpatient facility [SNIF], and death) of patients hospitalized with COVID-19 based on hospital discharge summary notes.MethodsText mining and feature engineering were applied to unstructured text from hospital discharge summaries. The study included patients with COVID-19 discharged from 2 hospitals in the Boston, Massachusetts area (Massachusetts General Hospital and Brigham and Women's Hospital) between March 10, 2020, and June 30, 2020. The data were divided into a training set (70%) and hold-out test set (30%). Discharge summaries were represented as bags-of-words consisting of single words (unigrams), bigrams, and trigrams. The number of features was reduced during training by excluding n-grams that occurred in fewer than 10% of discharge summaries, and further reduced using least absolute shrinkage and selection operator (LASSO) regularization while training a multiclass logistic regression model. Model performance was evaluated using the hold-out test set.ResultsThe study cohort included 1737 adult patients (median age 61 [SD 18] years; 55% men; 45% White and 16% Black; 14% nonsurvivors and 61% discharged home). The model selected 179 from a vocabulary of 1056 engineered features, consisting of combinations of unigrams, bigrams, and trigrams. The top features contributing most to the classification by the model (for each outcome) were the following: "appointments specialty," "home health," and "home care" (home); "intubate" and "ARDS" (inpatient rehabilitation); "service" (SNIF); "brief assessment" and "covid" (death). The model achieved a micro-average area under the receiver operating characteristic curve value of 0.98 (95% CI 0.97-0.98) and average precision of 0.81 (95% CI 0.75-0.84) in the testing set for prediction of discharge disposition.ConclusionsA supervised learning-based NLP approach is able to classify the discharge disposition of patients hospitalized with COVID-19. This approach has the potential to accelerate and increase the scale of research on patients' discharge disposition that is possible with EHR data.
| S-EPMC7879729 | biostudies-literature
Project description:ObjectiveStructured data on mammographic findings are difficult to obtain without manual review. We developed and evaluated a rule-based natural language processing (NLP) system to extract mammographic findings from free-text mammography reports.Materials and methodsThe NLP system extracted four mammographic findings: mass, calcification, asymmetry, and architectural distortion, using a dictionary look-up method on 93,705 mammography reports from Group Health. Status annotations and anatomical location annotation were associated to each NLP detected finding through association rules. After excluding negated, uncertain, and historical findings, affirmative mentions of detected findings were summarized. Confidence flags were developed to denote reports with highly confident NLP results and reports with possible NLP errors. A random sample of 100 reports was manually abstracted to evaluate the accuracy of the system.ResultsThe NLP system correctly coded 96-99 out of our sample of 100 reports depending on findings. Measures of sensitivity, specificity and negative predictive values exceeded 0.92 for all findings. Positive predictive values were relatively low for some findings due to their low prevalence.DiscussionOur NLP system was implemented entirely in SAS Base, which makes it portable and easy to implement. It performed reasonably well with multiple applications, such as using confidence flags as a filter to improve the efficiency of manual review. Refinements of library and association rules, and testing on more diverse samples may further improve its performance.ConclusionOur NLP system successfully extracts clinically useful information from mammography reports. Moreover, SAS is a feasible platform for implementing NLP algorithms.
| S-EPMC4408241 | biostudies-literature
Project description:Reading is a unique human ability that plays a pivotal role in the development and functioning of our modern society. However, its neural basis remains poorly understood since previous research was focused on reading words with fixed gaze. Here we developed a methodological framework for single-trial analysis of fixation onset-related EEG activity (FOREA) that enabled us to investigate visual information processing during natural reading. To reveal the effect of reading skills on orthographic processing during natural reading, we measured how altering the configural properties of the written text by modifying inter-letter spacing affects FOREA. We found that orthographic processing is reflected in FOREA in three consecutive time windows (120-175?ms, 230-265?ms, 345-380?ms after fixation onset) and the magnitude of FOREA effects in the two later time intervals showed a close association with the participants' reading speed: FOREA effects were larger in fast than in slow readers. Furthermore, these expertise-driven configural effects were clearly dissociable from the FOREA signatures of visual perceptual processes engaged to handle the increased crowding (155-220?ms) as a result of decreasing letter spacing. Our findings revealed that with increased reading skills orthographic processing becomes more sensitive to the configural properties of the written text.
| S-EPMC4882504 | biostudies-literature
Project description:ObjectiveSeizure frequency and seizure freedom are among the most important outcome measures for patients with epilepsy. In this study, we aimed to automatically extract this clinical information from unstructured text in clinical notes. If successful, this could improve clinical decision-making in epilepsy patients and allow for rapid, large-scale retrospective research.Materials and methodsWe developed a finetuning pipeline for pretrained neural models to classify patients as being seizure-free and to extract text containing their seizure frequency and date of last seizure from clinical notes. We annotated 1000 notes for use as training and testing data and determined how well 3 pretrained neural models, BERT, RoBERTa, and Bio_ClinicalBERT, could identify and extract the desired information after finetuning.ResultsThe finetuned models (BERTFT, Bio_ClinicalBERTFT, and RoBERTaFT) achieved near-human performance when classifying patients as seizure free, with BERTFT and Bio_ClinicalBERTFT achieving accuracy scores over 80%. All 3 models also achieved human performance when extracting seizure frequency and date of last seizure, with overall F1 scores over 0.80. The best combination of models was Bio_ClinicalBERTFT for classification, and RoBERTaFT for text extraction. Most of the gains in performance due to finetuning required roughly 70 annotated notes.Discussion and conclusionOur novel machine reading approach to extracting important clinical outcomes performed at or near human performance on several tasks. This approach opens new possibilities to support clinical practice and conduct large-scale retrospective clinical research. Future studies can use our finetuning pipeline with minimal training annotations to answer new clinical questions.
| S-EPMC9006692 | biostudies-literature
Project description:ObjectivesHealth care organizations are increasingly employing social workers to address patients' social needs. However, social work (SW) activities in health care settings are largely captured as text data within electronic health records (EHRs), making measurement and analysis difficult. This study aims to extract and classify, from EHR notes, interventions intended to address patients' social needs using natural language processing (NLP) and machine learning (ML) algorithms.Study designSecondary data analysis of a longitudinal cohort.MethodsWe extracted 815 SW encounter notes from the EHR system of a federally qualified health center. We reviewed the literature to derive a 10-category classification scheme for SW interventions. We applied NLP and ML algorithms to categorize the documented SW interventions in EHR notes according to the 10-category classification scheme.ResultsMost of the SW notes (n = 598; 73.4%) contained at least 1 SW intervention. The most frequent interventions offered by social workers included care coordination (21.5%), education (21.0%), financial planning (18.5%), referral to community services and organizations (17.1%), and supportive counseling (15.3%). High-performing classification algorithms included the kernelized support vector machine (SVM) (accuracy, 0.97), logistic regression (accuracy, 0.96), linear SVM (accuracy, 0.95), and multinomial naive Bayes classifier (accuracy, 0.92).ConclusionsNLP and ML can be utilized for automated identification and classification of SW interventions documented in EHRs. Health care administrators can leverage this automated approach to gain better insight into the most needed social interventions in the patient population served by their organizations. Such information can be applied in managerial decisions related to SW staffing, resource allocation, and patients' social needs.
| S-EPMC8005360 | biostudies-literature
Project description:IntroductionAutomatically identifying specific phenotypes in free-text clinical notes is critically important for the reuse of clinical data. In this study, the authors combine expert-guided feature (text) selection with one-class classification for text processing.ObjectivesTo compare the performance of one-class classification to traditional binary classification; to evaluate the utility of feature selection based on expert-selected salient text (snippets); and to determine the robustness of these models with respects to irrelevant surrounding text.MethodsThe authors trained one-class support vector machines (1C-SVMs) and two-class SVMs (2C-SVMs) to identify notes discussing breast cancer. Manually annotated visit summary notes (88 positive and 88 negative for breast cancer) were used to compare the performance of models trained on whole notes labeled as positive or negative to models trained on expert-selected text sections (snippets) relevant to breast cancer status. Model performance was evaluated using a 70:30 split for 20 iterations and on a realistic dataset of 10 000 records with a breast cancer prevalence of 1.4%.ResultsWhen tested on a balanced experimental dataset, 1C-SVMs trained on snippets had comparable results to 2C-SVMs trained on whole notes (F = 0.92 for both approaches). When evaluated on a realistic imbalanced dataset, 1C-SVMs had a considerably superior performance (F = 0.61 vs. F = 0.17 for the best performing model) attributable mainly to improved precision (p = .88 vs. p = .09 for the best performing model).Conclusions1C-SVMs trained on expert-selected relevant text sections perform better than 2C-SVMs classifiers trained on either snippets or whole notes when applied to realistically imbalanced data with low prevalence of the positive class.
| S-EPMC4986669 | biostudies-literature
Project description:BackgroundThe medical problem list is an important part of the electronic medical record in development in our institution. To serve the functions it is designed for, the problem list has to be as accurate and timely as possible. However, the current problem list is usually incomplete and inaccurate, and is often totally unused. To alleviate this issue, we are building an environment where the problem list can be easily and effectively maintained.MethodsFor this project, 80 medical problems were selected for their frequency of use in our future clinical field of evaluation (cardiovascular). We have developed an Automated Problem List system composed of two main components: a background and a foreground application. The background application uses Natural Language Processing (NLP) to harvest potential problem list entries from the list of 80 targeted problems detected in the multiple free-text electronic documents available in our electronic medical record. These proposed medical problems drive the foreground application designed for management of the problem list. Within this application, the extracted problems are proposed to the physicians for addition to the official problem list.ResultsThe set of 80 targeted medical problems selected for this project covered about 5% of all possible diagnoses coded in ICD-9-CM in our study population (cardiovascular adult inpatients), but about 64% of all instances of these coded diagnoses. The system contains algorithms to detect first document sections, then sentences within these sections, and finally potential problems within the sentences. The initial evaluation of the section and sentence detection algorithms demonstrated a sensitivity and positive predictive value of 100% when detecting sections, and a sensitivity of 89% and a positive predictive value of 94% when detecting sentences.ConclusionThe global aim of our project is to automate the process of creating and maintaining a problem list for hospitalized patients and thereby help to guarantee the timeliness, accuracy and completeness of this information.
| S-EPMC1208893 | biostudies-literature
Project description:Background:The gut-selective nature of vedolizumab has raised questions regarding increased joint pain or arthralgia with its use in inflammatory bowel disease (IBD) patients. As arthralgias are seldom coded and thus difficult to study, few studies have examined the comparative risk of arthralgia between vedolizumab and tumor necrosis factor inhibitor (TNFi). Our objectives were to evaluate the application of natural language processing (NLP) to identify arthralgia in the clinical notes and to compare the risk of arthralgia between vedolizumab and TNFi in IBD. Methods:We performed a retrospective study using a validated electronic medical record (EMR)-based IBD cohort from 2 large tertiary care centers. The index date was the first date of vedolizumab or TNFi prescription. Baseline covariates were assessed 1 year before the index date; patients were followed 1 year after the index date. The primary outcome was arthralgia, defined using NLP. Using inverse probability of treatment weight to balance the cohorts, we then constructed Cox regression models to calculate the hazard ratio (HR) for arthralgia in the vedolizumab and TNFi groups. Results:We studied 367 IBD patients on vedolizumab and 1218 IBD patients on TNFi. Patients on vedolizumab were older (mean age, 41.2 vs 34.9 years) and had more prevalent use of immunomodulators (52.3% vs 31.9%) than TNFi users. Our data did not observe a significantly increased risk of arthralgia in the vedolizumab group compared with TNFi (HR, 1.20; 95% confidence interval, 0.97-1.49). Conclusions:In this large observational study, we did not find a significantly increased risk of arthralgia associated with vedolizumab use compared with TNFi.
| S-EPMC6140445 | biostudies-literature
Project description:Successful clinical trials offer better treatments to current or future patients and advance scientific research.1,2,3 Clinical trials define the target population using specific eligibility criteria to ensure an optimal enrollment sample.4 Clinical trial eligibility criteria are often described in unstructured free-text5 which makes automation of the recruitment process challenging. This contributes to the long-standing problem of insufficient enrollment of clinical trials.6,7 This study uses a machine learning approach to extract clinical trial eligibility criteria, and convert them into structured queryable formats using descriptive statistics based on medical entity frequency and binary entity relationships. We present a JSON-based structural representation of clinical trials eligibility criteria for clinical trials to follow.
| S-EPMC10148319 | biostudies-literature
Project description:AimsStress echocardiography (SE) findings and interpretations are commonly documented in free-text reports. Reusing SE results requires laborious manual reviews. This study aimed to develop and validate an automated method for abstracting SE reports in a large cohort.Methods and resultsThis study included adult patients who had SE within 30 days of their emergency department visit for suspected acute coronary syndrome in a large integrated healthcare system. An automated natural language processing (NLP) algorithm was developed to abstract SE reports and classify overall SE results into normal, non-diagnostic, infarction, and ischaemia categories. Randomly selected reports (n = 140) were double-blindly reviewed by cardiologists to perform criterion validity of the NLP algorithm. Construct validity was tested on the entire cohort using abstracted SE data and additional clinical variables. The NLP algorithm abstracted 6346 consecutive SE reports. Cardiologists had good agreements on the overall SE results on the 140 reports: Kappa (0.83) and intraclass correlation coefficient (0.89). The NLP algorithm achieved 98.6% specificity and negative predictive value, 95.7% sensitivity, positive predictive value, and F-score on the overall SE results and near-perfect scores on ischaemia findings. The 30-day acute myocardial infarction or death outcomes were highest among patients with ischaemia (5.0%), followed by infarction (1.4%), non-diagnostic (0.8%), and normal (0.3%) results. We found substantial variations in the format and quality of SE reports, even within the same institution.ConclusionsNatural language processing is an accurate and efficient method for abstracting unstructured SE reports. This approach creates new opportunities for research, public health measures, and care improvement.
| S-EPMC9779789 | biostudies-literature