Unknown

Dataset Information

0

ChemPix: automated recognition of hand-drawn hydrocarbon structures using deep learning.


ABSTRACT: Inputting molecules into chemistry software, such as quantum chemistry packages, currently requires domain expertise, expensive software and/or cumbersome procedures. Leveraging recent breakthroughs in machine learning, we develop ChemPix: an offline, hand-drawn hydrocarbon structure recognition tool designed to remove these barriers. A neural image captioning approach consisting of a convolutional neural network (CNN) encoder and a long short-term memory (LSTM) decoder learned a mapping from photographs of hand-drawn hydrocarbon structures to machine-readable SMILES representations. We generated a large auxiliary training dataset, based on RDKit molecular images, by combining image augmentation, image degradation and background addition. Additionally, a small dataset of ∼600 hand-drawn hydrocarbon chemical structures was crowd-sourced using a phone web application. These datasets were used to train the image-to-SMILES neural network with the goal of maximizing the hand-drawn hydrocarbon recognition accuracy. By forming a committee of the trained neural networks where each network casts one vote for the predicted molecule, we achieved a nearly 10 percentage point improvement of the molecule recognition accuracy and were able to assign a confidence value for the prediction based on the number of agreeing votes. The ensemble model achieved an accuracy of 76% on hand-drawn hydrocarbons, increasing to 86% if the top 3 predictions were considered.

SUBMITTER: Weir H 

PROVIDER: S-EPMC8365825 | biostudies-literature |

REPOSITORIES: biostudies-literature

Similar Datasets

| S-EPMC8604928 | biostudies-literature
| S-EPMC6050314 | biostudies-literature
| S-EPMC6322765 | biostudies-literature
| S-EPMC8303427 | biostudies-literature
| S-EPMC8556392 | biostudies-literature
| S-EPMC7441407 | biostudies-literature
| S-EPMC9249740 | biostudies-literature
| S-EPMC8082409 | biostudies-literature
| S-EPMC8292460 | biostudies-literature
| S-EPMC8596988 | biostudies-literature