Dataset Information

Computer Vision for Recognition of Materials and Vessels in Chemistry Lab Settings and the Vector-LabPics Data Set.

ABSTRACT: This work presents a machine learning approach for the computer vision-based recognition of materials inside vessels in the chemistry lab and other settings. In addition, we release a data set associated with the training of the model for further model development. The task to learn is finding the region, boundaries, and category for each material phase and vessel in an image. Handling materials inside mostly transparent containers is the main activity performed by human and robotic chemists in the laboratory. Visual recognition of vessels and their contents is essential for performing this task. Modern machine-vision methods learn recognition tasks by using data sets containing a large number of annotated images. This work presents the Vector-LabPics data set, which consists of 2187 images of materials within mostly transparent vessels in a chemistry lab and other general settings. The images are annotated for both the vessels and the individual material phases inside them, and each instance is assigned one or more classes (liquid, solid, foam, suspension, powder, ...). The fill level, labels, corks, and parts of the vessel are also annotated. Several convolutional nets for semantic and instance segmentation were trained on this data set. The trained neural networks achieved good accuracy in detecting and segmenting vessels and material phases, and in classifying liquids and solids, but relatively low accuracy in segmenting multiphase systems such as phase-separating liquids.

SUBMITTER: Eppel S

PROVIDER: S-EPMC7596871 | biostudies-literature | 2020 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Computer Vision for Recognition of Materials and Vessels in Chemistry Lab Settings and the Vector-LabPics Data Set.

Eppel Sagi S Xu Haoping H Bismuth Mor M Aspuru-Guzik Alan A

ACS central science 20200910 10

This work presents a machine learning approach for the computer vision-based recognition of materials inside vessels in the chemistry lab and other settings. In addition, we release a data set associated with the training of the model for further model development. The task to learn is finding the region, boundaries, and category for each material phase and vessel in an image. Handling materials inside mostly transparent containers is the main activity performed by human and robotic chemists in ...[more]

PMID: 33145411

Similar Datasets

Project description:ObjectiveVideo recording and video recognition (VR) with computer vision have become widely used in many aspects of modern life. Hospitals have employed VR technology for security purposes, however, despite the growing number of studies showing the feasibility of VR software for physiologic monitoring or detection of patient movement, its use in the intensive care unit (ICU) in real-time is sparse and the perception of this novel technology is unknown. The objective of this study is to understand the attitudes of providers, patients, and patient's families toward using VR in the ICU.DesignA 10-question survey instrument was used and distributed into two groups of participants: clinicians (MDs, advance practice providers, registered nurses), patients and families (adult patients and patients' relatives). Questions were specifically worded and section for free text-comments created to elicit respondents' thoughts and attitudes on potential issues and barriers toward implementation of VR in the ICU.SettingThe survey was conducted at Mayo Clinic in Minnesota and Florida.ResultsA total of 233 clinicians' and 50 patients' surveys were collected. Both cohorts favored VR under specific circumstances (e.g., invasive intervention and diagnostic manipulation). Acceptable reasons for VR usage according to clinicians were anticipated positive impact on patient safety (70%), and diagnostic suggestions and decision support (51%). A minority of providers was concerned that artificial intelligence (AI) would replace their job (14%) or erode professional skills (28%). The potential use of VR in lawsuits (81% clinicians) and privacy breaches (59% patients) were major areas of concern. Further identified barriers were lack of trust for AI, deterioration of the patient-clinician rapport. Patients agreed with VR unless it does not reduce nursing care or record sensitive scenarios.ConclusionThe survey provides valuable information on the acceptance of VR cameras in the critical care setting including an overview of real concerns and attitudes toward the use of VR technology in the ICU.

Project description:Extracting meaning from a dynamic and variable flow of incoming information is a major goal of both natural and artificial intelligence. Computer vision (CV) guided by deep learning (DL) has made significant strides in recognizing a specific identity despite highly variable attributes. This is the same challenge faced by the nervous system and partially addressed by the concept cells-neurons exhibiting selective firing in response to specific persons/places, described in the human medial temporal lobe (MTL) ⁠. Yet, access to neurons representing a particular concept is limited due to these neurons' sparse coding. It is conceivable, however, that the information required for such decoding is present in relatively small neuronal populations. To evaluate how well neuronal populations encode identity information in natural settings, we recorded neuronal activity from multiple brain regions of nine neurosurgical epilepsy patients implanted with depth electrodes, while the subjects watched an episode of the TV series "24". First, we devised a minimally supervised CV algorithm (with comparable performance against manually-labeled data) to detect the most prevalent characters (above 1% overall appearance) in each frame. Next, we implemented DL models that used the time-varying population neural data as inputs and decoded the visual presence of the four main characters throughout the episode. This methodology allowed us to compare "computer vision" with "neuronal vision"-footprints associated with each character present in the activity of a subset of neurons-and identify the brain regions that contributed to this decoding process. We then tested the DL models during a recognition memory task following movie viewing where subjects were asked to recognize clip segments from the presented episode. DL model activations were not only modulated by the presence of the corresponding characters but also by participants' subjective memory of whether they had seen the clip segment, and by the associative strengths of the characters in the narrative plot. The described approach can offer novel ways to probe the representation of concepts in time-evolving dynamic behavioral tasks. Further, the results suggest that the information required to robustly decode concepts is present in the population activity of only tens of neurons even in brain regions beyond MTL.

Dataset Information

Computer Vision for Recognition of Materials and Vessels in Chemistry Lab Settings and the Vector-LabPics Data Set.

Publications

Computer Vision for Recognition of Materials and Vessels in Chemistry Lab Settings and the Vector-LabPics Data Set.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets