Dataset Information

Detection and annotation of plant organs from digitised herbarium scans using deep learning.

ABSTRACT: As herbarium specimens are increasingly becoming digitised and accessible in online repositories, advanced computer vision techniques are being used to extract information from them. The presence of certain plant organs on herbarium sheets is useful information in various scientific contexts and automatic recognition of these organs will help mobilise such information. In our study, we use deep learning to detect plant organs on digitised herbarium specimens with Faster R-CNN. For our experiment, we manually annotated hundreds of herbarium scans with thousands of bounding boxes for six types of plant organs and used them for training and evaluating the plant organ detection model. The model worked particularly well on leaves and stems, while flowers were also present in large numbers in the sheets, but were not equally well recognised.

SUBMITTER: Younis S

PROVIDER: S-EPMC7746675 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Detection and annotation of plant organs from digitised herbarium scans using deep learning.

Younis Sohaib S Schmidt Marco M Weiland Claus C Dressler Stefan S Seeger Bernhard B Hickler Thomas T

Biodiversity data journal 20201210

As herbarium specimens are increasingly becoming digitised and accessible in online repositories, advanced computer vision techniques are being used to extract information from them. The presence of certain plant organs on herbarium sheets is useful information in various scientific contexts and automatic recognition of these organs will help mobilise such information. In our study, we use deep learning to detect plant organs on digitised herbarium specimens with Faster R-CNN. For our experiment ...[more]

PMID: 33343217

Similar Datasets

Project description:The COVID-19 pandemic has caused a worldwide catastrophe and widespread devastation that reeled almost all countries. The pandemic has mounted pressure on the existing healthcare system and caused panic and desperation. The gold testing standard for COVID-19 detection, reverse transcription-polymerase chain reaction (RT-PCR), has shown its limitations with 70% accuracy, contributing to the incorrect diagnosis that exaggerated the complexities and increased the fatalities. The new variations further pose unseen challenges in terms of their diagnosis and subsequent treatment. The COVID-19 virus heavily impacts the lungs and fills the air sacs with fluid causing pneumonia. Thus, chest X-ray inspection is a viable option if the inspection detects COVID-19-induced pneumonia, hence confirming the exposure of COVID-19. Artificial intelligence and machine learning techniques are capable of examining chest X-rays in order to detect patterns that can confirm the presence of COVID-19-induced pneumonia. This research used CNN and deep learning techniques to detect COVID-19-induced pneumonia from chest X-rays. Transfer learning with fine-tuning ensures that the proposed work successfully classifies COVID-19-induced pneumonia, regular pneumonia, and normal conditions. Xception, Visual Geometry Group 16, and Visual Geometry Group 19 are used to realize transfer learning. The experimental results were promising in terms of precision, recall, F1 score, specificity, false omission rate, false negative rate, false positive rate, and false discovery rate with a COVID-19-induced pneumonia detection accuracy of 98%. Experimental results also revealed that the proposed work has not only correctly identified COVID-19 exposure but also made a distinction between COVID-19-induced pneumonia and regular pneumonia, as the latter is a very common disease, while COVID-19 is more lethal. These results mitigated the concern and overlap in the diagnosis of COVID-19-induced pneumonia and regular pneumonia. With further integrations, it can be employed as a potential standard model in differentiating the various lung-related infections, including COVID-19.

Project description:The highly rapid spread of the current pandemic has quickly overwhelmed hospitals all over the world and motivated extensive research to address a wide range of emerging problems. The unforeseen influx of COVID-19 patients to hospitals has made it inevitable to deploy a rapid and accurate triage system, monitor progression, and predict patients at higher risk of deterioration in order to make informed decisions regarding hospital resource management. Disease detection in radiographic scans, severity estimation, and progression and prognosis prediction have been extensively studied with the help of end-to-end methods based on deep learning. The majority of recent works have utilized a single scan to determine severity or predict progression of the disease. In this paper, we present a method based on deep sequence learning to predict improvement or deterioration in successive chest X-ray scans and build a mathematical model to determine individual patient disease progression profile using successive scans. A deep convolutional neural network pretrained on a diverse lung disease dataset was used as a feature extractor to generate the sequences. We devised three strategies for sequence modeling in order to obtain both fine-grained and coarse-grained features and construct sequences of different lengths. We also devised a strategy to quantify positive or negative change in successive scans, which was then combined with age-related risk factors to construct disease progression profile for COVID-19 patients. The age-related risk factors allowed us to model rapid deterioration and slower recovery in older patients. Experiments conducted on two large datasets showed that the proposed method could accurately predict disease progression. With the best feature extractor, the proposed method was able to achieve AUC of 0.98 with the features obtained from radiographs. Furthermore, the proposed patient profiling method accurately estimated the health profile of patients.

Project description:BackgroundMorphological leaf traits are frequently used to quantify, understand and predict plant and vegetation functional diversity and ecology, including environmental and climate change responses. Although morphological leaf traits are easy to measure, their coverage for characterising variation within species and across temporal scales is limited. At the same time, there are about 3100 herbaria worldwide, containing approximately 390 million plant specimens dating from the 16th to 21st century, which can potentially be used to extract morphological leaf traits. Globally, plant specimens are rapidly being digitised and images are made openly available via various biodiversity data platforms, such as iDigBio and GBIF. Based on a pilot study to identify the availability and appropriateness of herbarium specimen images for comprehensive trait data extraction, we developed a spatio-temporal dataset on intraspecific trait variability containing 128,036 morphological leaf trait measurements for seven selected species.New informationAfter scrutinising the metadata of digitised herbarium specimen images available from iDigBio and GBIF (21.9 million and 31.6 million images for Tracheophyta; accessed date December 2020), we identified approximately 10 million images potentially appropriate for our study. From the 10 million images, we selected seven species (Salix bebbiana Sarg., Alnus incana (L.) Moench, Viola canina L., Salix glauca L., Chenopodium album L., Impatiens capensis Meerb. and Solanum dulcamara L.) , which have a simple leaf shape, are well represented in space and time and have high availability of specimens per species. We downloaded 17,383 images. Out of these, we discarded 5779 images due to quality issues. We used the remaining 11,604 images to measure the area, length, width and perimeter on 32,009 individual leaf blades using the semi-automated tool TraitEx. The resulting dataset contains 128,036 trait records.We demonstrate its comparability to trait data measured in natural environments following standard protocols by comparing trait values from the TRY database. We conclude that the herbarium specimens provide valuable information on leaf sizes. The dataset created in our study, by extracting leaf traits from the digitised herbarium specimen images of seven selected species, is a promising opportunity to improve ecological knowledge about the adaptation of size-related leaf traits to environmental changes in space and time.

Dataset Information

Detection and annotation of plant organs from digitised herbarium scans using deep learning.

Publications

Detection and annotation of plant organs from digitised herbarium scans using deep learning.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets