Dataset Information

Insights into few shot learning approaches for image scene classification.

ABSTRACT: Image understanding and scene classification are keystone tasks in computer vision. The development of technologies and profusion of existing datasets open a wide room for improvement in the image classification and recognition research area. Notwithstanding the optimal performance of exiting machine learning models in image understanding and scene classification, there are still obstacles to overcome. All models are data-dependent that can only classify samples close to the training set. Moreover, these models require large data for training and learning. The first problem is solved by few-shot learning, which achieves optimal performance in object detection and classification but with a lack of eligible attention in the scene classification task. Motivated by these findings, in this paper, we introduce two models for few-shot learning in scene classification. In order to trace the behavior of those models, we also introduce two datasets (MiniSun; MiniPlaces) for image scene classification. Experimental results show that the proposed models outperform the benchmark approaches in respect of classification accuracy.

SUBMITTER: Soudy M

PROVIDER: S-EPMC8459776 | biostudies-literature | 2021

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Insights into few shot learning approaches for image scene classification.

Soudy Mohamed M Afify Yasmine Y Badr Nagwa N

PeerJ. Computer science 20210920

Image understanding and scene classification are keystone tasks in computer vision. The development of technologies and profusion of existing datasets open a wide room for improvement in the image classification and recognition research area. Notwithstanding the optimal performance of exiting machine learning models in image understanding and scene classification, there are still obstacles to overcome. All models are data-dependent that can only classify samples close to the training set. Moreov ...[more]

PMID: 34616882

Similar Datasets

Project description:Diabetes foot ulcer (DFU) is one of the common complications of diabetes patients, which may lead to infection, necrosis and even amputation. Therefore, early diagnosis, classification of severity and related treatment are crucial for the patients. Current DFU classification methods often require experienced doctors to manually classify the severity, which is time-consuming and low accuracy. The objective of the study is to propose a few-shot DFU image classification method based on deep residual neural network and transfer learning. Considering the difficulty in obtaining clinical DFU images, it is a few-shot problem. Therefore, the methods include: (1) Data augmentation of the original DFU images by using geometric transformations and random noise; (2) Deep ResNet models selection based on different convolutional layers comparative experiments; (3) DFU classification model training with transfer learning by using the selected pre-trained ResNet model and fine tuning. To verify the proposed classification method, the experiments were performed with the original and augmented datasets by separating three classifications: zero grade, mild grade, severe grade. (1) The datasets were augmented from the original 146 to 3000 image datasets and the corresponding DFU classification's average accuracy from 0.9167 to 0.9867; (2) Comparative experiments were conducted with ResNet18, ResNet34, ResNet50, ResNet101, ResNet152 by using 3000 image datasets, and the average accuracy/loss is 0.9325/0.2927, 0.9276/0.3234, 0.9901/0.1356, 0.9865/0.1427, 0.9790/0.1583 respectively; (3) Based on the augmented 3000 image datasets, it was achieved 0.9867 average accuracy with the DFU classification model, which was trained by the pre-trained ResNet50 and hyper-parameters. The experimental results indicated that the proposed few-shot DFU image classification method based on deep ResNet and transfer learning got very high accuracy, and it is expected to be suitable for low-cost and low-computational terminal equipment, aiming at helping clinical DFU classification efficiently and auxiliary diagnosis.

Project description:Cryo-electron tomography (Cryo-ET) is an emerging technology for three-dimensional (3D) visualization of macromolecular structures in the near-native state. To recover structures of macromolecules, millions of diverse macromolecules captured in tomograms should be accurately classified into structurally homogeneous subsets. Although existing supervised deep learning-based methods have improved classification accuracy, such trained models have limited ability to classify novel macromolecules that are unseen in the training stage. To adapt the trained model to the macromolecule classification of a novel class, massive labeled macromolecules of the novel class are needed. However, data labeling is very time-consuming and labor-intensive. In this work, we propose a novel few-shot learning method for the classification of novel macromolecules (named FSCC). A two-stage training strategy is designed in FSCC to enhance the generalization ability of the model to novel macromolecules. First, FSCC uses contrastive learning to pre-train the model on a sufficient number of labeled macromolecules. Second, FSCC uses distribution calibration to re-train the classifier, enabling the model to classify macromolecules of novel classes (unseen class in the pre-training). Distribution calibration transfers learned knowledge in the pre-training stage to novel macromolecules with limited labeled macromolecules of novel class. Experiments were performed on both synthetic and real datasets. On the synthetic datasets, compared with the state-of-the-art (SOTA) method based on supervised deep learning, FSCC achieves competitive performance. To achieve such performance, FSCC only needs five labeled macromolecules per novel class. However, the SOTA method needs 1100 ∼ 1500 labeled macromolecules per novel class. On the real datasets, FSCC improves the accuracy by 5% ∼ 16% when compared to the baseline model. These demonstrate good generalization ability of contrastive learning and calibration distribution to classify novel macromolecules with very few labeled macromolecules.

Dataset Information

Insights into few shot learning approaches for image scene classification.

Publications

Insights into few shot learning approaches for image scene classification.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets