Dataset Information

Automatic food detection in egocentric images using artificial intelligence technology.

ABSTRACT:

Objective

To develop an artificial intelligence (AI)-based algorithm which can automatically detect food items from images acquired by an egocentric wearable camera for dietary assessment.

Design

To study human diet and lifestyle, large sets of egocentric images were acquired using a wearable device, called eButton, from free-living individuals. Three thousand nine hundred images containing real-world activities, which formed eButton data set 1, were manually selected from thirty subjects. eButton data set 2 contained 29 515 images acquired from a research participant in a week-long unrestricted recording. They included both food- and non-food-related real-life activities, such as dining at both home and restaurants, cooking, shopping, gardening, housekeeping chores, taking classes, gym exercise, etc. All images in these data sets were classified as food/non-food images based on their tags generated by a convolutional neural network.

Results

A cross data-set test was conducted on eButton data set 1. The overall accuracy of food detection was 91·5 and 86·4 %, respectively, when one-half of data set 1 was used for training and the other half for testing. For eButton data set 2, 74·0 % sensitivity and 87·0 % specificity were obtained if both 'food' and 'drink' were considered as food images. Alternatively, if only 'food' items were considered, the sensitivity and specificity reached 85·0 and 85·8 %, respectively.

Conclusions

The AI technology can automatically detect foods from low-quality, wearable camera-acquired real-world egocentric images with reasonable accuracy, reducing both the burden of data processing and privacy concerns.

SUBMITTER: Jia W

PROVIDER: S-EPMC8114337 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ObjectiveThis study aimed to validate a deep learning-based fully automatic calcium scoring (coronary artery calcium [CAC]_auto) system using previously published cardiac computed tomography (CT) cohort data with the manually segmented coronary calcium scoring (CAC_hand) system as the reference standard.Materials and methodsWe developed the CAC_auto system using 100 co-registered, non-enhanced and contrast-enhanced CT scans. For the validation of the CAC_auto system, three previously published CT cohorts (n = 2985) were chosen to represent different clinical scenarios (i.e., 2647 asymptomatic, 220 symptomatic, 118 valve disease) and four CT models. The performance of the CAC_auto system in detecting coronary calcium was determined. The reliability of the system in measuring the Agatston score as compared with CAC_hand was also evaluated per vessel and per patient using intraclass correlation coefficients (ICCs) and Bland-Altman analysis. The agreement between CAC_auto and CAC_hand based on the cardiovascular risk stratification categories (Agatston score: 0, 1-10, 11-100, 101-400, > 400) was evaluated.ResultsIn 2985 patients, 6218 coronary calcium lesions were identified using CAC_hand. The per-lesion sensitivity and false-positive rate of the CAC_auto system in detecting coronary calcium were 93.3% (5800 of 6218) and 0.11 false-positive lesions per patient, respectively. The CAC_auto system, in measuring the Agatston score, yielded ICCs of 0.99 for all the vessels (left main 0.91, left anterior descending 0.99, left circumflex 0.96, right coronary 0.99). The limits of agreement between CAC_auto and CAC_hand were 1.6 ± 52.2. The linearly weighted kappa value for the Agatston score categorization was 0.94. The main causes of false-positive results were image noise (29.1%, 97/333 lesions), aortic wall calcification (25.5%, 85/333 lesions), and pericardial calcification (24.3%, 81/333 lesions).ConclusionThe atlas-based CAC_auto empowered by deep learning provided accurate calcium score measurement as compared with manual method and risk category classification, which could potentially streamline CAC imaging workflows.

Project description:BackgroundParkinson's disease (PD) is the second most common neurodegenerative disease. An objective diagnosis method is urgently needed in clinical practice. In this study, deep learning and radiomics techniques were studied to automatically diagnose PD from healthy controls (HCs).Methods155 PD patients and 154 HCs were randomly divided into a training set (246 patients) and a testing set (63 patients). The brain subregions identification and segmentation were automatically performed with a VB-net, and radiomics features of billateral thalamus, caudatum, putamen and pallidum were extracted. Five independent machine learning classifiers [Support Vector Machine (SVM), Stochastic gradient descent (SGD), random forest (RF), quadratic discriminant analysis (QDA) and decision tree (DT)] were trained on the training set, and validated on the testing. Delong test was used to compare the performance of different models.ResultsOur VB-net could automatically identify and segment the brain into 109 regions. 2,264 radiomics features were automatically extracted from the billateral thalamus, caudatum, putamen or pallidum of each patient. After four step of features dimensionality reduction, Delong tests showed that the SVM model based on combined features had the best performance, with AUCs of 0.988 (95% CI: 0.979 ~ 0.998, specificity = 91.1%, sensitivity =100%, accuracy = 89.4% and precision = 88.2%) and 0.976 (95% CI: 0.942 ~ 1.000, specificity = 100%, sensitivity = 87.1%, accuracy = 93.5% and precision = 88.6%) in the training set and testing set, respectively. Decision curve analysis showed that the clinical benefit of the line graph model was high.ConclusionThe SVM model based on combined features could be used to diagnose PD with high accuracy. Our fully automatic model could rapidly process the MRI data and distinguish PD and HCs in one minute. It greatly improved the diagnostic efficiency and has a great potential value in clinical practice to help the early diagnosis of PD.