Dataset Information

Predicting 3D body shape and body composition from conventional 2D photography.

ABSTRACT:

Purpose

Total and regional body composition are important indicators of health and mortality risk, but their measurement is usually restricted to controlled environments in clinical settings with expensive and specialized equipment. A method that approaches the accuracy of the current gold standard method, dual-energy x-ray absorptiometry (DXA), while only requiring input from widely available consumer grade equipment, would enable the measurement of these important biometrics in the wild, enabling data collection at a scale that would have previously been prohibitive in time and expense. We describe an algorithm for predicting three-dimensional (3D) body shape and composition from a single frontal 2-dimensional image acquired with a digital consumer camera.

Methods

Duplicate 3D optical scans, two-dimensional (2D) optical images, and DXA whole-body scans were available for 183 men and 233 women from the Shape Up! Adults Study. A principal component analysis vector basis was fit to 3D point clouds of a training subset of 152 men and 194 women. The relationship between this vector space and DXA-derived body composition was modeled with linear regression. The principal component 3D shape was then fitted to match a silhouette extracted from a 2D photograph of a novel body. Body composition was predicted from the resulting 3D shape match using the linear mapping between the principal component parameters and the DXA metrics. Accuracy of body composition estimates from the silhouette method was evaluated against a simple model using height and weight as a baseline, and against DXA measurements as ground truth. Test-retest precision of the silhouette method was evaluated using the duplicate 2D optical images and compared against precision of the duplicate DXA scans. Paired t-tests were performed to detect significant differences between the sets.

Results

Results were reported on a held-out set. Body composition prediction achieved R² s of 0.81 and 0.74 for percent fat prediction of males and females, respectively, on a held-out test set consisting of 31 males and 39 females. Precision estimates for fat mass were 2.31% and 2.06% for males and females, respectively, compared to 1.26% and 0.68% for DXA scans. The t-tests revealed no statistically significant differences between the silhouette method measurements and DXA measurements, or between retests.

Conclusion

Total and regional body composition measures can be estimated from a single frontal photograph of a human body. Body composition prediction using consumer level photography can enable early screening and monitoring of possible physiological indicators of metabolic disease in regions where medical imagery or clinical assessment is inaccessible.

SUBMITTER: Tian IY

PROVIDER: S-EPMC7796893 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundMany predictors of morbidity caused by metabolic disease are associated with body shape. 3D optical (3DO) scanning captures body shape and has been shown to accurately and precisely predict body composition variables associated with mortality risk. 3DO is safer, less expensive, and more accessible than criterion body composition assessment methods such as dual-energy X-ray absorptiometry (DXA). However, 3DO scanning has not been standardized across manufacturers for pose, mesh resolution, and post processing methods.PurposeWe introduce a scanner-agnostic algorithm that automatically fits a topologically consistent human mesh to 3DO scanned point clouds and predicts clinically important body metrics using a standardized body shape model. Our models transform raw scans captured by any 3DO scanner into fixed topology meshes with anatomical consistency, standardizing the outputs of 3DO scans across manufacturers and allowing for the use of common prediction models across scanning devices.MethodsA fixed-topology body mesh template was automatically registered to 848 training scans from three different 3DO systems. Participants were between 18 and 89 years old with body mass index ranging from 14 to 52 kg/m2 . Scans were registered by first performing a coarse nearest neighbor alignment between the template and the input scan with an anatomically constrained principal component analysis (PCA) domain deformation using a device and gender specific bootstrap basis trained on 70 seed scans each. The template mesh was then optimized to fit the target with a smooth per-vertex surface-to-surface deformation. A combined unified PCA model was created from the superset of all automatically fit training scans including all three devices. Body composition predictions to DXA measurements were learned from the training mesh PCA coefficients using linear regression. Using this final unified model, we tested the accuracy of our body composition models on a withheld sample of 562 scans by fitting a PCA parameterized template mesh to each raw scan and predicting the expected body composition metrics from the principal components using the learned regression model.ResultsWe achieved coefficients of determination (R2 ) above 0.8 on all nine fat and lean predictions except female visceral fat (0.77). R2 was as high as 0.94 (total fat and lean, trunk fat), and all root-mean-squared errors were below 3.0 kg. All predicted body composition variables were not significantly different from reference DXA measurements except for visceral fat and female trunk fat. Repeatability precision as measured by the coefficient of variation (%CV) was around 2-3x worse than DXA precision, with visceral fat %CV below 2x DXA %CV and female total fat mass at 5x.ConclusionsOur method provides an accurate, automated, and scanner agnostic framework for standardizing 3DO scans and a low cost, radiation-free alternative to criterion radiology imaging for body composition analysis. We published a web-app version of this work at https://shapeup.shepherdresearchlab.org/3do-bodycomp-analyzer/ that accepts mesh file uploads and returns templated meshes with body composition predictions for demo purposes.

Project description:Background: Mutant BRAF targeted therapies remain a standard of care for the treatment of metastatic malignant melanoma (MM); however high initial response rates are tempered by the persistence of residual MM cells that eventually lead to disease recurrence and mortality. Since MM recurrence during targeted therapy can present with the simultaneous occurrence of multiple tumour nodules at the original body sites, we hypothesised the presence of an intrinsically resistant MM cell sub-population. Objectives: Identify an MM cell subpopulation that is intrinsically resistant to targeted therapy and so may be responsible for MM recurrence. Methods: Using melanoma cell lines, we define culture conditions for reproducible 3D growth of melanospheres to investigate putative cancer stem cell populations. We undertook RNA sequencing and bioinformatic analysis to characterise cell populations between adherent and non-adherent culture, and cells expressing or not expressing CD20. Furthermore, we define an in vitro assay to evaluate killing of melanoma cancer stem cells as a therapeutic test using combination therapies targeting driver mutation and CD20 marker. Results: We have described culture conditions that promote MM cells to form melanospheres with a reproducible colony forming efficiency of 0.3% to 1.3%. RNA sequencing of melanosphere versus conventional MM cell cultures (n=6), irrespective of the BRAF mutation status, showed that melanosphere formation was associated with growth and differentiation transcriptional signatures resembling MM tumours. Importantly, melanosphere formation also led to the emergence of a CD20+ MM cell subpopulation, similar to that observed in primary human MM tumours. CD20+ MM cells were resistant to BRAF inhibitor therapy, and consistent with this finding demonstrated a Forkhead box protein M1 (FOXM1) transcriptomic profile (n=6). Combining BRAF inhibitor and anti-CD20 antibody treatment led to the additional killing of previously resistant CD20+ BRAF mutant MM cells. Conclusions: In MM patients that harbour a CD20+ sub-population, combined therapy with BRAF inhibitor and anti-CD20 antibody could potentially kill residual MM cells and so prevent disease recurrence.

Project description:Evidence acquisition, interpretation and preservation are essential parts of forensic case work that make a standardized documentation process fundamental. The most commonly used method for the documentation and interpretation of superficial wounds is a combination of two modalities: two-dimensional (2D) photography for evidence preservation and real-life examination for wound analysis. As technologies continue to develop, 2D photography is being enhanced with three-dimensional (3D) documentation technology. In our study, we compared the real-life examination of superficial wounds using four different technical documentation and visualization methods.To test the different methods, a mannequin was equipped with several injury stickers, and then the different methods were applied. A total of 42 artificial injury stickers were documented in regard to orientation, form, color, size, wound borders, wound corners and suspected mechanism of injury for the injury mechanism. As the gold standard, superficial wounds were visually examined by two board-certified forensic pathologists directly on the mannequin. These results were compared to an examination using standard 2D forensic photography; 2D photography using the multicamera system Botscan©, which included predefined viewing positions all around the body; and 3D photogrammetric reconstruction based on images visualized both on screen and in a virtual reality (VR) using a head-mounted display (HMD).The results of the gold standard examination showed that the two forensic pathologists had an inter-reader agreement ranging from 69% for the orientation and 11% for the size of the wounds. A substantial portion of the direct visual documentation showed only a partial overlap, especially for the items of size and color, thereby prohibiting the statistical comparison of these two items. A forest plot analysis of the remaining six items showed no significant difference between the methods. We found that among the forensic pathologists, there was high variability regarding the vocabulary used for the description of wound morphology, which complicated the exact comparison of the two documentations of the same wound.There were no significant differences for any of the four methods compared to the gold standard, thereby challenging the role of real-life examination and 2D photography as the most reliable documentation approaches. Further studies with real injuries are necessary to support our evaluation that technical examination methods involving multicamera systems and 3D visualization for whole-body examination might be a valid alternative in future forensic documentation.

Project description:BackgroundThree-dimensional optical (3DO) body scanning has been proposed for automatic anthropometry. However, conventional measurements fail to capture detailed body shape. More sophisticated shape features could better indicate health status.ObjectivesThe objectives were to predict DXA total and regional body composition, serum lipid and diabetes markers, and functional strength from 3DO body scans using statistical shape modeling.MethodsHealthy adults underwent whole-body 3DO and DXA scans, blood tests, and strength assessments in the Shape Up! Adults cross-sectional observational study. Principal component analysis was performed on registered 3DO scans. Stepwise linear regressions were performed to estimate body composition, serum biomarkers, and strength using 3DO principal components (PCs). 3DO model accuracy was compared with simple anthropometric models and precision was compared with DXA.ResultsThis analysis included 407 subjects. Eleven PCs for each sex captured 95% of body shape variance. 3DO body composition accuracy to DXA was: fat mass R2 = 0.88 male, 0.93 female; visceral fat mass R2 = 0.67 male, 0.75 female. 3DO body fat test-retest precision was: root mean squared error = 0.81 kg male, 0.66 kg female. 3DO visceral fat was as precise (%CV = 7.4 for males, 6.8 for females) as DXA (%CV = 6.8 for males, 7.4 for females). Multiple 3DO PCs were significantly correlated with serum HDL cholesterol, triglycerides, glucose, insulin, and HOMA-IR, independent of simple anthropometrics. 3DO PCs improved prediction of isometric knee strength (combined model R2 = 0.67 male, 0.59 female; anthropometrics-only model R2 = 0.34 male, 0.24 female).Conclusions3DO body shape PCs predict body composition with good accuracy and precision comparable to existing methods. 3DO PCs improve prediction of serum lipid and diabetes markers, and functional strength measurements. The safety and accessibility of 3DO scanning make it appropriate for monitoring individual body composition, and metabolic health and functional strength in epidemiological settings.This trial was registered at clinicaltrials.gov as NCT03637855.