Dataset Information

Fuji-SfM dataset: A collection of annotated images and point clouds for Fuji apple detection and location using structure-from-motion photogrammetry.

ABSTRACT: The present dataset contains colour images acquired in a commercial Fuji apple orchard (Malus domestica Borkh. cv. Fuji) to reconstruct the 3D model of 11 trees by using structure-from-motion (SfM) photogrammetry. The data provided in this article is related to the research article entitled "Fruit detection and 3D location using instance segmentation neural networks and structure-from-motion photogrammetry" [1]. The Fuji-SfM dataset includes: (1) a set of 288 colour images and the corresponding annotations (apples segmentation masks) for training instance segmentation neural networks such as Mask-RCNN; (2) a set of 582 images defining a motion sequence of the scene which was used to generate the 3D model of 11 Fuji apple trees containing 1455 apples by using SfM; (3) the 3D point cloud of the scanned scene with the corresponding apple positions ground truth in global coordinates. With that, this is the first dataset for fruit detection containing images acquired in a motion sequence to build the 3D model of the scanned trees with SfM and including the corresponding 2D and 3D apple location annotations. This data allows the development, training, and test of fruit detection algorithms either based on RGB images, on coloured point clouds or on the combination of both types of data.

SUBMITTER: Gene-Mola J

PROVIDER: S-EPMC7184157 | biostudies-literature | 2020 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Fuji-SfM dataset: A collection of annotated images and point clouds for Fuji apple detection and location using structure-from-motion photogrammetry.

Gené-Mola Jordi J Sanz-Cortiella Ricardo R Rosell-Polo Joan R JR Morros Josep-Ramon JR Ruiz-Hidalgo Javier J Vilaplana Verónica V Gregorio Eduard E

Data in brief 20200421

The present dataset contains colour images acquired in a commercial Fuji apple orchard (<i>Malus domestica</i> Borkh. cv. Fuji) to reconstruct the 3D model of 11 trees by using structure-from-motion (SfM) photogrammetry. The data provided in this article is related to the research article entitled "Fruit detection and 3D location using instance segmentation neural networks and structure-from-motion photogrammetry" [1]. The Fuji-SfM dataset includes: (1) a set of 288 colour images and the corresp ...[more]

PMID: 32368602

Similar Datasets

Project description:Image-based modeling, and more precisely, Structure from Motion (SfM) and Multi-View Stereo (MVS), is emerging as a flexible, self-service, remote sensing tool for generating fine-grained digital surface models (DSMs) in the Earth sciences and ecology. However, drone-based SfM + MVS applications have developed at a rapid pace over the past decade and there are now many software options available for data processing. Consequently, understanding of reproducibility issues caused by variations in software choice and their influence on data quality is relatively poorly understood. This understanding is crucial for the development of SfM + MVS if it is to fulfill a role as a new quantitative remote sensing tool to inform management frameworks and species conservation schemes. To address this knowledge gap, a lightweight multirotor drone carrying a Ricoh GR II consumer-grade camera was used to capture replicate, centimeter-resolution image datasets of a temperate, intensively managed grassland ecosystem. These data allowed the exploration of method reproducibility and the impact of SfM + MVS software choice on derived vegetation canopy height measurement accuracy. The quality of DSM height measurements derived from four different, yet widely used SfM-MVS software-Photoscan, Pix4D, 3DFlow Zephyr, and MICMAC, was compared with in situ data captured on the same day as image capture. We used both traditional agronomic techniques for measuring sward height, and a high accuracy and precision differential GPS survey to generate independent measurements of the underlying ground surface elevation. Using the same replicate image dataset (n = 3) as input, we demonstrate that there are 1.7, 2.0, and 2.5 cm differences in RMSE (excluding one outlier) between the outputs from different SfM + MVS software using High, Medium, and Low quality settings, respectively. Furthermore, we show that there can be a significant difference, although of small overall magnitude between replicate image datasets (n = 3) processed using the same SfM + MVS software, following the same workflow, with a variance in RMSE of up to 1.3, 1.5, and 2.7 cm (excluding one outlier) for "High," "Medium," and "Low" quality settings, respectively. We conclude that SfM + MVS software choice does matter, although the differences between products processed using "High" and "Medium" quality settings are of small overall magnitude.

Project description:Annual trunk increments are essential for short-term analyses of the response of trees to various factors. For instance, based on annual trunk increments, it is possible to develop and calibrate forest growth models. We investigated the possibility of estimating annual trunk increments from the terrestrial structure from motion (SfM) photogrammetry. Obtaining the annual trunk increments of mature trees is challenging due to the relatively small growth of trunks within one year. In our experiment, annual trunk increments were obtained by two conventional methods: measuring tape (perimeter increment) at heights of 0.8, 1.3, and 1.8 m on the trunk and increment borer (diameter increment) at a height of 1.3 m on the trunk. The following tree species were investigated: Fagus sylvatica L. (beech), Quercus petraea (Matt.) Liebl. (oak), Picea abies (L.) H. Karst (spruce), and Abies alba Mill (fir). The annual trunk increments ranged from 0.9 cm to 2.4 cm (tape/perimeter) and from 0.7 mm to 3.1 mm (borer/diameter). The data were collected before- and after-vegetation season, besides the data collection increment borer. When the estimated perimeters from the terrestrial SfM photogrammetry were compared to those obtained using the measuring tape, the root mean square error (RMSE) was 0.25-1.33 cm. The relative RMSE did not exceed 1% for all tree species. No statistically significant differences were found between the annual trunk increments obtained using the measuring tape and terrestrial SfM photogrammetry for beech, spruce, and fir. Only in the case of oak, the difference was statistically significant. Furthermore, the correlation coefficient between the annual trunk increments collected using the increment borer and those derived from terrestrial SfM photogrammetry was positive and equal to 0.6501. Terrestrial SfM photogrammetry is a hardware low-demanding technique that provides accurate three-dimensional data that can, based on our results, even detect small temporal tree trunk changes.

Dataset Information

Fuji-SfM dataset: A collection of annotated images and point clouds for Fuji apple detection and location using structure-from-motion photogrammetry.

Publications

Fuji-SfM dataset: A collection of annotated images and point clouds for Fuji apple detection and location using structure-from-motion photogrammetry.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets