Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Efficient Retrieval of Massive Ocean Remote Sensing Images via a Cloud-Based Mean-Shift Algorithm.

ABSTRACT: The rapid development of remote sensing (RS) technology has resulted in the proliferation of high-resolution images. There are challenges involved in not only storing large volumes of RS images but also in rapidly retrieving the images for ocean disaster analysis such as for storm surges and typhoon warnings. In this paper, we present an efficient retrieval of massive ocean RS images via a Cloud-based mean-shift algorithm. Distributed construction method via the pyramid model is proposed based on the maximum hierarchical layer algorithm and used to realize efficient storage structure of RS images on the Cloud platform. We achieve high-performance processing of massive RS images in the Hadoop system. Based on the pyramid Hadoop distributed file system (HDFS) storage method, an improved mean-shift algorithm for RS image retrieval is presented by fusion with the canopy algorithm via Hadoop MapReduce programming. The results show that the new method can achieve better performance for data storage than HDFS alone and WebGIS-based HDFS. Speedup and scaleup are very close to linear changes with an increase of RS images, which proves that image retrieval using our method is efficient.

SUBMITTER: Yang M

PROVIDER: S-EPMC5539728 | biostudies-other | 2017 Jul

REPOSITORIES: biostudies-other

ACCESS DATA

Json Xml

Similar Datasets

A mean shift algorithm for drift correction in localization microscopy.

Project description:Single-molecule localization microscopy techniques transcend the diffraction limit of visible light by localizing isolated emitters sampled stochastically. This time-lapse imaging necessitates long acquisition times, over which sample drift can become large relative to the localization precision. Here, we present an efficient and robust method for estimating drift, using a simple peak-finding algorithm based on mean shifts that is effective for single-molecule localization microscopy in two or three dimensions.

| S-EPMC8978553 | biostudies-literature

Global Optimal Structured Embedding Learning for Remote Sensing Image Retrieval.

Project description:A rich line of works focus on designing elegant loss functions under the deep metric learning (DML) paradigm to learn a discriminative embedding space for remote sensing image retrieval (RSIR). Essentially, such embedding space could efficiently distinguish deep feature descriptors. So far, most existing losses used in RSIR are based on triplets, which have disadvantages of local optimization, slow convergence and insufficient use of similarity structure in a mini-batch. In this paper, we present a novel DML method named as global optimal structured loss to deal with the limitation of triplet loss. To be specific, we use a softmax function rather than a hinge function in our novel loss to realize global optimization. In addition, we present a novel optimal structured loss, which globally learn an efficient deep embedding space with mined informative sample pairs to force the positive pairs within a limitation and push the negative ones far away from a given boundary. We have conducted extensive experiments on four public remote sensing datasets and the results show that the proposed global optimal structured loss with pairs mining scheme achieves the state-of-the-art performance compared with the baselines.

| S-EPMC6983082 | biostudies-literature

Detection of plane in remote sensing images using super-resolution.

Project description:The object detection of remote sensing image often has low accuracy and high missed or false detection rate due to the large number of small objects, instance level noise and cloud occlusion. In this paper, a new object detection model based on SRGAN and YOLOV3 is proposed, which is called SR-YOLO. It solves the problems of SRGAN network sensitivity to hyper-parameters and modal collapse. Meanwhile, The FPN network in YOLOv3 is replaced by PANet, shortened the distance between the lowest and the highest layers, and the SR-YOLO model has strong robustness and high detection ability by using the enhanced path to enrich the characteristics of each layer. The experimental results on the UCAS-High Resolution Aerial Object Detection Dataset showed SR-YOLO has achieved excellent performance. Compared with YOLOv3, the average precision (AP) of SR-YOLO increased from 92.35% to 96.13%, the log-average miss rate (MR-2) decreased from 22% to 14%, and the Recall rate increased from 91.36% to 95.12%.

| S-EPMC9022876 | biostudies-literature

A Novel Method to Predict Genomic Islands Based on Mean Shift Clustering Algorithm.

Project description:Genomic Islands (GIs) are regions of bacterial genomes that are acquired from other organisms by the phenomenon of horizontal transfer. These regions are often responsible for many important acquired adaptations of the bacteria, with great impact on their evolution and behavior. Nevertheless, these adaptations are usually associated with pathogenicity, antibiotic resistance, degradation and metabolism. Identification of such regions is of medical and industrial interest. For this reason, different approaches for genomic islands prediction have been proposed. However, none of them are capable of predicting precisely the complete repertory of GIs in a genome. The difficulties arise due to the changes in performance of different algorithms in the face of the variety of nucleotide distribution in different species. In this paper, we present a novel method to predict GIs that is built upon mean shift clustering algorithm. It does not require any information regarding the number of clusters, and the bandwidth parameter is automatically calculated based on a heuristic approach. The method was implemented in a new user-friendly tool named MSGIP--Mean Shift Genomic Island Predictor. Genomes of bacteria with GIs discussed in other papers were used to evaluate the proposed method. The application of this tool revealed the same GIs predicted by other methods and also different novel unpredicted islands. A detailed investigation of the different features related to typical GI elements inserted in these new regions confirmed its effectiveness. Stand-alone and user-friendly versions for this new methodology are available at http://msgip.integrativebioinformatics.me.

| S-EPMC4711805 | biostudies-literature

Linear convergence of the subspace constrained mean shift algorithm: from Euclidean to directional data.

Project description:This paper studies the linear convergence of the subspace constrained mean shift (SCMS) algorithm, a well-known algorithm for identifying a density ridge defined by a kernel density estimator. By arguing that the SCMS algorithm is a special variant of a subspace constrained gradient ascent (SCGA) algorithm with an adaptive step size, we derive the linear convergence of such SCGA algorithm. While the existing research focuses mainly on density ridges in the Euclidean space, we generalize density ridges and the SCMS algorithm to directional data. In particular, we establish the stability theorem of density ridges with directional data and prove the linear convergence of our proposed directional SCMS algorithm.

| S-EPMC9893762 | biostudies-literature

Class incremental learning of remote sensing images based on class similarity distillation.

Project description:When a well-trained model learns a new class, the data distribution differences between the new and old classes inevitably cause catastrophic forgetting in order to perform better in the new class. This behavior differs from human learning. In this article, we propose a class incremental object detection method for remote sensing images to address the problem of catastrophic forgetting caused by distribution differences among different classes. First, we introduce a class similarity distillation (CSD) loss based on the similarity between new and old class prototypes, ensuring the model's plasticity to learn new classes and stability to detect old classes. Second, to better extract class similarity features, we propose a global similarity distillation (GSD) loss that maximizes the mutual information between the new class feature and old class features. Additionally, we present a region proposal network (RPN)-based method that assigns positive and negative labels to prevent mislearning issues. Experiments demonstrate that our method is more accurate for class incremental learning on public DOTA and DIOR datasets and significantly improves training efficiency compared to state-of-the-art class incremental object detection methods.

| S-EPMC10557500 | biostudies-literature

A new simple concept for ocean colour remote sensing using parallel polarisation radiance.

Project description:Ocean colour remote sensing has supported research on subjects ranging from marine ecosystems to climate change for almost 35 years. However, as the framework for ocean colour remote sensing is based on the radiation intensity at the top-of-atmosphere (TOA), the polarisation of the radiation, which contains additional information on atmospheric and water optical properties, has largely been neglected. In this study, we propose a new simple concept to ocean colour remote sensing that uses parallel polarisation radiance (PPR) instead of the traditional radiation intensity. We use vector radiative transfer simulation and polarimetric satellite sensing data to demonstrate that using PPR has two significant advantages in that it effectively diminishes the sun glint contamination and enhances the ocean colour signal at the TOA. This concept may open new doors for ocean colour remote sensing. We suggest that the next generation of ocean colour sensors should measure PPR to enhance observational capability.

| S-EPMC3894553 | biostudies-literature

How Can Phytoplankton Pigments Be Best Used to Characterize Surface Ocean Phytoplankton Groups for Ocean Color Remote Sensing Algorithms?

Project description:High-performance liquid chromatography (HPLC) remains one of the most widely applied methods for estimation of phytoplankton community structure from ocean samples, which are used to create and validate satellite retrievals of phytoplankton community structure. HPLC measures the concentrations of phytoplankton pigments, some of which are useful chemotaxonomic markers for phytoplankton groups. Here, consistent suites of HPLC phytoplankton pigments measured on global surface water samples are compiled across spatial scales. The global dataset includes >4,000 samples from every major ocean basin and representing a wide range of ecological regimes. The local dataset is composed of six time series from long-term observatory sites. These samples are used to quantify the potential and limitations of HPLC for understanding surface ocean phytoplankton groups. Hierarchical cluster and empirical orthogonal function analyses are used to examine the associations between and among groups of phytoplankton pigments and to diagnose the main controls on these associations. These methods identify four major groups of phytoplankton on global scales (cyanobacteria, diatoms/dinoflagellates, haptophytes, and green algae) that can be identified by diagnostic biomarker pigments. On local scales, the same methods identify more and different taxonomic groups of phytoplankton than are detectable in the global dataset. Notably, diatom and dinoflagellate pigments group together on global scales, but dinoflagellate marker pigments always separate from diatoms on local scales. Together, these results confirm that HPLC pigments can be used for satellite algorithm quantification of no more than four phytoplankton groups on global scales, but can provide higher resolution for local-scale algorithm development and validation.

| S-EPMC7043335 | biostudies-literature

Surface ocean microbiota determine cloud precursors.

Project description:One pathway by which the oceans influence climate is via the emission of sea spray that may subsequently influence cloud properties. Sea spray emissions are known to be dependent on atmospheric and oceanic physicochemical parameters, but the potential role of ocean biology on sea spray fluxes remains poorly characterized. Here we show a consistent significant relationship between seawater nanophytoplankton cell abundances and sea-spray derived Cloud Condensation Nuclei (CCN) number fluxes, generated using water from three different oceanic regions. This sensitivity of CCN number fluxes to ocean biology is currently unaccounted for in climate models yet our measurements indicate that it influences fluxes by more than one order of magnitude over the range of phytoplankton investigated.

| S-EPMC7801489 | biostudies-literature

A method for extracting small water bodies based on DEM and remote sensing images.

Project description:Accurate and comprehensive extraction of water bodies facilitates the study of watershed changes and water quality monitoring and also provides a reference for ecological evolution. When extracting tributaries and small water bodies based on remote sensing images, there are problems such as uncertain threshold selection, more edge voids, and extraction difficulties. The improved water body extraction method (Combination Normalized Difference Water Index), fuses Digital Elevation Model and remote sensing images. The river network is extracted from the Digital Elevation Model and the remote sensing image is normalized. After fusion, threshold comparison is performed, and the threshold of the river network location is used as the basis for connecting the broken water bodies, it is compared and verified with the normalized thresholds to achieve accurate identification and complete extraction of water bodies. Taking the water bodies in Xinyang City as an example, the overall accuracy of the confusion matrix was the highest, with an overall accuracy of 93.0% compared with the traditional index method. Combined with water bodies in Zhengzhou City for model validation, it has high applicability. Whether the water body is large or small, the extraction results are complete, with no voids or broken, and the accuracy is high.

| S-EPMC10774334 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data