MBR-SIFT: A mirror reflected invariant feature descriptor using a binary representation for image matching.
Ontology highlight
ABSTRACT:
SUBMITTER: Su M
PROVIDER: S-EPMC5436860 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:The choice of an optimal feature detector-descriptor combination for image matching often depends on the application and the image type. In this paper, we propose the Log-Polar Magnitude feature descriptor-a rotation, scale, and illumination invariant descriptor that achieves comparable performance to SIFT on a large variety of image registration problems but with much shorter feature vectors. The descriptor is based on the Log-Polar Transform followed by a Fourier Transform and selection of the magnitude spectrum components. Selecting different frequency components allows optimizing for image patterns specific for a particular application. In addition, by relying only on coordinates of the found features and (optionally) feature sizes our descriptor is completely detector independent. We propose 48- or 56-long feature vectors that potentially can be shortened even further depending on the application. Shorter feature vectors result in better memory usage and faster matching. This combined with the fact that the descriptor does not require a time-consuming feature orientation estimation (the rotation invariance is achieved solely by using the magnitude spectrum of the Log-Polar Transform) makes it particularly attractive to applications with limited hardware capacity. Evaluation is performed on the standard Oxford dataset and two different microscopy datasets; one with fluorescence and one with transmission electron microscopy images. Our method performs better than SURF and comparable to SIFT on the Oxford dataset, and better than SIFT on both microscopy datasets indicating that it is particularly useful in applications with microscopy images.
| S-EPMC5708636 | biostudies-literature
Project description:The goal of visual place recognition (VPR) is to determine the location of a query image by identifying its place in a collection of image databases. Visual sensor technologies are crucial for visual place recognition as they allow for precise identification and location of query images within a database. Global descriptor-based VPR methods face the challenge of accurately capturing the local specific regions within a scene; consequently, it leads to an increasing probability of confusion during localization in such scenarios. To tackle feature extraction and feature matching challenges in VPR, we propose a modified patch-NetVLAD strategy that includes two new modules: a context-aware patch descriptor and a context-aware patch matching mechanism. Firstly, we propose a context-driven patch feature descriptor to overcome the limitations of global and local descriptors in visual place recognition. This descriptor aggregates features from each patch's surrounding neighborhood. Secondly, we introduce a context-driven feature matching mechanism that utilizes cluster and saliency context-driven weighting rules to assign higher weights to patches that are less similar to densely populated or locally similar regions for improved localization performance. We further incorporate both of these modules into the patch-NetVLAD framework, resulting in a new approach called contextual patch-NetVLAD. Experimental results are provided to show that our proposed approach outperforms other state-of-the-art methods to achieve a Recall@10 score of 99.82 on Pittsburgh30k, 99.82 on FMDataset, and 97.68 on our benchmark dataset.
| S-EPMC10857504 | biostudies-literature
Project description:An invariant feature matching method is proposed as a spatially invariant feature matching approach. Deformation effects, such as affine and homography, change the local information within the image and can result in ambiguous local information pertaining to image points. New method based on dissimilarity values, which measures the dissimilarity of the features through the path based on Eigenvector properties, is proposed. Evidence shows that existing matching techniques using similarity metrics--such as normalized cross-correlation, squared sum of intensity differences and correlation coefficient--are insufficient for achieving adequate results under different image deformations. Thus, new descriptor's similarity metrics based on normalized Eigenvector correlation and signal directional differences, which are robust under local variation of the image information, are proposed to establish an efficient feature matching technique. The method proposed in this study measures the dissimilarity in the signal frequency along the path between two features. Moreover, these dissimilarity values are accumulated in a 2D dissimilarity space, allowing accurate corresponding features to be extracted based on the cumulative space using a voting strategy. This method can be used in image registration applications, as it overcomes the limitations of the existing approaches. The output results demonstrate that the proposed technique outperforms the other methods when evaluated using a standard dataset, in terms of precision-recall and corner correspondence.
| S-EPMC4795769 | biostudies-literature
Project description:Aim. To develop a new invariant descriptor for the characterization of protein surfaces, suitable for various analysis tasks, such as protein functional classification, and search and retrieval of protein surfaces over a large database. Methods. We start with a local descriptor of selected circular patches on the protein surface. The descriptor records the distance distribution between the central residue and the residues within the patch, keeping track of the number of particular pairwise residue cooccurrences in the patch. A global descriptor for the entire protein surface is then constructed by combining information from the local descriptors. Our method is novel in its focus on residue-specific distance distributions, and the use of residue-distance co-occurrences as the basis for the proposed protein surface descriptors. Results. Results are presented for protein classification and for retrieval for three protein families. For the three families, we obtained an area under the curve for precision and recall ranging from 0.6494 (without residue co-occurrences) to 0.6683 (with residue co-occurrences). Large-scale screening using two other protein families placed related family members at the top of the rank, with a number of uncharacterized proteins also retrieved. Comparative results with other proposed methods are included.
| S-EPMC3227456 | biostudies-literature
Project description:Here we explore the possibility that a core function of sensory cortex is the generation of an internal simulation of sensory environment in real-time. A logical elaboration of this idea leads to a dynamical neural architecture that oscillates between two fundamental network states, one driven by external input, and the other by recurrent synaptic drive in the absence of sensory input. Synaptic strength is modified by a proposed synaptic state matching (SSM) process that ensures equivalence of spike statistics between the two network states. Remarkably, SSM, operating locally at individual synapses, generates accurate and stable network-level predictive internal representations, enabling pattern completion and unsupervised feature detection from noisy sensory input. SSM is a biologically plausible substrate for learning and memory because it brings together sequence learning, feature detection, synaptic homeostasis, and network oscillations under a single unifying computational framework.
| S-EPMC3753233 | biostudies-literature
Project description:We present an Algorithm to understand Inter-pixel similarity, which shall be observed in images with the help of a data structure Full Binary Tree. The Full Binary Tree has certain properties like every node must have 2 children or none. Based on this property of Binary Tree, the method of Sliced Binary Pattern is proposed. The inter-pixel similarity may be observed by converting any pixel information of an image within a block of size 3 × 3 to its binarized form, as the pixel information, whose similarity with neighboring pixel cannot be exploited, when it is in decimal form. Thus, we convert all pixel information within a block of size 3 × 3 to its binarized form then we compare the binary pattern of a central pixel with its 8-nearest neighbors. If there is a binary pattern match between central pixel and its 8-nearest neighbors of a block, we assign weights to it, where the weights are determined by the position of match that exist between central pixel and 8-other neighboring pixels of an image. This process helps in determining the inter-pixel similarity of 8-nearest neighbors with respect to central pixel of a block. Every block of 3 × 3 pixels is processed with this strategy to obtain the similarity between patterns in an image. The erected Weighted Full Binary Tree-Sliced Binary Pattern analyzes an image in RGB-Dimensions based on patterns of Inter-Pixel Similarity by tracing the similarity path. The proposed RGB-D texture based inter-pixel similarity addresses the verification of facial similarity. Further, the proposed WFBT-SBP has yielded a good classification accuracy of 77.4%, 77.3%, 77.98%, and 77.94% over a relations of F-S, F-D, M-S, M-D of KinfaceW-I and 76.89%, 76.72%, 77.01%, 76.99% over a relations of F-S, F-D, M-S, and M-D of KinfaceW-II respectively.
| S-EPMC7218272 | biostudies-literature
Project description:Categorical sensory representations are critical for many behaviors, including speech perception. In the auditory system, categorical information is thought to arise hierarchically, becoming increasingly prominent in higher-order cortical regions. The neural mechanisms that support this robust and flexible computation remain poorly understood. Here, we studied sound representations in the ferret primary and non-primary auditory cortex while animals engaged in a challenging sound discrimination task. Population-level decoding of simultaneously recorded single neurons revealed that task engagement caused categorical sound representations to emerge in non-primary auditory cortex. In primary auditory cortex, task engagement caused a general enhancement of sound decoding that was not specific to task-relevant categories. These findings are consistent with mixed selectivity models of neural disentanglement, in which early sensory regions build an overcomplete representation of the world and allow neurons in downstream brain regions to flexibly and selectively read out behaviorally relevant, categorical information.
| S-EPMC11341091 | biostudies-literature
Project description:The utilization of scale invariant feature transform algorithm in synthetic-aperture radar images (SAR-SIFT) to match image features may lead to principal orientation assignments of descriptors being affected by speckle noise, thereby diminishing accuracy. In this study, we propose using the Fourier histogram of oriented ratio gradient (Fourier HORG) descriptor for robust matching of SAR images. This method is based on the SAR-SIFT algorithm framework. During feature description, the rotation-invariant Fourier HORG descriptor is established by performing Fourier analysis on the ratio gradient in the polar coordinate system, whereby the principal orientation assignment process is avoided and the robustness of SAR image registration improved. A matching experiment was conducted involving four sets of SAR image pairs, and the results demonstrated that our method exhibited higher accuracy and robustness compared to image matching based on the Fourier histogram of oriented gradient (Fourier HOG) descriptor and the SAR-SIFT algorithm, thus confirming the effectiveness of our proposed method.
| S-EPMC10477315 | biostudies-literature
Project description:Identity comparisons of photographs of unfamiliar faces are prone to error but important for applied settings, such as person identification at passport control. Finding techniques to improve face-matching accuracy is therefore an important contemporary research topic. This study investigated whether matching accuracy can be improved by instruction to attend to specific facial features. Experiment 1 showed that instruction to attend to the eyebrows enhanced matching accuracy for optimized same-day same-race face pairs but not for other-race faces. By contrast, accuracy was unaffected by instruction to attend to the eyes, and declined with instruction to attend to ears. Experiment 2 replicated the eyebrow-instruction improvement with a different set of same-race faces, comprising both optimized same-day and more challenging different-day face pairs. These findings suggest that instruction to attend to specific features can enhance face-matching accuracy, but feature selection is crucial and generalization across face sets may be limited.
| S-EPMC5854257 | biostudies-literature
Project description:Image registration of remotely sensed imagery is challenging, as complex deformations are common. Different deformations, such as affine and homogenous transformation, combined with multimodal data capturing can emerge in the data acquisition process. These effects, when combined, tend to compromise the performance of the currently available registration methods. A new image transform, known as geometric mean projection transform, is introduced in this work. As it is deformation invariant, it can be employed as a feature descriptor, whereby it analyzes the functions of all vertical and horizontal signals in local areas of the image. Moreover, an invariant feature correspondence method is proposed as a point matching algorithm, which incorporates new descriptor's dissimilarity metric. Considering the image as a signal, the proposed approach utilizes a square Eigenvector correlation (SEC) based on the Eigenvector properties. In our experiments on standard test images sourced from "Featurespace" and "IKONOS" datasets, the proposed method achieved higher average accuracy relative to that obtained from other state of the art image registration techniques. The accuracy of the proposed method was assessed using six standard evaluation metrics. Furthermore, statistical analyses, including t-test and Friedman test, demonstrate that the method developed as a part of this study is superior to the existing methods.
| S-EPMC6067644 | biostudies-literature