Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

An efficient hierarchical video coding scheme combining visual perception characteristics.

ABSTRACT: Different visual perception characteristic saliencies are the key to constitute the low-complexity video coding framework. A hierarchical video coding scheme based on human visual systems (HVS) is proposed in this paper. The proposed scheme uses a joint video coding framework consisting of visual perception analysis layer (VPAL) and video coding layer (VCL). In VPAL, effective visual perception characteristics detection algorithm is proposed to achieve visual region of interest (VROI) based on the correlation between coding information (such as motion vector, prediction mode, etc.) and visual attention. Then, the interest priority setting for VROI according to visual perception characteristics is completed. In VCL, the optional encoding method is developed utilizing the visual interested priority setting results from VPAL. As a result, the proposed scheme achieves information reuse and complementary between visual perception analysis and video coding. Experimental results show that the proposed hierarchical video coding scheme effectively alleviates the contradiction between complexity and accuracy. Compared with H.264/AVC (JM17.0), the proposed scheme reduces 80% video coding time approximately and maintains a good video image quality as well. It improves video coding performance significantly.

SUBMITTER: Liu P

PROVIDER: S-EPMC4052983 | biostudies-other | 2014

REPOSITORIES: biostudies-other

ACCESS DATA

Json Xml

Similar Datasets

Spatio-Temporally Efficient Coding Assigns Functions to Hierarchical Structures of the Visual System.

Project description:Hierarchical structures constitute a wide array of brain areas, including the visual system. One of the important questions regarding visual hierarchical structures is to identify computational principles for assigning functions that represent the external world to hierarchical structures of the visual system. Given that visual hierarchical structures contain both bottom-up and top-down pathways, the derived principles should encompass these bidirectional pathways. However, existing principles such as predictive coding do not provide an effective principle for bidirectional pathways. Therefore, we propose a novel computational principle for visual hierarchical structures as spatio-temporally efficient coding underscored by the efficient use of given resources in both neural activity space and processing time. This coding principle optimises bidirectional information transmissions over hierarchical structures by simultaneously minimising temporal differences in neural responses and maximising entropy in neural representations. Simulations demonstrated that the proposed spatio-temporally efficient coding was able to assign the function of appropriate neural representations of natural visual scenes to visual hierarchical structures. Furthermore, spatio-temporally efficient coding was able to predict well-known phenomena, including deviations in neural responses to unlearned inputs and bias in preferred orientations. Our proposed spatio-temporally efficient coding may facilitate deeper mechanistic understanding of the computational processes of hierarchical brain structures.

| S-EPMC9184804 | biostudies-literature

Hierarchical structure is employed by humans during visual motion perception.

Project description:In the real world, complex dynamic scenes often arise from the composition of simpler parts. The visual system exploits this structure by hierarchically decomposing dynamic scenes: When we see a person walking on a train or an animal running in a herd, we recognize the individual's movement as nested within a reference frame that is, itself, moving. Despite its ubiquity, surprisingly little is understood about the computations underlying hierarchical motion perception. To address this gap, we developed a class of stimuli that grant tight control over statistical relations among object velocities in dynamic scenes. We first demonstrate that structured motion stimuli benefit human multiple object tracking performance. Computational analysis revealed that the performance gain is best explained by human participants making use of motion relations during tracking. A second experiment, using a motion prediction task, reinforced this conclusion and provided fine-grained information about how the visual system flexibly exploits motion structure.

| S-EPMC7533882 | biostudies-literature

Cortical entrainment to hierarchical contextual rhythms recomposes dynamic attending in visual perception.

Project description:Temporal regularity is ubiquitous and essential to guiding attention and coordinating behavior within a dynamic environment. Previous researchers have modeled attention as an internal rhythm that may entrain to first-order regularity from rhythmic events to prioritize information selection at specific time points. Using the attentional blink paradigm, here we show that higher-order regularity based on rhythmic organization of contextual features (pitch, color, or motion) may serve as a temporal frame to recompose the dynamic profile of visual temporal attention. Critically, such attentional reframing effect is well predicted by cortical entrainment to the higher-order contextual structure at the delta band as well as its coupling with the stimulus-driven alpha power. These results suggest that the human brain involuntarily exploits multiscale regularities in rhythmic contexts to recompose dynamic attending in visual perception, and highlight neural entrainment as a central mechanism for optimizing our conscious experience of the world in the time dimension.

| S-EPMC8177885 | biostudies-literature

TMS-induced blinking assessed with high-speed video: optical disruption of visual perception.

Project description:It is known that TMS can induce blinking, but it is unknown to what extent and at what time TMS-induced blinking can cover the pupil. We applied single-pulse TMS with a leftward and rightward monophasic current through a round coil over the occipital pole in 8 healthy subjects, using high-speed video to monitor left or right eye with a spatial resolution of 0.1 mm and a temporal resolution of 2 ms. We plotted eyelid position relative to upper and lower pupil borders as a function of time after TMS for each subject and current direction. We found 2 blinks in every subject, an isolated late blink with one current direction and a superimposed early and late blink with the other current direction, in accordance with our previously reported association between a leftward and rightward lower coil rim current and an early blink in right and left eye, respectively. Blink extent varied, but 4 subjects showed total pupil covering with both current directions. Blink timing varied, but pupil covering was initiated as early as 32 ms after TMS and pupil uncovering was completed as late as 200 ms after TMS. We found no saccades. We conclude that TMS can cause an important optical disruption of visual perception.

| S-EPMC7334885 | biostudies-literature

Hierarchical Novelty-Familiarity Representation in the Visual System by Modular Predictive Coding.

Project description:Predictive coding has been previously introduced as a hierarchical coding framework for the visual system. At each level, activity predicted by the higher level is dynamically subtracted from the input, while the difference in activity continuously propagates further. Here we introduce modular predictive coding as a feedforward hierarchy of prediction modules without back-projections from higher to lower levels. Within each level, recurrent dynamics optimally segregates the input into novelty and familiarity components. Although the anatomical feedforward connectivity passes through the novelty-representing neurons, it is nevertheless the familiarity information which is propagated to higher levels. This modularity results in a twofold advantage compared to the original predictive coding scheme: the familiarity-novelty representation forms quickly, and at each level the full representational power is exploited for an optimized readout. As we show, natural images are successfully compressed and can be reconstructed by the familiarity neurons at each level. Missing information on different spatial scales is identified by novelty neurons and complements the familiarity representation. Furthermore, by virtue of the recurrent connectivity within each level, non-classical receptive field properties still emerge. Hence, modular predictive coding is a biologically realistic metaphor for the visual system that dynamically extracts novelty at various scales while propagating the familiarity information.

| S-EPMC4682867 | biostudies-literature

DOWNREGULATION OF SPLICING REGULATOR RBFOX1 COMPROMISES VISUAL DEPTH PERCEPTION

Project description:Rbfox1 is a splicing regulator that has been associated with various neurological conditions such as autism spectrum disorder, mental retardation, epilepsy, attention-deficit/hyperactivity disorder, and schizophrenia. We show that in adult rodent retinas, Rbfox1 is expressed in all types of retinal ganglion cells (RGCs) as well as in certain subsets of amacrine cells (ACs) within the inner nuclear and ganglion cell layers. In developing retinas, Rbfox1 can be detected as early as E12. At that age, Rbfox1 is localized in the cytoplasm of differentiated RGCs. Between P0 and P5, strong expression of Rbfox1 in the inner plexiform layer was observed. This coincided with switching of Rbfox1 localization in RGC somas from cytoplasmic to a predominantly nuclear. Dynamic changes in Rbfox1 expression during first 10 postnatal days are correlated with the stage II spontaneous retinal waves of excitation, which in mice begins around the time of birth and continues for as long as two weeks. By P10, dendritic staining of Rbfox1 was dramatically reduced and remained so in the fully developed retina. In Rbfox1 knockout (KO) animals no detectable changes in retinal gross morphology were observed two months after Rbfox1 downregulation. However, the visual cliff test revealed marked abnormalities of depth perception of these animals. Retinal transcriptome analysis of Rbfox1 KO mice identified a number of genes that are involved in establishing neural circuits and synaptic transmission, including Vamp1, Vamp2, Snap25, Trak2, and Slc1A7, suggesting a role of Rbfox1 in the regulation of genes that facilitate AC and RGC synaptic communication.

2018-07-19 | GSE105084 | GEO

Temporal decorrelation by SK channels enables efficient neural coding and perception of natural stimuli.

Project description:It is commonly assumed that neural systems efficiently process natural sensory input. However, the mechanisms by which such efficient processing is achieved, and the consequences for perception and behaviour remain poorly understood. Here we show that small conductance calcium-activated potassium (SK) channels enable efficient neural processing and perception of natural stimuli. Specifically, these channels allow for the high-pass filtering of sensory input, thereby removing temporal correlations or, equivalently, whitening frequency response power. Varying the degree of adaptation through pharmacological manipulation of SK channels reduced efficiency of coding of natural stimuli, which in turn gave rise to predictable changes in behavioural responses that were no longer matched to natural stimulus statistics. Our results thus demonstrate a novel mechanism by which the nervous system can implement efficient processing and perception of natural sensory input that is likely to be shared across systems and species.

| S-EPMC4837484 | biostudies-literature

Green Visual Sensor of Plant: An Energy-Efficient Compressive Video Sensing in the Internet of Things.

Project description:Internet of Things (IoT) realizes the real-time video monitoring of plant propagation or growth in the wild. However, the monitoring time is seriously limited by the battery capacity of the visual sensor, which poses a challenge to the long-working plant monitoring. Video coding is the most consuming component in a visual sensor, it is important to design an energy-efficient video codec in order to extend the time of monitoring plants. This article presents an energy-efficient Compressive Video Sensing (CVS) system to make the visual sensor green. We fuse a context-based allocation into CVS to improve the reconstruction quality with fewer computations. Especially, considering the practicality of CVS, we extract the contexts of video frames from compressive measurements but not from original pixels. Adapting to these contexts, more measurements are allocated to capture the complex structures but fewer to the simple structures. This adaptive allocation enables the low-complexity recovery algorithm to produce high-quality reconstructed video sequences. Experimental results show that by deploying the proposed context-based CVS system on the visual sensor, the rate-distortion performance is significantly improved when comparing it with some state-of-the-art methods, and the computational complexity is also reduced, resulting in a low energy consumption.

| S-EPMC8918948 | biostudies-literature

A neural coding scheme reproducing foraging trajectories.

Project description:The movement of many animals may follow Lévy patterns. The underlying generating neuronal dynamics of such a behavior is unknown. In this paper we show that a novel discovery of multifractality in winnerless competition (WLC) systems reveals a potential encoding mechanism that is translatable into two dimensional superdiffusive Lévy movements. The validity of our approach is tested on a conductance based neuronal model showing WLC and through the extraction of Lévy flights inducing fractals from recordings of rat hippocampus during open field foraging. Further insights are gained analyzing mice motor cortex neurons and non motor cell signals. The proposed mechanism provides a plausible explanation for the neuro-dynamical fundamentals of spatial searching patterns observed in animals (including humans) and illustrates an until now unknown way to encode information in neuronal temporal series.

| S-EPMC4673616 | biostudies-literature

Hierarchical motion perception as causal inference.

Project description:Since motion can only be defined relative to a reference frame, which reference frame guides perception? A century of psychophysical studies has produced conflicting evidence: retinotopic, egocentric, world-centric, or even object-centric. We introduce a hierarchical Bayesian model mapping retinal velocities to perceived velocities. Our model mirrors the structure in the world, in which visual elements move within causally connected reference frames. Friction renders velocities in these reference frames mostly stationary, formalized by an additional delta component (at zero) in the prior. Inverting this model automatically segments visual inputs into groups, groups into supergroups, etc. and "perceives" motion in the appropriate reference frame. Critical model predictions are supported by two new experiments, and fitting our model to the data allows us to infer the subjective set of reference frames used by individual observers. Our model provides a quantitative normative justification for key Gestalt principles providing inspiration for building better models of visual processing in general.

| S-EPMC10680834 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data