Dataset Information

The HTM Spatial Pooler-A Neocortical Algorithm for Online Sparse Distributed Coding.

ABSTRACT: Hierarchical temporal memory (HTM) provides a theoretical framework that models several key computational principles of the neocortex. In this paper, we analyze an important component of HTM, the HTM spatial pooler (SP). The SP models how neurons learn feedforward connections and form efficient representations of the input. It converts arbitrary binary input patterns into sparse distributed representations (SDRs) using a combination of competitive Hebbian learning rules and homeostatic excitability control. We describe a number of key properties of the SP, including fast adaptation to changing input statistics, improved noise robustness through learning, efficient use of cells, and robustness to cell death. In order to quantify these properties we develop a set of metrics that can be directly computed from the SP outputs. We show how the properties are met using these metrics and targeted artificial simulations. We then demonstrate the value of the SP in a complete end-to-end real-world HTM system. We discuss the relationship with neuroscience and previous studies of sparse coding. The HTM spatial pooler represents a neurally inspired algorithm for learning sparse representations from noisy data streams in an online fashion.

SUBMITTER: Cui Y

PROVIDER: S-EPMC5712570 | biostudies-literature | 2017

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The HTM Spatial Pooler-A Neocortical Algorithm for Online Sparse Distributed Coding.

Cui Yuwei Y Ahmad Subutai S Hawkins Jeff J

Frontiers in computational neuroscience 20171129

Hierarchical temporal memory (HTM) provides a theoretical framework that models several key computational principles of the neocortex. In this paper, we analyze an important component of HTM, the HTM spatial pooler (SP). The SP models how neurons learn feedforward connections and form efficient representations of the input. It converts arbitrary binary input patterns into sparse distributed representations (SDRs) using a combination of competitive Hebbian learning rules and homeostatic excitabil ...[more]

PMID: 29238299

Similar Datasets

Project description:The visual cortex's hierarchical, multi-level organization is captured in many biologically inspired computational vision models, the general idea being that progressively larger scale (spatially/temporally) and more complex visual features are represented in progressively higher areas. However, most earlier models use localist representations (codes) in each representational field (which we equate with the cortical macrocolumn, "mac"), at each level. In localism, each represented feature/concept/event (hereinafter "item") is coded by a single unit. The model we describe, Sparsey, is hierarchical as well but crucially, it uses sparse distributed coding (SDC) in every mac in all levels. In SDC, each represented item is coded by a small subset of the mac's units. The SDCs of different items can overlap and the size of overlap between items can be used to represent their similarity. The difference between localism and SDC is crucial because SDC allows the two essential operations of associative memory, storing a new item and retrieving the best-matching stored item, to be done in fixed time for the life of the model. Since the model's core algorithm, which does both storage and retrieval (inference), makes a single pass over all macs on each time step, the overall model's storage/retrieval operation is also fixed-time, a criterion we consider essential for scalability to the huge ("Big Data") problems. A 2010 paper described a nonhierarchical version of this model in the context of purely spatial pattern processing. Here, we elaborate a fully hierarchical model (arbitrary numbers of levels and macs per level), describing novel model principles like progressive critical periods, dynamic modulation of principal cells' activation functions based on a mac-level familiarity measure, representation of multiple simultaneously active hypotheses, a novel method of time warp invariant recognition, and we report results showing learning/recognition of spatiotemporal patterns.

Project description:BackgroundComputed tomography (CT) is an advanced medical imaging technology. The images obtained by CT are helpful for improving diagnostic accuracy. Currently, CT is widely used in clinical settings for diagnosis and health examinations. However, full angle CT scanning has the disadvantage of causing radiation damage to the human body. Sparse angle projection CT scanning is the most effective way to minimize this damage, but the quality of the reconstructed image is reduced. Therefore, it is important to improve the reconstructed image quality produced by sparse angle projection.MethodsIn this paper, we focused on the algebraic reconstruction algorithm. To reduce the accumulation of random noise, we formulated a modified algebraic reconstruction algorithm. Firstly, the algebraic reconstruction algorithm was used to compute two consecutive results, and then the weighted sum of these two results was used to correct the reconstructed image, and an iterative result was obtained. Using this method, we aimed to reduce the noise accumulation caused by iteration.ResultsIn this study, 20 angle projections were used for the reconstruction. The experimental object was the Shepp-Logan phantom test image. The experiments were implemented under two conditions: without noise and with noise. The peak signal to noise ratio (PSNR) and the mean squared error (MSE) of the reconstructed image from projections without noise were 76.0896 and 0.0016, respectively. The PSNR and MSE of the reconstructed image from projections with noise were 75.8263 and 0.0017, respectively. The reconstructed performance was superior to the previous algebraic reconstruction algorithm.ConclusionsThe performance of the proposed method was superior to other algorithms, which confirms that noise accumulation caused by iteration can be effectively reduced by the weighted summation of two consecutive reconstruction results. Moreover, the reconstruction performance under noisy projection is superior to other algorithms, which demonstrates that the proposed method improves anti-noise performance.

Dataset Information

The HTM Spatial Pooler-A Neocortical Algorithm for Online Sparse Distributed Coding.

Publications

The HTM Spatial Pooler-A Neocortical Algorithm for Online Sparse Distributed Coding.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets