Dataset Information

Spontaneous representation of numerosity zero in a deep neural network for visual object recognition

ABSTRACT: Summary Conceiving “nothing” as a numerical value zero is considered a sophisticated numerical capability that humans share with cognitively advanced animals. We demonstrate that representation of zero spontaneously emerges in a deep learning neural network without any number training. As a signature of numerical quantity representation, and similar to real neurons from animals, numerosity zero network units show maximum activity to empty sets and a gradual decrease in activity with increasing countable numerosities. This indicates that the network spontaneously ordered numerosity zero as the smallest numerical value along the number line. Removal of empty-set network units caused specific deficits in the network's judgment of numerosity zero, thus reflecting these units' functional relevance. These findings suggest that processing visual information is sufficient for a visual number sense that includes zero to emerge and explains why cognitively advanced animals with whom we share a nonverbal number system exhibit rudiments of numerosity zero. Graphical abstract Highlights • Zero representations spontaneously emerge in a neural network without training• Network units are tuned not only to countable numerosity but also to zero• Neural network orders zero as the smallest numerical value along the number line• Zero units are functionally relevant for the network's discrimination performance Biological sciences; Neuroscience; Sensory neuroscience; Machine learning

SUBMITTER: Nasr K

PROVIDER: S-EPMC8571726 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Scene understanding and decomposition is a crucial challenge for intelligent systems, whether it is for object manipulation, navigation, or any other task. Although current machine and deep learning approaches for object detection and classification obtain high accuracy, they typically do not leverage interaction with the world and are limited to a set of objects seen during training. Humans on the other hand learn to recognize and classify different objects by actively engaging with them on first encounter. Moreover, recent theories in neuroscience suggest that cortical columns in the neocortex play an important role in this process, by building predictive models about objects in their reference frame. In this article, we present an enactive embodied agent that implements such a generative model for object interaction. For each object category, our system instantiates a deep neural network, called Cortical Column Network (CCN), that represents the object in its own reference frame by learning a generative model that predicts the expected transform in pixel space, given an action. The model parameters are optimized through the active inference paradigm, i.e., the minimization of variational free energy. When provided with a visual observation, an ensemble of CCNs each vote on their belief of observing that specific object category, yielding a potential object classification. In case the likelihood on the selected category is too low, the object is detected as an unknown category, and the agent has the ability to instantiate a novel CCN for this category. We validate our system in an simulated environment, where it needs to learn to discern multiple objects from the YCB dataset. We show that classification accuracy improves as an embodied agent can gather more evidence, and that it is able to learn about novel, previously unseen objects. Finally, we show that an agent driven through active inference can choose their actions to reach a preferred observation.

Dataset Information

Spontaneous representation of numerosity zero in a deep neural network for visual object recognition

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets