Early Emergence of Solid Shape Coding in Natural and Deep Network Vision.
Ontology highlight
ABSTRACT:
SUBMITTER: Srinath R
PROVIDER: S-EPMC7856003 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:We recognize, understand, and interact with objects through both vision and touch. Conceivably, these two sensory systems encode object shape in similar ways, which could facilitate cross-modal communication. To test this idea, we studied single neurons in macaque monkey intermediate visual (area V4) and somatosensory (area SII) cortex, using matched shape stimuli. We found similar patterns of shape sensitivity characterized by tuning for curvature direction. These parallel tuning patterns imply analogous shape coding mechanisms in intermediate visual and somatosensory cortex.
| S-EPMC2738619 | biostudies-literature
Project description:The human visual cortex extracts both spatial and temporal visual features to support perception and guide behavior. Deep convolutional neural networks (CNNs) provide a computational framework to model cortical representation and organization for spatial visual processing, but unable to explain how the brain processes temporal information. To overcome this limitation, we extended a CNN by adding recurrent connections to different layers of the CNN to allow spatial representations to be remembered and accumulated over time. The extended model, or the recurrent neural network (RNN), embodied a hierarchical and distributed model of process memory as an integral part of visual processing. Unlike the CNN, the RNN learned spatiotemporal features from videos to enable action recognition. The RNN better predicted cortical responses to natural movie stimuli than the CNN, at all visual areas, especially those along the dorsal stream. As a fully observable model of visual processing, the RNN also revealed a cortical hierarchy of temporal receptive window, dynamics of process memory, and spatiotemporal representations. These results support the hypothesis of process memory, and demonstrate the potential of using the RNN for in-depth computational understanding of dynamic natural vision.
| S-EPMC5895512 | biostudies-literature
Project description:Convolutional neural network (CNN) driven by image recognition has been shown to be able to explain cortical responses to static pictures at ventral-stream areas. Here, we further showed that such CNN could reliably predict and decode functional magnetic resonance imaging data from humans watching natural movies, despite its lack of any mechanism to account for temporal dynamics or feedback processing. Using separate data, encoding and decoding models were developed and evaluated for describing the bi-directional relationships between the CNN and the brain. Through the encoding models, the CNN-predicted areas covered not only the ventral stream, but also the dorsal stream, albeit to a lesser degree; single-voxel response was visualized as the specific pixel pattern that drove the response, revealing the distinct representation of individual cortical location; cortical activation was synthesized from natural images with high-throughput to map category representation, contrast, and selectivity. Through the decoding models, fMRI signals were directly decoded to estimate the feature representations in both visual and semantic spaces, for direct visual reconstruction and semantic categorization, respectively. These results corroborate, generalize, and extend previous findings, and highlight the value of using deep learning, as an all-in-one model of the visual cortex, to understand and decode natural vision.
| S-EPMC6215471 | biostudies-literature
Project description:Local solid shape applies to the surface curvature of small surface patches-essentially regions of approximately constant curvatures-of volumetric objects that are smooth volumetric regions in Euclidean 3-space. This should be distinguished from local shape in pictorial space. The difference is categorical. Although local solid shape has naturally been explored in haptics, results in vision are not forthcoming. We describe a simple experiment in which observers judge shape quality and magnitude of cinematographic presentations. Without prior training, observers readily use continuous shape index and Casorati curvature scales with reasonable resolution.
| S-EPMC5016822 | biostudies-other
Project description:Background and aimsHerbivory by large mammals imposes a critical recruitment bottleneck on plants in many systems. Spines defend plants against large herbivores, and how early they emerge in saplings may be one of the strongest predictors of sapling survival in herbivore-rich environments. Yet little effort has been directed at understanding the variability in spine emergence across saplings.MethodsWe present a multispecies study examining whether and how sapling size, spine type and species' environmental niche (light and precipitation environment) influence early emergence and biomass investment in spines. A phylogenetically diverse pool of 45 species possessing different spine types (spines, prickles and thorns; that are derived from distinct plant organs: leaf, epidermis or cortex, and branch, respectively), were grown under common-garden conditions, and patterns of spine emergence and biomass allocation to spines at 5 and 15 weeks after transplanting were characterized.Key resultsSpine type and species' resource niche were the main factors driving early emergence and investment patterns. Spines emerged earliest in leaf spine-bearing species, and latest in thorn-bearing species. The probability of early spine emergence increased with decreasing precipitation, and was greater in species from open than from closed habitats. Sapling investment in spines changed with plant mass but was contingent on spine type and habitat type.ConclusionsDifferent spine types have strikingly different timing of expression, suggesting that developmental origins of spines play a critical role in sapling defences. Furthermore, species from different precipitation and light environments (open vs. closed habitats) showed contrasting patterns of early spine expression, suggesting that resource limitation in their native range may have driven divergent evolution of early defence expression.
| S-EPMC6943690 | biostudies-literature
Project description:Controlling stresses in materials presents many unusual opportunities for their engineering applications. The potential for current approaches is severely limited by the intrinsic tie between the stress and the geometric shape. Here, we report a material concept that allows stress management in a highly efficient digital manner while decoupling the stress and the geometric shape. This is realized in a dynamic covalent shape memory polymer network, for which the elastic shape memory sets the baseline stress level and maintains the geometric shape while the plasticity enabled by the dynamic bond exchange allows stress tuning. With a digital gray scale photothermal mechanism, any arbitrarily defined stress distribution can be created in a free-standing polymer film. The naturally invisible stresses can be further visualized as mechanical colors under polarized light, revealing its potential for encoding hidden information. Our approach expands the technological potential in many areas for which stresses are relevant.
| S-EPMC6167378 | biostudies-literature
Project description:The fundamental role of the visual system is to guide behavior in natural environments. To optimize information transmission, many animals have evolved a non-homogeneous retina and serially sample visual scenes by saccadic eye movements. Such eye movements, however, introduce high-speed retinal motion and decouple external and internal reference frames. Until now, these processes have only been studied with unnatural stimuli, eye movement behavior, and tasks. These experiments confound retinotopic and geotopic coordinate systems and may probe a non-representative functional range. Here we develop a real-time, gaze-contingent display with precise spatiotemporal control over high-definition natural movies. In an active condition, human observers freely watched nature documentaries and indicated the location of periodic narrow-band contrast increments relative to their gaze position. In a passive condition under central fixation, the same retinal input was replayed to each observer by updating the video's screen position. Comparison of visual sensitivity between conditions revealed three mechanisms that the visual system has adapted to compensate for peri-saccadic vision changes. Under natural conditions we show that reduced visual sensitivity during eye movements can be explained simply by the high retinal speed during a saccade without recourse to an extra-retinal mechanism of active suppression; we give evidence for enhanced sensitivity immediately after an eye movement indicative of visual receptive fields remapping in anticipation of forthcoming spatial structure; and we demonstrate that perceptual decisions can be made in world rather than retinal coordinates.
| S-EPMC3727295 | biostudies-literature
Project description:Solid-solid phase transitions are the most ubiquitous in nature, and many technologies rely on them. However, studying them in detail is difficult because of the extreme conditions (high pressure/temperature) under which many such transitions occur and the high-resolution equipment needed to capture the intermediate states of the transformations. These difficulties mean that basic questions remain unanswered, such as whether so-called diffusionless solid-solid transitions, which have only local particle rearrangement, require thermal activation. Here, we introduce a family of minimal model systems that exhibits solid-solid phase transitions that are driven by changes in the shape of colloidal particles. By using particle shape as the control variable, we entropically reshape the coordination polyhedra of the particles in the system, a change that occurs indirectly in atomic solid-solid phase transitions via changes in temperature, pressure, or density. We carry out a detailed investigation of the thermodynamics of a series of isochoric, diffusionless solid-solid phase transitions within a single shape family and find both transitions that require thermal activation or are "discontinuous" and transitions that occur without thermal activation or are "continuous." In the discontinuous case, we find that sufficiently large shape changes can drive reconfiguration on timescales comparable with those for self-assembly and without an intermediate fluid phase, and in the continuous case, solid-solid reconfiguration happens on shorter timescales than self-assembly, providing guidance for developing means of generating reconfigurable colloidal materials.
| S-EPMC5441791 | biostudies-literature
Project description:Closed-cycle aquaculture using hatchery produced seed stocks is vital to the sustainability of endangered species such as Pacific bluefin tuna (Thunnus orientalis) because this aquaculture system does not depend on aquaculture seeds collected from the wild. High egg quality promotes efficient aquaculture production by improving hatch rates and subsequent growth and survival of hatched larvae. In this study, we investigate the possibility of a simple, low-cost, and accurate egg quality prediction system based only on photographic images using deep neural networks. We photographed individual eggs immediately after spawning and assessed their qualities, i.e., whether they hatched normally and how many days larvae survived without feeding. The proposed system predicted normally hatching eggs with higher accuracy than human experts. It was also successful in predicting which eggs would produce longer-surviving larvae. We also analyzed the image aspects that contributed to the prediction to discover important egg features. Our results suggest the applicability of deep learning techniques to efficient egg quality prediction, and analysis of early developmental stages of development.
| S-EPMC7804258 | biostudies-literature
Project description:Sense of body ownership and body representation are fundamental parts of human consciousness, but the contribution of the visual modality to their development remains unclear. We tested congenitally and late blind adults on a somatosensory version of the rubber hand illusion, and on the Aristotle illusion, in which sighted controls touching a single sphere with crossed fingers commonly report perceiving two. We found that congenitally and late blind individuals did not report subjectively experiencing the rubber hand illusion. However, in an objective measure, the congenitally blind did not show a recalibration of the position of their hand towards the rubber hand while late blind and sighted individuals did. By contrast, all groups experienced the Aristotle illusion. This pattern of results provides evidence for a dissociation of the concepts of body ownership and spatial recalibration and, furthermore, suggests different reference frames for hands (external space) and fingers (anatomical space).
| S-EPMC4206865 | biostudies-other