The extraction of 3D shape from texture and shading in the human brain.
Ontology highlight
ABSTRACT:
SUBMITTER: Georgieva SS
PROVIDER: S-EPMC2536698 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:We used contrast-agent enhanced functional magnetic resonance imaging (fMRI) in the alert monkey to map the cortical regions involved in the extraction of 3D shape from the monocular static cues, texture and shading. As in the parallel human imaging study, we contrasted the 3D condition to several 2D control conditions. The extraction of 3D shape from texture (3D SfT) involves both ventral and parietal regions, in addition to early visual areas. Strongest activation was observed in CIP, with decreasing strength towards the anterior part of the intraparietal sulcus (IPS). In the ventral stream 3D SfT sensitivity was observed in a ventral portion of TEO. The extraction of 3D shape from shading (3D SfS) involved predominantly ventral regions, such as V4 and a dorsal potion of TEO. These results are similar to those obtained earlier in human subjects and indicate that the extraction of 3D shape from texture is performed in both ventral and dorsal regions for both species, as are the motion and disparity cues, whereas shading is mainly processed in the ventral stream.
| S-EPMC2789404 | biostudies-literature
Project description:A biologically inspired model architecture for inferring 3D shape from texture is proposed. The model is hierarchically organized into modules roughly corresponding to visual cortical areas in the ventral stream. Initial orientation selective filtering decomposes the input into low-level orientation and spatial frequency representations. Grouping of spatially anisotropic orientation responses builds sketch-like representations of surface shape. Gradients in orientation fields and subsequent integration infers local surface geometry and globally consistent 3D depth. From the distributions in orientation responses summed in frequency, an estimate of the tilt and slant of the local surface can be obtained. The model suggests how 3D shape can be inferred from texture patterns and their image appearance in a hierarchically organized processing cascade along the cortical ventral stream. The proposed model integrates oriented texture gradient information that is encoded in distributed maps of orientation-frequency representations. The texture energy gradient information is defined by changes in the grouped summed normalized orientation-frequency response activity extracted from the textured object image. This activity is integrated by directed fields to generate a 3D shape representation of a complex object with depth ordering proportional to the fields output, with higher activity denoting larger distance in relative depth away from the viewer.
| S-EPMC5029942 | biostudies-literature
Project description:The human visual system is tasked with recovering the different physical sources of optical structure that generate our retinal images. Separate research has focused on understanding how the visual system estimates (a) environmental sources of image structure and (b) blur induced by the eye's limited focal range, but little is known about how the visual system distinguishes environmental sources from optical defocus. Here, we present evidence that this is a fundamental perceptual problem and provide insights into how and when the visual system succeeds and fails in solving it. We show that fully focused surface shading can be misperceived as defocused and that optical blur can be misattributed to the material properties and shape of surfaces. We further reveal how these misperceptions depend on the relationship between shading gradients and sharp contours, and conclude that computations of blur are inherently linked to computations of surface shape, material, and illumination.
| S-EPMC6688857 | biostudies-literature
Project description:Analyses of age-related white matter hyperintensity (WMH) lesions manifested in T2 fluid-attenuated inversion recovery (FLAIR) magnetic resonance images (MRI) have been mostly on understanding the size and location of the WMH lesions and rarely on the morphological characterization of the lesions. This work extends our prior analyses of the morphological characteristics and texture of WMH from 2D to 3D based on 3D T2 FLAIR images. 3D Zernike transformation was used to characterize WMH shape; a fuzzy logic method was used to characterize the lesion texture. We then clustered 3D WMH lesions into groups based on their 3D shape and texture features. A potential growth index (PGI) to assess dynamic changes in WMH lesions was developed based on the image texture features of the WMH lesion penumbra. WMH lesions with various sizes were segmented from brain images of 32 cognitively normal older adults. The WMH lesions were divided into two groups based on their size. Analyses of Variance (ANOVAs) showed significant differences in PGI among WMH shape clusters (P = 1.57 × 10-3 for small lesions; P = 3.14 × 10-2 for large lesions). Significant differences in PGI were also found among WMH texture group clusters (P = 1.79 × 10-6). In conclusion, we presented a novel approach to characterize the morphology of 3D WMH lesions and explored the potential to assess the dynamic morphological changes of WMH lesions using PGI.
| S-EPMC9731131 | biostudies-literature
Project description:BackgroundThe shading of an object provides an important cue for recognition, especially for determining its 3D shape. However, neuronal mechanisms that allow the recovery of 3D shape from shading are poorly understood. The aim of our study was to determine the neuronal basis of 3D shape from shading coding in area V4 of the awake macaque monkey.ResultsWe recorded the responses of V4 cells to stimuli presented parafoveally while the monkeys fixated a central spot. We used a set of stimuli made of 8 different 3D shapes illuminated from 4 directions (from above, the left, the right and below) and different 2D controls for each stimulus. The results show that V4 neurons present a broad selectivity to 3D shape and illumination direction, but without a preference for a unique illumination direction. However, 3D shape and illumination direction selectivities are correlated suggesting that V4 neurons can use the direction of illumination present in complex patterns of shading present on the surface of objects. In addition, a vast majority of V4 neurons (78%) have statistically different responses to the 3D and 2D versions of the stimuli, while responses to 3D are not systematically stronger than those to 2D controls. However, a hierarchical cluster analysis showed that the different classes of stimuli (3D, 2D controls) are clustered in the V4 cells response space suggesting a coding of 3D stimuli based on the population response. The different illumination directions also tend to be clustered in this space.ConclusionTogether, these results show that area V4 participates, at the population level, in the coding of complex shape from the shading patterns coming from the illumination of the surface of corrugated objects. Hence V4 provides important information for one of the steps of cortical processing of the 3D aspect of objects in natural light environment.
| S-EPMC2790458 | biostudies-literature
Project description:Brain extraction is a critical pre-processing step in brain magnetic resonance imaging (MRI) analytical pipelines. In rodents, this is often achieved by manually editing brain masks slice-by-slice, a time-consuming task where workloads increase with higher spatial resolution datasets. We recently demonstrated successful automatic brain extraction via a deep-learning-based framework, U-Net, using 2D convolutions. However, such an approach cannot make use of the rich 3D spatial-context information from volumetric MRI data. In this study, we advanced our previously proposed U-Net architecture by replacing all 2D operations with their 3D counterparts and created a 3D U-Net framework. We trained and validated our model using a recently released CAMRI rat brain database acquired at isotropic spatial resolution, including T2-weighted turbo-spin-echo structural MRI and T2*-weighted echo-planar-imaging functional MRI. The performance of our 3D U-Net model was compared with existing rodent brain extraction tools, including Rapid Automatic Tissue Segmentation, Pulse-Coupled Neural Network, SHape descriptor selected External Regions after Morphologically filtering, and our previously proposed 2D U-Net model. 3D U-Net demonstrated superior performance in Dice, Jaccard, center-of-mass distance, Hausdorff distance, and sensitivity. Additionally, we demonstrated the reliability of 3D U-Net under various noise levels, evaluated the optimal training sample sizes, and disseminated all source codes publicly, with a hope that this approach will benefit rodent MRI research community. Significant Methodological Contribution: We proposed a deep-learning-based framework to automatically identify the rodent brain boundaries in MRI. With a fully 3D convolutional network model, 3D U-Net, our proposed method demonstrated improved performance compared to current automatic brain extraction methods, as shown in several qualitative metrics (Dice, Jaccard, PPV, SEN, and Hausdorff). We trust that this tool will avoid human bias and streamline pre-processing steps during 3D high resolution rodent brain MRI data analysis. The software developed herein has been disseminated freely to the community.
| S-EPMC8716693 | biostudies-literature
Project description:This dataset represents the 3D road surface texture of a route of 27 km long in a resolution of 0.1 m approximatively in both longitudinal and transversal directions. The first purpose of the dataset is to test numerical programs that need road surface topographies as input. The dataset is composed of 2658 text files and each representing a section of that route. The data was collected with the Harris2, a vehicle operated by TRL (Transport Research Laboratory from the UK), equipped with a LiDAR (Light Detection and Ranging) and a PPS (Road-Profile System). The files are presented in a regular grid achieved by merging the LIDAR and the PPS data into 3D coordinates.
| S-EPMC7900215 | biostudies-literature
Project description:Modern humans have large and globular brains that distinguish them from their extinct Homo relatives. The characteristic globularity develops during a prenatal and early postnatal period of rapid brain growth critical for neural wiring and cognitive development. However, it remains unknown when and how brain globularity evolved and how it relates to evolutionary brain size increase. On the basis of computed tomographic scans and geometric morphometric analyses, we analyzed endocranial casts of Homo sapiens fossils (N = 20) from different time periods. Our data show that, 300,000 years ago, brain size in early H. sapiens already fell within the range of present-day humans. Brain shape, however, evolved gradually within the H. sapiens lineage, reaching present-day human variation between about 100,000 and 35,000 years ago. This process started only after other key features of craniofacial morphology appeared modern and paralleled the emergence of behavioral modernity as seen from the archeological record. Our findings are consistent with important genetic changes affecting early brain development within the H. sapiens lineage since the origin of the species and before the transition to the Later Stone Age and the Upper Paleolithic that mark full behavioral modernity.
| S-EPMC5783678 | biostudies-literature
Project description:The impact of chromosomal inversions on human brain morphology remains underexplored. We studied 35 common inversions classified from genotypes of 33,018 adults with European ancestry. The inversions at 2p22.3, 16p11.2, and 17q21.31 reach genome-wide significance, followed by 8p23.1 and 6p21.33, in their association with cortical and subcortical morphology. The 17q21.31, 8p23.1, and 16p11.2 regions comprise the LRRC37, OR7E, and NPIP duplicated gene families. We find the 17q21.31 MAPT inversion region, known for harboring neurological risk, to be the most salient locus among common variants for shaping and patterning the cortex. Overall, we observe the inverted orientations decreasing brain size, with the exception that the 2p22.3 inversion is associated with increased subcortical volume and the 8p23.1 inversion is associated with increased motor cortex. These significant inversions are in the genomic hotspots of neuropsychiatric loci. Our findings are generalizable to 3,472 children and demonstrate inversions as essential genetic variation to understand human brain phenotypes.
| S-EPMC10508191 | biostudies-literature
Project description:The time-series topography change of a landfill site before its failure has rarely been surveyed in detail. However, this information is important for both landfill management and early warning of landslides. Here, we take the 2015 Shenzhen landslide as an example, and we use the radar shape-from-shading (SFS) technique to retrieve time-series digital elevation models of the landfill. The results suggest that the total filling volume reached 4,074,300 m3 in the one and a half years before the landslide, while 2,817,400 m3 slid down in the accident. Meanwhile, the landfill rate in most areas exceeded 2 m/month, which is the empirical upper threshold in landfill engineering. Using topography captured on December 12, 2015, the slope safety analysis gives a factor of safety of 0.932, suggesting that this slope was already hazardous before the landslide. We conclude that the synthetic aperture radar (SAR) SFS technique has the potential to contribute to landfill failure monitoring.
| S-EPMC5335704 | biostudies-literature