Experimentally disambiguating models of sensory cue integration.
Ontology highlight
ABSTRACT:
SUBMITTER: Scarfe P
PROVIDER: S-EPMC8762719 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Adults optimize perceptual judgements by integrating different types of sensory information [1, 2]. This engages specialized neural circuits that fuse signals from the same [3-5] or different [6] modalities. Whereas young children can use sensory cues independently, adult-like precision gains from cue combination only emerge around ages 10 to 11 years [7-9]. Why does it take so long to make best use of sensory information? Existing data cannot distinguish whether this (1) reflects surprisingly late changes in sensory processing (sensory integration mechanisms in the brain are still developing) or (2) depends on post-perceptual changes (integration in sensory cortex is adult-like, but higher-level decision processes do not access the information) [10]. We tested visual depth cue integration in the developing brain to distinguish these possibilities. We presented children aged 6-12 years with displays depicting depth from binocular disparity and relative motion and made measurements using psychophysics, retinotopic mapping, and pattern classification fMRI. Older children (>10.5 years) showed clear evidence for sensory fusion in V3B, a visual area thought to integrate depth cues in the adult brain [3-5]. By contrast, in younger children (<10.5 years), there was no evidence for sensory fusion in any visual area. This significant age difference was paired with a shift in perceptual performance around ages 10 to 11 years and could not be explained by motion artifacts, visual attention, or signal quality differences. Thus, whereas many basic visual processes mature early in childhood [11, 12], the brain circuits that fuse cues take a very long time to develop.
| S-EPMC4635311 | biostudies-literature
Project description:In situations with redundant or competing sensory information, humans have been shown to perform cue integration, weighting different cues according to their certainty in a quantifiably optimal manner. Ants have been shown to merge the directional information available from their path integration (PI) and visual memory, but as yet it is not clear that they do so in a way that reflects the relative certainty of the cues. In this study, we manipulate the variance of the PI home vector by allowing ants (Cataglyphis velox) to run different distances and testing their directional choice when the PI vector direction is put in competition with visual memory. Ants show progressively stronger weighting of their PI direction as PI length increases. The weighting is quantitatively predicted by modelling the expected directional variance of home vectors of different lengths and assuming optimal cue integration. However, a subsequent experiment suggests ants may not actually compute an internal estimate of the PI certainty, but are using the PI home vector length as a proxy.
| S-EPMC4614770 | biostudies-literature
Project description:The direction of rotation of a wire-frame (Necker) cube, which is perceptually bistable, can be trained to depend on stimulus location (Q. Haijiang, J. A. Saunders, R. W. Stone, & B. T. Backus, 2006). However, it is not known which aspects of "location" are important to this learning. We therefore explored "location" in a series of experiments that separately assessed testing venue, location relative to the observer, and location in the retinal image as types of location signal that could potentially be recruited by the visual system. Subjects were trained using wire-frame cubes with rotation direction disambiguated by depth cues. Training cubes were presented at two locations, rotating in opposite directions. On interleaved test trials, ambiguous monocular cubes were presented at the same two locations. The extent to which test cubes were perceived to rotate according to the trained location-rotation contingency was our measure of location-cue recruitment. We found that only retinal position was recruited as a cue for apparent rotation direction. Furthermore, the learned retinal location cue was robust to ocular transfer. Our findings are consistent with a relatively low-level site of learning, such as MT.
| S-EPMC3217240 | biostudies-literature
Project description:Summary Animals commonly integrate multiple sources of information to guide their behavior. Among insects, previous studies have suggested that the relative reliability of cues affects their weighting in behavior, but have not systematically explored how well alternative integration strategies can account for the observed directional choices. Here, we characterize the directional reliability of an ersatz sun at different elevations and wind at different speeds as guiding cues for a species of ball-rolling dung beetle. The relative reliability is then shown to determine which cue dominates when the cues are put in conflict. We further show through modeling that the results are best explained by continuous integration of the cues as a vector-sum (rather than switching between them) but with non-optimal weighting and small individual biases. The neural circuitry in the insect central complex appears to provide an ideal substrate for this type of vector-sum-based integration mechanism. Graphical abstract Highlights • The weight of a sun cue for orientation decreases with increasing elevation• The weight of wind as an orientation cue increases with increasing speed• Behaviorally, dung beetles integrate cues using a vector summation strategy• The insect brain is well suited to encode vector summation Biological sciences; Zoology; Ethology
| S-EPMC9583106 | biostudies-literature
Project description:One generally has the impression that one feels one's hand at the same location as one sees it. However, because our brain deals with possibly conflicting visual and proprioceptive information about hand position by combining it into an optimal estimate of the hand's location, mutual calibration is not necessary to achieve such a coherent percept. Does sensory integration nevertheless entail sensory calibration? We asked subjects to move their hand between visual targets. Blocks of trials without any visual feedback about their hand's position were alternated with blocks with veridical visual feedback. Whenever vision was removed, individual subjects' hands slowly drifted toward the same position to which they had drifted on previous blocks without visual feedback. The time course of the observed drift depended in a predictable manner (assuming optimal sensory combination) on the variable errors in the blocks with and without visual feedback. We conclude that the optimal use of unaligned sensory information, rather than changes within either of the senses or an accumulation of execution errors, is the cause of the frequently observed movement drift. The conclusion that seeing one's hand does not lead to an alignment between vision and proprioception has important consequences for the interpretation of previous work on visuomotor adaptation.
| S-EPMC1693739 | biostudies-literature
Project description:Functional connectivity (FC) analyses of correlations of neural activity are used extensively in neuroimaging and electrophysiology to gain insights into neural interactions. However, analyses assessing changes in correlation fail to distinguish effects produced by sources as different as changes in neural signal amplitudes or noise levels. This ambiguity substantially diminishes the value of FC for inferring system properties and clinical states. Network modelling approaches may avoid ambiguities, but require specific assumptions. We present an enhancement to FC analysis with improved specificity of inferences, minimal assumptions and no reduction in flexibility. The Additive Signal Change (ASC) approach characterizes FC changes into certain prevalent classes of signal change that involve the input of additional signal to existing activity. With FMRI data, the approach reveals a rich diversity of signal changes underlying measured changes in FC, suggesting that it could clarify our current understanding of FC changes in many contexts. The ASC method can also be used to disambiguate other measures of dependency, such as regression and coherence, providing a flexible tool for the analysis of neural data.
| S-EPMC5929905 | biostudies-literature
Project description:Human observers combine multiple sensory cues synergistically to achieve greater perceptual sensitivity, but little is known about the underlying neuronal mechanisms. We recorded the activity of neurons in the dorsal medial superior temporal (MSTd) area during a task in which trained monkeys combined visual and vestibular cues near-optimally to discriminate heading. During bimodal stimulation, MSTd neurons combined visual and vestibular inputs linearly with subadditive weights. Neurons with congruent heading preferences for visual and vestibular stimuli showed improvements in sensitivity that parallel behavioral effects. In contrast, neurons with opposite preferences showed diminished sensitivity under cue combination. Responses of congruent cells were more strongly correlated with monkeys' perceptual decisions than were responses of opposite cells, suggesting that the monkey monitored the activity of congruent cells to a greater extent during cue integration. These findings show that perceptual cue integration occurs in nonhuman primates and identify a population of neurons that may form its neural basis.
| S-EPMC2713666 | biostudies-literature
Project description:Language processing requires us to integrate incoming linguistic representations with representations of past input, often across intervening words and phrases. This computational situation has been argued to require retrieval of the appropriate representations from memory via a set of features or representations serving as retrieval cues. However, even within in a cue-based retrieval account of language comprehension, both the structure of retrieval cues and the particular computation that underlies direct-access retrieval are still underspecified. Evidence from two event-related brain potential (ERP) experiments that show cue-based interference from different types of linguistic representations during ellipsis comprehension are consistent with an architecture wherein different cue types are integrated, and where the interaction of cue with the recent contents of memory determines processing outcome, including expression of the interference effect in ERP componentry. I conclude that retrieval likely includes a computation where cues are integrated with the contents of memory via a linear weighting scheme, and I propose vector addition as a candidate formalization of this computation. I attempt to account for these effects and other related phenomena within a broader cue-based framework of language processing.
| S-EPMC6264514 | biostudies-literature
Project description:A large body of prior research has evaluated how humans combine multiple sources of information pertaining to stimuli drawn from continuous dimensions, such as distance or size. These prior studies have repeatedly demonstrated that in these circumstances humans integrate cues in a near-optimal fashion, weighting cues according to their reliability. However, most of our interactions with sensory information are in the context of categories such as objects and phonemes, thereby requiring a solution to the cue combination problem by mapping sensory estimates from continuous dimensions onto task-relevant categories. Previous studies have examined cue combination with natural categories (e.g., phonemes), providing qualitative evidence that human observers utilize information about the distributional properties of task-relevant categories, in addition to sensory information, in such categorical cue combination tasks. In the present study, we created and taught human participants novel audiovisual categories, thus allowing us to quantitatively evaluate participants' integration of sensory and categorical information. Comparing participant behavior to the predictions of a statistically optimal observer that ideally combines all available sources of information, we provide the first evidence, to our knowledge, that human observers combine sensory and category information in a statistically optimal manner.
| S-EPMC5589839 | biostudies-literature
Project description:Of all frontocortical subregions, the anterior cingulate cortex (ACC) has perhaps the most overlapping theories of function.1-3 Recording studies in rats, humans, and other primates have reported diverse neural responses that support many theories,4-12 yet nearly all these studies have in common tasks in which one event reliably predicts another. This leaves open the possibility that ACC represents associative pairing of events, independent of their overt biological significance. Sensory preconditioning13 provides an opportunity to test this. In the first phase, preconditioning, value-neutral sensory stimuli are paired (A→B). To test whether this was learned, subjects are given standard conditioning during which one of the previously neutral sensory cues is paired with a biologically meaningful outcome (B→outcome). During the final probe test, the neutral cue which was never paired with a biologically meaningful outcome is presented alone (A→) and will elicit a conditional response, suggesting that subjects had learned the associative structure during preconditioning and use that knowledge to infer presentation of the biologically relevant outcome (A→B→outcome). Inference-based responding demonstrates a fundamental property of model-based reasoning14,15 and requires learning of the associations between neutral stimuli before rewards are introduced.16-19 ACC neurons developed firing patterns that reflected the learning of sensory associations during preconditioning, even though no rewards were present. The strength of these correlates predicted rats' ability to later mobilize and use that associative information during the probe test. These results demonstrate that clear biological significance is not necessary to produce correlates of learning in ACC.
| S-EPMC8976914 | biostudies-literature