A Cross Modal Performance-Based Measure of Sensory Stimuli Intricacy.
Ontology highlight
ABSTRACT:
SUBMITTER: Snitz K
PROVIDER: S-EPMC4740424 | biostudies-literature | 2016
REPOSITORIES: biostudies-literature
Publications
A Cross Modal Performance-Based Measure of Sensory Stimuli Intricacy.
Snitz Kobi K Arzi Anat A Jacobson Merav M Secundo Lavi L Weissler Kineret K Yablonka Adi A
PloS one 20160203 2
We define a new measure of sensory stimuli which has the following properties: It is cross modal, performance based, robust, and well defined. We interpret this measure as the intricacy or complexity of the stimuli, yet its validity is independent of its interpretation. We tested the validity and cross modality of our measure using three olfactory and one visual experiment. In order to test the link between our measure and cognitive performance we also conducted an additional visual experiment. ...[more]
Similar Datasets
Project description:Men generally prefer feminine women's faces and voices over masculine women's faces and voices, and these cross-modal preferences are positively correlated. Men's preferences for female facial and vocal femininity have typically been investigated independently by presenting soundless still images separately from audio-only vocal recordings. For the first time ever, we presented men with short video clips in which dynamic faces and voices were simultaneously manipulated in femininity/masculinity. Men preferred feminine men's faces over masculine men's faces, and preferred masculine men's voices over feminine men's voices. We found that men preferred feminine women's faces and voices over masculine women's faces and voices. Men's attractiveness ratings of both feminine and masculine faces were increased by the addition of vocal femininity. Also, men's attractiveness ratings of feminine and masculine voices were increased by the addition of facial femininity present in the video. Men's preferences for vocal and facial femininity were significantly and positively correlated when stimuli were female, but not when they were male. Our findings complement other evidence for cross-modal femininity preferences among male raters, and show that preferences observed in studies using still images and/or independently presented vocal stimuli are also observed when dynamic faces and voices are displayed simultaneously in video format.
| S-EPMC3729951 | biostudies-literature
Project description:Sensory loss induces cross-modal plasticity, often resulting in altered performance in remaining sensory modalities. Whereas much is known about the macroscopic mechanisms underlying cross-modal plasticity, only scant information exists about its cellular and molecular underpinnings. We found that Caenorhabditis elegans nematodes deprived of a sense of body touch exhibit various changes in behavior, associated with other unimpaired senses. We focused on one such behavioral alteration, enhanced odor sensation, and sought to reveal the neuronal and molecular mechanisms that translate mechanosensory loss into improved olfactory acuity. To this end, we analyzed in mechanosensory mutants food-dependent locomotion patterns that are associated with olfactory responses and found changes that are consistent with enhanced olfaction. The altered locomotion could be reversed in adults by optogenetic stimulation of the touch receptor (mechanosensory) neurons. Furthermore, we revealed that the enhanced odor response is related to a strengthening of inhibitory AWC→AIY synaptic transmission in the olfactory circuit. Consistently, inserting in this circuit an engineered electrical synapse that diminishes AWC inhibition of AIY counteracted the locomotion changes in touch-deficient mutants. We found that this cross-modal signaling between the mechanosensory and olfactory circuits is mediated by neuropeptides, one of which we identified as FLP-20. Our results indicate that under normal function, ongoing touch receptor neuron activation evokes FLP-20 release, suppressing synaptic communication and thus dampening odor sensation. In contrast, in the absence of mechanosensory input, FLP-20 signaling is reduced, synaptic suppression is released, and this enables enhanced olfactory acuity; these changes are long lasting and do not represent ongoing modulation, as revealed by optogenetic experiments. Our work adds to a growing literature on the roles of neuropeptides in cross-modal signaling, by showing how activity-dependent neuropeptide signaling leads to specific cross-modal plastic changes in neural circuit connectivity, enhancing sensory performance.
| S-EPMC4712962 | biostudies-literature
Project description:Typical human perception features stable biases such as perceiving visual events as later than synchronous auditory events. The origin of such perceptual biases is unknown. To investigate the role of early sensory experience, we tested whether a congenital, transient loss of pattern vision, caused by bilateral dense cataracts, has sustained effects on audio-visual and tactile-visual temporal biases and resolution. Participants judged the temporal order of successively presented, spatially separated events within and across modalities. Individuals with reversed congenital cataracts showed a bias towards perceiving visual stimuli as occurring earlier than auditory (Expt. 1) and tactile (Expt. 2) stimuli. This finding stood in stark contrast to normally sighted controls and sight-recovery individuals who had developed cataracts later in childhood: both groups exhibited the typical bias of perceiving vision as delayed compared to audition. These findings provide strong evidence that cross-modal temporal biases depend on sensory experience during an early sensitive period.
| S-EPMC7476755 | biostudies-literature
Project description:IntroductionVisual-to-auditory sensory substitution devices are assistive devices for the blind that convert visual images into auditory images (or soundscapes) by mapping visual features with acoustic cues. To convey spatial information with sounds, several sensory substitution devices use a Virtual Acoustic Space (VAS) using Head Related Transfer Functions (HRTFs) to synthesize natural acoustic cues used for sound localization. However, the perception of the elevation is known to be inaccurate with generic spatialization since it is based on notches in the audio spectrum that are specific to each individual. Another method used to convey elevation information is based on the audiovisual cross-modal correspondence between pitch and visual elevation. The main drawback of this second method is caused by the limitation of the ability to perceive elevation through HRTFs due to the spectral narrowband of the sounds.MethodIn this study we compared the early ability to localize objects with a visual-to-auditory sensory substitution device where elevation is either conveyed using a spatialization-based only method (Noise encoding) or using pitch-based methods with different spectral complexities (Monotonic and Harmonic encodings). Thirty eight blindfolded participants had to localize a virtual target using soundscapes before and after having been familiarized with the visual-to-auditory encodings.ResultsParticipants were more accurate to localize elevation with pitch-based encodings than with the spatialization-based only method. Only slight differences in azimuth localization performance were found between the encodings.DiscussionThis study suggests the intuitiveness of a pitch-based encoding with a facilitation effect of the cross-modal correspondence when a non-individualized sound spatialization is used.
| S-EPMC9909421 | biostudies-literature
Project description:Pain can be elicited through all mammalian sensory pathways yet cross-modal sensory integration, and its relationship to clinical pain, is largely unexplored. Centralized chronic pain conditions such as fibromyalgia are often associated with symptoms of multisensory hypersensitivity. In this study, female patients with fibromyalgia demonstrated cross-modal hypersensitivity to visual and pressure stimuli compared with age- and sex-matched healthy controls. Functional magnetic resonance imaging revealed that insular activity evoked by an aversive level of visual stimulation was associated with the intensity of fibromyalgia pain. Moreover, attenuation of this insular activity by the analgesic pregabalin was accompanied by concomitant reductions in clinical pain. A multivariate classification method using support vector machines (SVM) applied to visual-evoked brain activity distinguished patients with fibromyalgia from healthy controls with 82% accuracy. A separate SVM classification of treatment effects on visual-evoked activity reliably identified when patients were administered pregabalin as compared with placebo. Both SVM analyses identified significant weights within the insular cortex during aversive visual stimulation. These data suggest that abnormal integration of multisensory and pain pathways within the insula may represent a pathophysiological mechanism in some chronic pain conditions and that insular response to aversive visual stimulation may have utility as a marker for analgesic drug development.
| S-EPMC4988086 | biostudies-literature
Project description:The claustrum, a subcortical nucleus forming extensive connections with the neocortex, has been implicated in sensory selection. Sensory-evoked claustrum activity is thought to modulate the neocortex's context-dependent response to sensory input. Recording from claustrum neurons while mice performed a tactile-visual sensory-selection task, we found that neurons in the anterior claustrum, including putative optotagged claustrocortical neurons projecting to the primary somatosensory cortex (S1), were rarely modulated by sensory input. Rather, they exhibited different types of direction-tuned motor responses. Furthermore, we found that claustrum neurons encoded upcoming movement during intertrial intervals and that pairs of claustrum neurons exhibiting synchronous firing were enriched for pairs preferring contralateral lick directions, suggesting that the activity of specific ensembles of similarly tuned claustrum neurons may modulate cortical activity. Chemogenetic inhibition of claustrocortical neurons decreased lick responses to inappropriate sensory stimuli. Altogether, our data indicate that the claustrum is integrated into higher-order premotor circuits recently implicated in decision-making.
| S-EPMC8829966 | biostudies-literature
Project description:Joint attention refers to the coordinated attention between social partners to an object of shared interest, usually involving shared gaze toward the object. In the laboratory, however, joint attention is often investigated using computerized gaze cueing tasks that do not allow shared gaze. Instead, these computerized tasks require the participant to maintain fixation on the virtual partner's face, while the partner gazes to the left or right. Here we designed a modified gaze cueing task that better simulates a natural joint attention episode by allowing shared gaze, while still maintaining tight experimental control. In our computerized task the participant's gaze and the gaze of a virtual partner were manipulated independently, resulting in shared or unshared gaze. Following each gaze shift of the virtual partner a touch stimulus was delivered on one of the cheeks of the participant. We analyzed behavioral and neural (electro-encephalography) responses to the touch. Faster reaction-times and stronger lateralization of alpha power were observed when the touched cheek was in a jointly attended hemispace compared with a singly attended or unattended hemispace. Importantly, these effects were unique to joint attention and could not be explained as the additive effects of own gaze and gaze cue direction. Underlining its social nature, we found that the behavioral effect was absent when we repeated our experiment with nonsocial cues (arrows) instead of gaze cues. Furthermore, when we compared trustworthy with untrustworthy virtual partners (trustworthiness judgements based on facial appearance) we found the effect only for trustworthy and not for untrustworthy virtual partners. We conclude that joint attention based on shared gaze influences attentional orienting such that cross-modal sensory processing at the jointly attended location is facilitated, particularly when the partner is trustworthy. This indicates that social interactions and trustworthiness judgements affect cortical and behavioral responses to sensory information.
| S-EPMC7611768 | biostudies-literature
Project description:Compensatory changes as a result of auditory deprivation in the deaf lead to higher visual processing skills. In two experiments, we explored if such brain plasticity in the deaf modulates processing of masked stimuli in the visual modality. Deaf and normal-hearing participants responded to targets either voluntarily or by instruction. Masked primes related to the response were presented briefly before the targets at the center and the periphery. In Experiment 1, targets appeared only at the foveal region whereas, in Experiment 2, they appeared both at the fovea and the periphery. The deaf showed higher sensitivity to masked primes in both the experiments. They chose the primed response more often and also were faster during congruent responses compared to the normal hearing. These results suggest that neuroplasticity in the deaf modulates how they perceive and use information with reduced visibility for action selection and execution.
| S-EPMC5558002 | biostudies-literature
Project description:Lack of a sensory input not only alters the cortical circuitry subserving the deprived sense, but also produces compensatory changes in the functionality of other sensory modalities. Here we report that visual deprivation produces opposite changes in synaptic function in primary visual and somatosensory cortices in rats, which are rapidly reversed by visual experience. This type of bidirectional cross-modal plasticity is associated with changes in synaptic AMPA receptor subunit composition.
| S-EPMC1905492 | biostudies-literature
Project description:BackgroundHigh-frequency hearing loss is one of the most common problems in the aging population and with those who have a history of exposure to loud noises. This type of hearing loss can be frustrating and disabling, making it difficult to understand speech communication and interact effectively with the world.ObjectiveThis study aimed to examine the impact of spatially unique haptic vibrations representing high-frequency phonemes on the self-perceived ability to understand conversations in everyday situations.MethodsTo address high-frequency hearing loss, a multi-motor wristband was developed that uses machine learning to listen for specific high-frequency phonemes. The wristband vibrates in spatially unique locations to represent which phoneme was present in real time. A total of 16 participants with high-frequency hearing loss were recruited and asked to wear the wristband for 6 weeks. The degree of disability associated with hearing loss was measured weekly using the Abbreviated Profile of Hearing Aid Benefit (APHAB).ResultsBy the end of the 6-week study, the average APHAB benefit score across all participants reached 12.39 points, from a baseline of 40.32 to a final score of 27.93 (SD 13.11; N=16; P=.002, 2-tailed dependent t test). Those without hearing aids showed a 10.78-point larger improvement in average APHAB benefit score at 6 weeks than those with hearing aids (t14=2.14; P=.10, 2-tailed independent t test). The average benefit score across all participants for ease of communication was 15.44 (SD 13.88; N=16; P<.001, 2-tailed dependent t test). The average benefit score across all participants for background noise was 10.88 (SD 17.54; N=16; P=.03, 2-tailed dependent t test). The average benefit score across all participants for reverberation was 10.84 (SD 16.95; N=16; P=.02, 2-tailed dependent t test).ConclusionsThese findings show that vibrotactile sensory substitution delivered by a wristband that produces spatially distinguishable vibrations in correspondence with high-frequency phonemes helps individuals with high-frequency hearing loss improve their perceived understanding of verbal communication. Vibrotactile feedback provides benefits whether or not a person wears hearing aids, albeit in slightly different ways. Finally, individuals with the greatest perceived difficulty understanding speech experienced the greatest amount of perceived benefit from vibrotactile feedback.
| S-EPMC11008433 | biostudies-literature