The cross-modal double flash illusion depends on featural similarity between cross-modal inducers.
Ontology highlight
ABSTRACT:
SUBMITTER: Roseboom W
PROVIDER: S-EPMC3853685 | biostudies-literature | 2013 Dec
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Transmission of neural signals in the brain takes time due to the slow biological mechanisms that mediate it. During such delays, the position of moving objects can change substantially. The brain could use statistical regularities in the natural world to compensate neural delays and represent moving stimuli closer to real time. This possibility has been explored in the context of the flash lag illusion, where a briefly flashed stimulus in alignment with a moving one appears to lag behind the moving stimulus. Despite numerous psychophysical studies, the neural mechanisms underlying the flash lag illusion remain poorly understood, partly because it has never been studied electrophysiologically in behaving animals. Macaques are a prime model for such studies, but it is unknown if they perceive the illusion. By training monkeys to report their percepts unbiased by reward, we show that they indeed perceive the illusion qualitatively similar to humans. Importantly, the magnitude of the illusion is smaller in monkeys than in humans, but it increases linearly with the speed of the moving stimulus in both species. These results provide further evidence for the similarity of sensory information processing in macaques and humans and pave the way for detailed neurophysiological investigations of the flash lag illusion in behaving macaques.
| S-EPMC3602542 | biostudies-literature
Project description:It remains unknown how the brain temporally binds sensory data across different modalities and attributes to create coherent perceptual experiences. To address this question, we measured what we see at the time we experience an event using a generalized version of the flash-lag effect (FLE) for combinations of visual attribute (bar orientation, face orientation, or face identity) and probe modality (visual or auditory). We asked participants to judge the content of rapidly and serially presented images seen at the same time as a briefly presented visual (flash) or auditory (click) probe and estimated the "time windows" contributing to decisions using reverse correlation analysis. We also used displays in which the visual attribute of a stimulus continuously changed and measured FLEs around abrupt flip in change direction and at the initiation and termination of a sequence. We consistently found clear latency-difference effects, which depended on visual attribute for the visual probe but did not for the auditory probe. The intra-modal FLE can be explained in terms of differential latency and temporal integration, but the cross-modal FLE is suggested to operate via a distinct mechanism; the content of a successive visual stream experienced after the awareness of a click is interpreted as simultaneous with the click.
| S-EPMC6405767 | biostudies-literature
Project description:Historically, the database search algorithms have been the de facto standard for inferring peptides from mass spectrometry (MS) data. Database search algorithms deduce peptides by transforming theoretical peptides into theoretical spectra and matching them to the experimental spectra. Heuristic similarity-scoring functions are used to match an experimental spectrum to a theoretical spectrum. However, the heuristic nature of the scoring functions and the simple transformation of the peptides into theoretical spectra, along with noisy mass spectra for the less abundant peptides, can introduce a cascade of inaccuracies. In this paper, we design and implement a Deep Cross-Modal Similarity Network called SpeCollate, which overcomes these inaccuracies by learning the similarity function between experimental spectra and peptides directly from the labeled MS data. SpeCollate transforms spectra and peptides into a shared Euclidean subspace by learning fixed size embeddings for both. Our proposed deep-learning network trains on sextuplets of positive and negative examples coupled with our custom-designed SNAP-loss function. Online hardest negative mining is used to select the appropriate negative examples for optimal training performance. We use 4.8 million sextuplets obtained from the NIST and MassIVE peptide libraries to train the network and demonstrate that for closed search, SpeCollate is able to perform better than Crux and MSFragger in terms of the number of peptide-spectrum matches (PSMs) and unique peptides identified under 1% FDR for real-world data. SpeCollate also identifies a large number of peptides not reported by either Crux or MSFragger. To the best of our knowledge, our proposed SpeCollate is the first deep-learning network that can determine the cross-modal similarity between peptides and mass-spectra for MS-based proteomics. We believe SpeCollate is significant progress towards developing machine-learning solutions for MS-based omics data analysis. SpeCollate is available at https://deepspecs.github.io/.
| S-EPMC8555789 | biostudies-literature
Project description:Changes in the retinal size of stationary objects provide a cue to the observer's motion in the environment: Increases indicate the observer's forward motion, and decreases backward motion. In this study, a series of images each comprising a pair of pine-tree figures were translated into auditory modality using sensory substitution software. Resulting auditory stimuli were presented in an ascending sequence (i.e. increasing in intensity and bandwidth compatible with forward motion), descending sequence (i.e. decreasing in intensity and bandwidth compatible with backward motion), or in a scrambled order. During the presentation of stimuli, blindfolded participants estimated the lengths of wooden sticks by haptics. Results showed that those exposed to the stimuli compatible with forward motion underestimated the lengths of the sticks. This consistent underestimation may share some aspects with visual size-contrast effects such as the Ebbinghaus illusion. In contrast, participants in the other two conditions did not show such magnitude of error in size estimation; which is consistent with the "adaptive perceptual bias" towards acoustic increases in intensity and bandwidth. In sum, we report a novel cross-modal size-contrast illusion, which reveals that auditory motion cues compatible with listeners' forward motion modulate haptic representations of object size.
| S-EPMC6783429 | biostudies-literature
Project description:The sound-induced flash illusion (SiFI) is a classical auditory-dominated multisensory integration phenomenon in which the observer misperceives the number of visual flashes due to the simultaneous presentation of a different number of auditory beeps. Although the SiFI has been documented to correlate with perceptual sensitivity, to date there is no consensus as to how it corresponds to sensitivity with aging. The present study was based on the SiFI paradigm (Shams et al., 2000), adding repeated auditory stimuli prior to the appearance of audiovisual stimuli to investigate the effects of repetition suppression (RS) on the SiFI with aging. The repeated auditory stimuli consisted of one or two of the same auditory stimuli presented twice in succession, which were then followed by the audiovisual stimuli. By comparing the illusions in old and young adults, we aimed to explore the influence of aging on the RS of auditory stimuli on the SiFI. The results showed that both age groups showed SiFI effects, however, the RS performance of the two age groups had different effects on the fusion and fission illusions. The illusion effect in old adults was weaker than in young adults. Specifically, RS only affected fission illusions in the old adults but both fission and fusion illusions in young adults. Thus, the present study indicated that the decreased perceptual sensitivity based on auditory RS could weaken the SiFI effect in multisensory integration and that old adults are more susceptible to RS, showing that old adults perceived the SiFI effect weakly under auditory RS.
| S-EPMC7047336 | biostudies-literature
Project description:Temperature is an important characteristic of food and drink. In addition to food-intrinsic temperature (i.e., serving temperature), consumers often experience food-extrinsic temperature (e.g., physical warmth). Emerging research on cross-modal correspondence has revealed that people reliably associate temperature with other sensory features. Building on the literature on cross-modal correspondence and sensation transference theory, the present study aimed to reveal mental representations of temperature-taste correspondence and cross-modal mental representations influencing corresponding sensory/hedonic perceptions of beverages, with a focus on manipulating food-extrinsic warmth. To reveal mental representations of temperature-taste correspondence, Experiment 1 investigated whether temperature words (warm, cool) are associated with sensory/hedonic attributes (e.g., sweet, sour, salty, bitter). The results of Experiment 1 demonstrated that warm (vs. cool) was matched more with saltiness, tastiness, healthfulness, and preference (intention to buy), whereas cool (vs. warm) was matched more with sourness and freshness. Experiment 2 assessed whether cross-modal mental representations influence corresponding sensory/hedonic perceptions of beverages. The participants wore hot and cold pads and rated sensory/hedonic attributes of Japanese tea (Experiment 2a) or black coffee (Experiment 2b) before and after tasting it. The results of Experiment 2a demonstrated that physical warmth (vs. coldness) increased healthfulness and the intention to buy Japanese tea. The results of Experiment 2b did not reveal any effects of physical warmth on sensory/hedonic ratings. These findings provide evidence of taste-temperature correspondence and provide preliminary support for the influence of food-extrinsic warmth on taste attributes related to positivity.
| S-EPMC7546214 | biostudies-literature
Project description:In the sound-induced flash illusion, auditory input affects the perception of visual stimuli with a large inter- and intraindividual variability. Crossmodal influence in this illusion has been shown to be associated with activity in visual and temporal areas. In this electroencephalography study, we investigated the relationship between oscillatory brain activity prior to stimulus presentation and subsequent perception of the illusion on the level of single trials. Using logistic regression, we modeled the perceptual outcome dependent on oscillatory power. We found that 25?Hz to 41?Hz activity over occipital electrodes from 0.17?s to 0.05?s prior to stimulus onset predicted the perception of the illusion. A t-test of power values, averaged over the significant cluster, between illusion and no-illusion trials showed higher power in illusion trials, corroborating the modeling result. We conclude that the observed power modulation predisposes the integration of audiovisual signals, providing further evidence for the governing role of prestimulus brain oscillations in multisensory perception.
| S-EPMC6461663 | biostudies-literature
Project description:The association of unrelated ant queens (pleometrosis) is supposed to improve nest foundation and competitiveness under environmental stress, but its evolutionary maintenance is difficult to explain because only one of the queens survives after nest foundation. My aim was to test the potential effect of queen association as a social buffer, that is, as a mechanism reducing stress and improving fitness due to the benefits of social contact. I analyzed the survival, fecundity, and behavior of isolated and paired Lasius flavus queens exposed and not exposed to stressors (disturbing environmental conditions). I found no difference in survivorship between isolated and paired queens or between stressed and unstressed isolated queens. Groups in which 1 or 2 paired queens were stressed showed higher mortality. Unstressed queens died similarly to their stressed nestmates, suggesting stress transmission. A trend suggested that paired queens produced eggs more quickly, but eggs were produced similarly between isolated and paired queens. Social avoidance was observed in groups with 1 stressed and 1 unstressed queen. However, the groups with 2 stressed queens showed the expected behaviors according to social buffering: lower mobility and more interindividual inspection. My findings suggest the synergistic effect of pleometrosis and stress and the dependence of stress level similarity between nestmates on social buffering or rejection on ant queens.
| S-EPMC10120981 | biostudies-literature
Project description:The present study investigated cross-modal associations between a series of paintings and sounds. We studied the effects of sound congruency (congruent vs. non-congruent sounds) and embodiment (embodied vs. synthetic sounds) on the evaluation of abstract and figurative paintings. Participants evaluated figurative and abstract paintings paired with congruent and non-congruent embodied and synthetic sounds. They also evaluated the perceived meaningfulness of the paintings, aesthetic value and immersive experience of the paintings. Embodied sounds (sounds associated with bodily sensations, bodily movements and touch) were more strongly associated with figurative paintings, while synthetic sounds (non-embodied sounds) were more strongly associated with abstract paintings. Sound congruency increased the perceived meaningfulness, immersive experience and aesthetic value of paintings. Sound embodiment increased immersive experience of paintings.
| S-EPMC9720465 | biostudies-literature
Project description:The study analyses the existence of cross-modal associations in the general population between a series of paintings and a series of clips of classical (guitar) music. Because of the complexity of the stimuli, the study differs from previous analyses conducted on the association between visual and auditory stimuli, which predominantly analyzed single tones and colors by means of psychophysical methods and forced choice responses. More recently, the relation between music and shape has been analyzed in terms of music visualization, or relatively to the role played by emotion in the association, and free response paradigms have also been accepted. In our study, in order to investigate what attributes may be responsible for the phenomenon of the association between visual and auditory stimuli, the clip/painting association was tested in two experiments: the first used the semantic differential on a unidimensional rating scale of adjectives; the second employed a specific methodology based on subjective perceptual judgments in first person account. Because of the complexity of the stimuli, it was decided to have the maximum possible uniformity of style, composition and musical color. The results show that multisensory features expressed by adjectives such as "quick," "agitated," and "strong," and their antonyms "slow," "calm," and "weak" characterized both the visual and auditory stimuli, and that they may have had a role in the associations. The results also suggest that the main perceptual features responsible for the clip/painting associations were hue, lightness, timbre, and musical tempo. Contrary to what was expected, the musical mode usually related to feelings of happiness (major mode), or to feelings of sadness (minor mode), and spatial orientation (vertical and horizontal) did not play a significant role in the association. The consistency of the associations was shown when evaluated on the whole sample, and after considering the different backgrounds and expertise of the subjects. No substantial difference was found between expert and non-expert subjects. The methods used in the experiment (semantic differential and subjective judgements in first person account) corroborated the interpretation of the results as associations due to patterns of qualitative similarity present in stimuli of different sensory modalities and experienced as such by the subjects. The main result of the study consists in showing the existence of cross-modal associations between highly complex stimuli; furthermore, the second experiment employed a specific methodology based on subjective perceptual judgments.
| S-EPMC4404723 | biostudies-literature