Dataset Information

The influence of joint attention and partner trustworthiness on cross-modal sensory cueing.

ABSTRACT: Joint attention refers to the coordinated attention between social partners to an object of shared interest, usually involving shared gaze toward the object. In the laboratory, however, joint attention is often investigated using computerized gaze cueing tasks that do not allow shared gaze. Instead, these computerized tasks require the participant to maintain fixation on the virtual partner's face, while the partner gazes to the left or right. Here we designed a modified gaze cueing task that better simulates a natural joint attention episode by allowing shared gaze, while still maintaining tight experimental control. In our computerized task the participant's gaze and the gaze of a virtual partner were manipulated independently, resulting in shared or unshared gaze. Following each gaze shift of the virtual partner a touch stimulus was delivered on one of the cheeks of the participant. We analyzed behavioral and neural (electro-encephalography) responses to the touch. Faster reaction-times and stronger lateralization of alpha power were observed when the touched cheek was in a jointly attended hemispace compared with a singly attended or unattended hemispace. Importantly, these effects were unique to joint attention and could not be explained as the additive effects of own gaze and gaze cue direction. Underlining its social nature, we found that the behavioral effect was absent when we repeated our experiment with nonsocial cues (arrows) instead of gaze cues. Furthermore, when we compared trustworthy with untrustworthy virtual partners (trustworthiness judgements based on facial appearance) we found the effect only for trustworthy and not for untrustworthy virtual partners. We conclude that joint attention based on shared gaze influences attentional orienting such that cross-modal sensory processing at the jointly attended location is facilitated, particularly when the partner is trustworthy. This indicates that social interactions and trustworthiness judgements affect cortical and behavioral responses to sensory information.

SUBMITTER: de Jong MC

PROVIDER: S-EPMC7611768 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Cross-modal spatial cueing can affect performance in a visual search task. For example, search performance improves if a visual target and an auditory cue originate from the same spatial location, and it deteriorates if they originate from different locations. Moreover, it has recently been postulated that multisensory settings, i.e., experimental settings, in which critical stimuli are concurrently presented in different sensory modalities (e.g., visual and auditory), may trigger asymmetries in visuospatial attention. Thereby, a facilitation has been observed for visual stimuli presented in the right compared to the left visual space. However, it remains unclear whether auditory cueing of attention differentially affects search performance in the left and the right hemifields in audio-visual search tasks. The present study investigated whether spatial asymmetries would occur in a search task with cross-modal spatial cueing. Participants completed a visual search task that contained no auditory cues (i.e., unimodal visual condition), spatially congruent, spatially incongruent, and spatially non-informative auditory cues. To further assess participants' accuracy in localising the auditory cues, a unimodal auditory spatial localisation task was also administered. The results demonstrated no left/right asymmetries in the unimodal visual search condition. Both an additional incongruent, as well as a spatially non-informative, auditory cue resulted in lateral asymmetries. Thereby, search times were increased for targets presented in the left compared to the right hemifield. No such spatial asymmetry was observed in the congruent condition. However, participants' performance in the congruent condition was modulated by their tone localisation accuracy. The findings of the present study demonstrate that spatial asymmetries in multisensory processing depend on the validity of the cross-modal cues, and occur under specific attentional conditions, i.e., when visual attention has to be reoriented towards the left hemifield.

Project description:Sensory loss induces cross-modal plasticity, often resulting in altered performance in remaining sensory modalities. Whereas much is known about the macroscopic mechanisms underlying cross-modal plasticity, only scant information exists about its cellular and molecular underpinnings. We found that Caenorhabditis elegans nematodes deprived of a sense of body touch exhibit various changes in behavior, associated with other unimpaired senses. We focused on one such behavioral alteration, enhanced odor sensation, and sought to reveal the neuronal and molecular mechanisms that translate mechanosensory loss into improved olfactory acuity. To this end, we analyzed in mechanosensory mutants food-dependent locomotion patterns that are associated with olfactory responses and found changes that are consistent with enhanced olfaction. The altered locomotion could be reversed in adults by optogenetic stimulation of the touch receptor (mechanosensory) neurons. Furthermore, we revealed that the enhanced odor response is related to a strengthening of inhibitory AWC→AIY synaptic transmission in the olfactory circuit. Consistently, inserting in this circuit an engineered electrical synapse that diminishes AWC inhibition of AIY counteracted the locomotion changes in touch-deficient mutants. We found that this cross-modal signaling between the mechanosensory and olfactory circuits is mediated by neuropeptides, one of which we identified as FLP-20. Our results indicate that under normal function, ongoing touch receptor neuron activation evokes FLP-20 release, suppressing synaptic communication and thus dampening odor sensation. In contrast, in the absence of mechanosensory input, FLP-20 signaling is reduced, synaptic suppression is released, and this enables enhanced olfactory acuity; these changes are long lasting and do not represent ongoing modulation, as revealed by optogenetic experiments. Our work adds to a growing literature on the roles of neuropeptides in cross-modal signaling, by showing how activity-dependent neuropeptide signaling leads to specific cross-modal plastic changes in neural circuit connectivity, enhancing sensory performance.

Dataset Information

The influence of joint attention and partner trustworthiness on cross-modal sensory cueing.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure