Orienting towards social features in naturalistic scenes is reflexive.
Ontology highlight
ABSTRACT:
SUBMITTER: Rosler L
PROVIDER: S-EPMC5526566 | biostudies-other | 2017
REPOSITORIES: biostudies-other
Similar Datasets
Project description:Previous research demonstrated that humans rapidly and reflexively prioritize social features (especially heads and faces) irrespective of their physical saliency when freely viewing naturalistic scenes. In the current study, we investigated whether this preference for social elements already occurs maximally fast during free exploration or whether it is possible to additionally accelerate it by means of top-down instructions. To examine this question, we presented participants with colour photographs of naturalistic scenes containing social features (e.g. heads and bodies) while recording their eye movements. For half of the stimuli, observers were instructed to freely view the images; for the other half of the stimuli, their task was to spot depicted people as fast as possible. We replicated that social elements (especially heads) were rapidly preferred over physically salient image parts. Moreover, we found the orienting towards social elements to be additionally enhanced and accelerated when participants were instructed to detect people quickly. Importantly, this effect was strongest for heads and already evident at the very first fixation. Thus, the present study not only corroborates that the prioritization of social features in naturalistic scenes partially relies on reflexive processes, but also demonstrates that these mechanisms can be additionally accelerated by top-down instructions.
| S-EPMC6458421 | biostudies-literature
Project description:According to so-called saliency-based attention models, attention during free viewing of visual scenes is particularly allocated to physically salient image regions. In the present study, we assumed that social features in complex naturalistic scenes would be processed preferentially irrespective of their physical saliency. Therefore, we expected worse prediction of gazing behavior by saliency-based attention models when social information is present in the visual field. To test this hypothesis, participants freely viewed color photographs of complex naturalistic social (e.g., including heads, bodies) and non-social (e.g., including landscapes, objects) scenes while their eye movements were recorded. In agreement with our hypothesis, we found that social features (especially heads) were heavily prioritized during visual exploration. Correspondingly, the presence of social information weakened the influence of low-level saliency on gazing behavior. Importantly, this pattern was most pronounced for the earliest fixations indicating automatic attentional processes. These findings were further corroborated by a linear mixed model approach showing that social features (especially heads) add substantially to the prediction of fixations beyond physical saliency. Taken together, the current study indicates gazing behavior for naturalistic scenes to be better predicted by the interplay of social and physically salient features than by low-level saliency alone. These findings strongly challenge the generalizability of saliency-based attention models and demonstrate the importance of considering social influences when investigating the driving factors of human visual attention.
| S-EPMC5371661 | biostudies-other
Project description:Impairment in social interactions is a primary characteristic of people diagnosed with autism spectrum disorder (ASD). Although these individuals tend to orient less to naturalistic social cues than do typically developing (TD) individuals, laboratory experiments testing social orienting in ASD have been inconclusive, possibly because of a failure to fully isolate reflexive (stimulus-driven) and voluntary (goal-directed) social orienting processes. The purpose of the present study was to separately examine potential reflexive and/or voluntary social orienting differences in individuals with ASD relative to TD controls. Subjects (ages 7-14) with high-functioning ASD and a matched control group completed three gaze cueing tasks on an iPad in which individuals briefly saw a face with averted gaze followed by a target after a variable delay. Two tasks were 100% predictive with either all congruent (target appears in gaze direction) or all incongruent (target appears opposite from gaze direction) trials, respectively. Another task was non-predictive with these same trials (half congruent and half incongruent) intermixed randomly. Response times (RTs) to the target were used to calculate reflexive (incongruent condition RT-congruent condition RT) and voluntary (non-predictive condition RT-predictive condition RT) gaze cueing effects. Subjects also completed two additional non-social orienting tasks (ProPoint and AntiPoint). Subjects with ASD demonstrate intact reflexive but deficient voluntary gaze following. Similar results were found in a separate test of non-social orienting. This suggests problems with using social cues, but only in a goal-directed fashion, in our sample of high-functioning individuals with ASD. Such findings may not only explain inconclusive previous findings but more importantly be critical for understanding social dysfunctions in ASD and for developing future interventions.
| S-EPMC4665260 | biostudies-literature
Project description:The human visual system is extremely sensitive to biological signals around us. In the current study, we demonstrate that biological motion walking direction can induce robust reflexive attentional orienting. Following a brief presentation of a central point-light walker walking towards either the left or right direction, observers' performance was significantly better on a target in the walking direction compared with that in the opposite direction even when participants were explicitly told that walking direction was not predictive of target location. Interestingly, the effect disappeared when the walker was shown upside-down. Moreover, the reflexive attentional orienting could be extended to motions of other biological entities but not inanimate objects, and was not due to the viewpoint effect of the point-light figure. Our findings provide strong evidence that biological motion cues can trigger reflexive attentional orienting, and highlight the intrinsic sensitivity of the human visual attention system to biological signals.
| S-EPMC2967601 | biostudies-literature
Project description:BackgroundImpairments in social cognition contribute significantly to disability in schizophrenia patients (SzP). Perception of facial expressions is critical for social cognition. Intact perception requires an individual to visually scan a complex dynamic social scene for transiently moving facial expressions that may be relevant for understanding the scene. The relationship of visual scanning for these facial expressions and social cognition remains unknown.MethodsIn 39 SzP and 27 healthy controls (HC), we used eye-tracking to examine the relationship between performance on The Awareness of Social Inference Test (TASIT), which tests social cognition using naturalistic video clips of social situations, and visual scanning, measuring each individual's relative to the mean of HC. We then examined the relationship of visual scanning to the specific visual features (motion, contrast, luminance, faces) within the video clips.ResultsTASIT performance was significantly impaired in SzP for trials involving sarcasm (p < 10-5). Visual scanning was significantly more variable in SzP than HC (p < 10-6), and predicted TASIT performance in HC (p = 0.02) but not SzP (p = 0.91), differing significantly between groups (p = 0.04). During the visual scanning, SzP were less likely to be viewing faces (p = 0.0001) and less likely to saccade to facial motion in peripheral vision (p = 0.008).ConclusionsSzP show highly significant deficits in the use of visual scanning of naturalistic social scenes to inform social cognition. Alterations in visual scanning patterns may originate from impaired processing of facial motion within peripheral vision. Overall, these results highlight the utility of naturalistic stimuli in the study of social cognition deficits in schizophrenia.
| S-EPMC7751380 | biostudies-literature
Project description:Rapid recognition and categorization of sounds are essential for humans and animals alike, both for understanding and reacting to our surroundings and for daily communication and social interaction. For humans, perception of speech sounds is of crucial importance. In real life, this task is complicated by the presence of a multitude of meaningful non-speech sounds. The present behavioural, magnetoencephalography (MEG) and functional magnetic resonance imaging (fMRI) study was set out to address how attention to speech versus attention to natural non-speech sounds within complex auditory scenes influences cortical processing. The stimuli were superimpositions of spoken words and environmental sounds, with parametric variation of the speech-to-environmental sound intensity ratio. The participants' task was to detect a repetition in either the speech or the environmental sound. We found that specifically when participants attended to speech within the superimposed stimuli, higher speech-to-environmental sound ratios resulted in shorter sustained MEG responses and stronger BOLD fMRI signals especially in the left supratemporal auditory cortex and in improved behavioural performance. No such effects of speech-to-environmental sound ratio were observed when participants attended to the environmental sound part within the exact same stimuli. These findings suggest stronger saliency of speech compared with other meaningful sounds during processing of natural auditory scenes, likely linked to speech-specific top-down and bottom-up mechanisms activated during speech perception that are needed for tracking speech in real-life-like auditory environments.
| S-EPMC9298413 | biostudies-literature
Project description:Humans are entertained and emotionally captivated by a good story. Artworks, such as operas, theatre plays, movies, TV series, cartoons, etc., contain implicit stories, which are conveyed visually (e.g., through scenes) and audially (e.g., via music and speech). Story theorists have explored the structure of various artworks and identified forms and paradigms that are common to most well-written stories. Further, typical story structures have been formalized in different ways and used by professional screenwriters as guidelines. Currently, computers cannot yet identify such a latent narrative structure of a movie story. Therefore, in this work, we raise the novel challenge of understanding and formulating the movie story structure and introduce the first ever story-based labeled dataset-the Flintstones Scene Dataset (FSD). The dataset consists of 1, 569 scenes taken from a manual annotation of 60 episodes of a famous cartoon series, The Flintstones, by 105 distinct annotators. The various labels assigned to each scene by different annotators are summarized by a probability vector over 10 possible story elements representing the function of each scene in the advancement of the story, such as the Climax of Act One or the Midpoint. These elements are learned from guidelines for professional script-writing. The annotated dataset is used to investigate the effectiveness of various story-related features and multi-label classification algorithms for the task of predicting the probability distribution of scene labels. We use cosine similarity and KL divergence to measure the quality of predicted distributions. The best approaches demonstrated 0.81 average similarity and 0.67 KL divergence between the predicted label vectors and the ground truth vectors based on the manual annotations. These results demonstrate the ability of machine learning approaches to detect the narrative structure in movies, which could lead to the development of story-related video analytics tools, such as automatic video summarization and recommendation systems.
| S-EPMC7012415 | biostudies-literature
Project description:Little research hitherto has examined how individual differences in attention, as assessed using standard experimental paradigms, relate to individual differences in how attention is spontaneously allocated in more naturalistic contexts. Here, we analyzed the time intervals between refoveating eye movements (fixation durations) while typically developing 11-month-old infants viewed a 90-min battery ranging from complex dynamic to noncomplex static materials. The same infants also completed experimental assessments of cognitive control, psychomotor reaction times (RT), processing speed (indexed via peak look during habituation), and arousal (indexed via tonic pupil size). High test-retest reliability was found for fixation duration, across testing sessions and across types of viewing material. Increased cognitive control and increased arousal were associated with reduced variability in fixation duration. For fixations to dynamic stimuli, in which a large proportion of saccades may be exogenously cued, we found that psychomotor RT measures were most predictive of mean fixation duration; for fixations to static stimuli, in contrast, in which there is less exogenous attentional capture, we found that psychomotor RT did not predict performance, but that measures of cognitive control and arousal did. The implications of these findings for understanding the development of attentional control in naturalistic settings are discussed.
| S-EPMC4286103 | biostudies-literature
Project description:At the interface between scene perception and speech production, we investigated how rapidly action scenes can activate semantic and lexical information. Experiment 1 examined how complex action-scene primes, presented for 150 ms, 100 ms, or 50 ms and subsequently masked, influenced the speed with which immediately following action-picture targets are named. Prime and target actions were either identical, showed the same action with different actors and environments, or were unrelated. Relative to unrelated primes, identical and same-action primes facilitated naming the target action, even when presented for 50 ms. In Experiment 2, neutral primes assessed the direction of effects. Identical and same-action scenes induced facilitation but unrelated actions induced interference. In Experiment 3, written verbs were used as targets for naming, preceded by action primes. When target verbs denoted the prime action, clear facilitation was obtained. In contrast, interference was observed when target verbs were phonologically similar, but otherwise unrelated, to the names of prime actions. This is clear evidence for word-form activation by masked action scenes. Masked action pictures thus provide conceptual information that is detailed enough to facilitate apprehension and naming of immediately following scenes. Masked actions even activate their word-form information-as is evident when targets are words. We thus show how language production can be primed with briefly flashed masked action scenes, in answer to long-standing questions in scene processing.
| S-EPMC5898714 | biostudies-literature
Project description:Objectives: The ability to process information about eye gaze and its use for nonverbal communication is foundational to human social interactions. We developed and validated a database of stimuli that are optimized to investigate the perception and referential understanding of shifts in eye gaze.Methods: The 245 Gaze Perception stimuli are digital photographs that test the ability to estimate and interpret eye gaze trajectory. The 82 Gaze Following stimuli are digital videos that measure the ability to follow and interpret eye gaze shifts online. Both stimuli were designed for a 4-alternative forced choice paradigm (4AFC) in which the participant identifies the gazed-at object.Results: Each stimulus was validated by independent raters and only included if the endorsement of the correct item was ?75%. Finally, we provided timestamps for 19 40-second video segments from adolescent-oriented entertainment movies that are matched on several factors. These segments involve social interactions with eye gaze shifts and can be used to measure visual social attention.Conclusions: This database will be an excellent resource for researchers interested in studying the developmental, behavioral, and/or neural mechanisms supporting the perception and interpretation of eye gaze cues.
| S-EPMC7723179 | biostudies-literature