Can people identify original and manipulated photos of real-world scenes?
Ontology highlight
ABSTRACT:
SUBMITTER: Nightingale SJ
PROVIDER: S-EPMC5514174 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Categorization performance is a popular metric of scene recognition and understanding in behavioral and computational research. However, categorical constructs and their labels can be somewhat arbitrary. Derived from exhaustive vocabularies of place names (e.g., Deng et al., 2009), or the judgements of small groups of researchers (e.g., Fei-Fei, Iyer, Koch, & Perona, 2007), these categories may not correspond with human-preferred taxonomies. Here, we propose clustering by increasing the rand index via coordinate ascent (CIRCA): an unsupervised, data-driven clustering method for deriving ground-truth scene categories. In Experiment 1, human participants organized 80 stereoscopic images of outdoor scenes from the Southampton-York Natural Scenes (SYNS) dataset (Adams et al., 2016) into discrete categories. In separate tasks, images were grouped according to i) semantic content, ii) three-dimensional spatial structure, or iii) two-dimensional image appearance. Participants provided text labels for each group. Using the CIRCA method, we determined the most representative category structure and then derived category labels for each task/dimension. In Experiment 2, we found that these categories generalized well to a larger set of SYNS images, and new observers. In Experiment 3, we tested the relationship between our category systems and the spatial envelope model (Oliva & Torralba, 2001). Finally, in Experiment 4, we validated CIRCA on a larger, independent dataset of same-different category judgements. The derived category systems outperformed the SUN taxonomy (Xiao, Hays, Ehinger, Oliva, & Torralba, 2010) and an alternative clustering method (Greene, 2019). In summary, we believe this novel categorization method can be applied to a wide range of datasets to derive optimal categorical groupings and labels from psychophysical judgements of stimulus similarity.
| S-EPMC7900870 | biostudies-literature
Project description:Research shows that emotional stimuli can capture attention, and this can benefit or impair performance, depending on the characteristics of a task. Additionally, whilst some findings show that attention expands under positive conditions, others show that emotion has no influence on the broadening of attention. The current study investigated whether emotional real-world scenes influence attention in a visual search task. Participants were asked to identify a target letter embedded in the centre or periphery of emotional images. Identification accuracy was lower in positive images compared to neutral images, and response times were slower in negative images. This suggests that real-world emotional stimuli have a distracting effect on visual attention and search. There was no evidence that emotional images influenced the spatial spread of attention. Instead, it is suggested that findings may provide support for the argument that positive emotion encourages a global processing style and negative emotion promotes local processing.
| S-EPMC6647383 | biostudies-literature
Project description:Perceptual load is a well-established determinant of attentional engagement in a task. So far, perceptual load has typically been manipulated by increasing either the number of task-relevant items or the perceptual processing demand (e.g. conjunction versus feature tasks). The tasks used often involved rather simple visual displays (e.g. letters or single objects). How can perceptual load be operationalized for richer, real-world images? A promising proxy is the visual complexity of an image. However, current predictive models for visual complexity have limited applicability to diverse real-world images. Here we modelled visual complexity using a deep convolutional neural network (CNN) trained to learn perceived ratings of visual complexity. We presented 53 observers with 4000 images from the PASCAL VOC dataset, obtaining 75 020 2-alternative forced choice paired comparisons across observers. Image visual complexity scores were obtained using the TrueSkill algorithm. A CNN with weights pre-trained on an object recognition task predicted complexity ratings with r = 0.83. By contrast, feature-based models used in the literature, working on image statistics such as entropy, edge density and JPEG compression ratio, only achieved r = 0.70. Thus, our model offers a promising method to quantify the perceptual load of real-world scenes through visual complexity.
| S-EPMC7277246 | biostudies-literature
Project description:Understanding the visual discrepancy and heterogeneity of different places is of great interest to architectural design, urban design and tourism planning. However, previous studies have been limited by the lack of adequate data and efficient methods to quantify the visual aspects of a place. This work proposes a data-driven framework to explore the place-informative scenes and objects by employing deep convolutional neural network to learn and measure the visual knowledge of place appearance automatically from a massive dataset of photos and imagery. Based on the proposed framework, we compare the visual similarity and visual distinctiveness of 18 cities worldwide using millions of geo-tagged photos obtained from social media. As a result, we identify the visual cues of each city that distinguish that city from others: other than landmarks, a large number of historical architecture, religious sites, unique urban scenes, along with some unusual natural landscapes have been identified as the most place-informative elements. In terms of the city-informative objects, taking vehicles as an example, we find that the taxis, police cars and ambulances are the most place-informative objects. The results of this work are inspiring for various fields-providing insights on what large-scale geo-tagged data can achieve in understanding place formalization and urban design.
| S-EPMC6458415 | biostudies-literature
Project description:Understanding the content of memory is essential to teasing apart its underlying mechanisms. While recognition tests have commonly been used to probe memory, it is difficult to establish what specific content is driving performance. Here, we instead focus on free recall of real-world scenes, and quantify the content of memory using a drawing task. Participants studied 30 scenes and, after a distractor task, drew as many images in as much detail as possible from memory. The resulting memory-based drawings were scored by thousands of online observers, revealing numerous objects, few memory intrusions, and precise spatial information. Further, we find that visual saliency and meaning maps can explain aspects of memory performance and observe no relationship between recall and recognition for individual images. Our findings show that not only is it possible to quantify the content of memory during free recall, but those memories contain detailed representations of our visual experiences.
| S-EPMC6315028 | biostudies-literature
Project description:Affective traits, including extraversion and emotion regulation, are important considerations in clinical psychology due to their associations with the occurrence of affective disorders. Previously, emotional real-world scenes have been shown to influence visual search. However, it is currently unknown whether extraversion and emotion regulation can influence visual search towards neutral targets embedded within real-world scenes, or whether these traits can impact the effect of emotional stimuli on visual search. An opportunity sample of healthy individuals had trait levels of extraversion and emotion regulation recorded before completing a visual search task. Participants more accurately identified search targets in neutral images compared to positive images, whilst response times were slower in negative images. Importantly, individuals with higher trait levels of expressive suppression displayed faster identification of search targets regardless of the emotional valence of the stimuli. Extraversion and cognitive reappraisal did not influence visual search. These findings add to our understanding regarding the influence of extraversion, cognitive reappraisal, and expressive suppression on our ability to allocate attention during visual search when viewing real-world scenes.
| S-EPMC8766590 | biostudies-literature
Project description:When studying how people search for objects in scenes, the inhomogeneity of the visual field is often ignored. Due to physiological limitations, peripheral vision is blurred and mainly uses coarse-grained information (i.e., low spatial frequencies) for selecting saccade targets, whereas high-acuity central vision uses fine-grained information (i.e., high spatial frequencies) for analysis of details. Here we investigated how spatial frequencies and color affect object search in real-world scenes. Using gaze-contingent filters, we attenuated high or low frequencies in central or peripheral vision while viewers searched color or grayscale scenes. Results showed that peripheral filters and central high-pass filters hardly affected search accuracy, whereas accuracy dropped drastically with central low-pass filters. Peripheral filtering increased the time to localize the target by decreasing saccade amplitudes and increasing number and duration of fixations. The use of coarse-grained information in the periphery was limited to color scenes. Central filtering increased the time to verify target identity instead, especially with low-pass filters. We conclude that peripheral vision is critical for object localization and central vision is critical for object identification. Visual guidance during peripheral object localization is dominated by low-frequency color information, whereas high-frequency information, relatively independent of color, is most important for object identification in central vision.
| S-EPMC7424126 | biostudies-literature
Project description:Visual search in natural scenes is a complex task relying on peripheral vision to detect potential targets and central vision to verify them. The segregation of the visual fields has been particularly established by on-screen experiments. We conducted a gaze-contingent experiment in virtual reality in order to test how the perceived roles of central and peripheral visions translated to more natural settings. The use of everyday scenes in virtual reality allowed us to study visual attention by implementing a fairly ecological protocol that cannot be implemented in the real world. Central or peripheral vision was masked during visual search, with target objects selected according to scene semantic rules. Analyzing the resulting search behavior, we found that target objects that were not spatially constrained to a probable location within the scene impacted search measures negatively. Our results diverge from on-screen studies in that search performances were only slightly affected by central vision loss. In particular, a central mask did not impact verification times when the target was grammatically constrained to an anchor object. Our findings demonstrates that the role of central vision (up to 6 degrees of eccentricities) in identifying objects in natural scenes seems to be minor, while the role of peripheral preprocessing of targets in immersive real-world searches may have been underestimated by on-screen experiments.
| S-EPMC8287039 | biostudies-literature
Project description:Characterizing humans' ability to discriminate changes in illumination provides information about the visual system's representation of the distal stimulus. We have previously shown that humans are able to discriminate illumination changes and that sensitivity to such changes depends on their chromatic direction. Probing illumination discrimination further would be facilitated by the use of computer-graphics simulations, which would, in practice, enable a wider range of stimulus manipulations. There is no a priori guarantee, however, that results obtained with simulated scenes generalize to real illuminated scenes. To investigate this question, we measured illumination discrimination in real and simulated scenes that were well-matched in mean chromaticity and scene geometry. Illumination discrimination thresholds were essentially identical for the two stimulus types. As in our previous work, these thresholds varied with illumination change direction. We exploited the flexibility offered by the use of graphics simulations to investigate whether the differences across direction are preserved when the surfaces in the scene are varied. We show that varying the scene's surface ensemble in a manner that also changes mean scene chromaticity modulates the relative sensitivity to illumination changes along different chromatic directions. Thus, any characterization of sensitivity to changes in illumination must be defined relative to the set of surfaces in the scene.
| S-EPMC5024666 | biostudies-literature
Project description:Non-governmental organisations (NGOs) play a key role in biodiversity conservation. The majority of these organisations rely on public donations to fund their activities, and therefore fundraising success is a determinant of conservation outcomes. In spite of this integral relationship, the key principals for fundraising success in conservation are still guided by expert opinion and anecdotal evidence, with very few quantitative studies in the literature. Here we assessed the behaviour of monetary donors across twenty-five different species-focused conservation campaigns organised by an NGO conservation and environmental society. The Australian Geographic Society (AGS) carried out fundraising campaigns over a five and half year period using an identical methodology in thirty-four of its country-wide network of outlet shops. AGS owns and operates these shops that sell toys and games related to science and nature. We tested how the following factors influenced monetary donations from members of the public:1) campaign duration, 2) appeal and familiarity of species, 3) species geographic distribution relative to the fundraising location, 4) level of income and education of potential donors, 5) age and gender profile of potential donors. Contrary to past research, we found most of these factors did not significantly influence the amount of donations made to each campaign by members of the public. Larger animals did elicit a significantly higher amount donated per transaction than smaller animals, as did shops located in poorer neighbourhoods. Our study findings contrast with past research that has focused largely on hypothetical donations data collected via surveys, and demonstrates the complexity and case-specific nature of relationships between donor characteristics and spending patterns. The study highlights the value of assessing real-world fundraising campaigns, and illustrates how collaboration between academia and NGOs could be used to better tailor fundraising campaigns to maximise donations from individual citizens.
| S-EPMC5785011 | biostudies-literature