Dataset Information

Interaction between language and vision: it's momentary, abstract, and it develops.

ABSTRACT: In this paper, we present a case study that explores the nature and development of the mechanisms by which language interacts with and influences our ability to represent and retain information from one of our most important non-linguistic systems - vision. In previous work (Dessalegn & Landau, 2008), we showed that 4 year-olds remembered conjunctions of visual features better when the visual target was accompanied by a sentence containing an asymmetric spatial predicate (e.g., the yellow is to the left of the black) but not when the visual target was accompanied by a sentence containing a novel noun (e.g., look at the dax) or a symmetric spatial predicate (e.g., the yellow is touching the black). In this paper, we extend these findings. In three experiments, 3, 4 and 6 year-olds were shown square blocks split in half by color vertically, horizontally or diagonally (e.g., yellow-left, black-right) and were asked to perform a delayed-matching task. We found that sentences containing spatial asymmetric predicates (e.g., the yellow is to the left of the black) and non-spatial asymmetric predicates (e.g., the yellow is prettier than the black) helped 4 year-olds, although not to the same extent. By contrast, 3 year-olds did not benefit from different linguistic instructions at all while 6 year-olds performed at ceiling in the task with or without the relevant sentences. Our findings suggest by age 4, the effects of language on non-linguistic tasks depend on highly abstract representations of the linguistic instructions and are momentary, seen only in the context of the task. We further speculate that language becomes more automatically engaged in nonlinguistic tasks over development.

SUBMITTER: Dessalegn B

PROVIDER: S-EPMC4531256 | biostudies-literature | 2013 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Interaction between language and vision: it's momentary, abstract, and it develops.

Dessalegn Banchiamlack B Landau Barbara B

Cognition 20130329 3

In this paper, we present a case study that explores the nature and development of the mechanisms by which language interacts with and influences our ability to represent and retain information from one of our most important non-linguistic systems - vision. In previous work (Dessalegn & Landau, 2008), we showed that 4 year-olds remembered conjunctions of visual features better when the visual target was accompanied by a sentence containing an asymmetric spatial predicate (e.g., the yellow is to ...[more]

PMID: 23545385

Similar Datasets

Project description:With the exception of primates, most vertebrates have laterally placed eyes. Binocular vision in vertebrates has been implicated in several functions, including depth perception, contrast discrimination, etc. However, the blind area in front of the head that is proximal to the binocular visual field is often neglected. This anterior blind area is important when discussing the evolution of binocular vision because its relative length is inversely correlated with the width of the binocular field. Therefore, species with wider binocular fields also have shorter anterior blind areas and objects along the mid-sagittal plane can be imaged at closer distances. Additionally, the anterior blind area is of functional significance for birds because the beak falls within this blind area. We tested for the first time some specific predictions about the functional role of the anterior blind area in birds controlling for phylogenetic effects. We used published data on visual field configuration in 40 species of birds and measured beak and skull parameters from museum specimens. We found that birds with proportionally longer beaks have longer anterior blind areas and thus narrower binocular fields. This result suggests that the anterior blind area and beak visibility do play a role in shaping binocular fields, and that binocular field width is not solely determined by the need for stereoscopic vision. In visually guided foragers, the ability to see the beak-and how much of the beak can be seen-varies predictably with foraging habits. For example, fish- and insect-eating specialists can see more of their own beak than birds eating immobile food can. But in non-visually guided foragers, there is no consistent relationship between the beak and anterior blind area. We discuss different strategies-wide binocular fields, large eye movements, and long beaks-that minimize the potential negative effects of the anterior blind area. Overall, we argue that there is more to avian binocularity than meets the eye.

Project description:Pointing toward concrete objects is a well-known and efficient communicative strategy. Much less is known about the communicative effectiveness of abstract pointing where the pointing gestures are directed to "empty space." McNeill's (2003) observations suggest that abstract pointing can be used to establish referents in gesture space, without the referents being physically present. Recently, however, it has been shown that abstract pointing typically provides redundant information to the uttered speech thereby suggesting a very limited communicative value (So et al., 2009). In a first approach to tackle this issue we were interested to know whether perceivers are sensitive at all to this gesture cue or whether it is completely discarded as irrelevant add-on information. Sensitivity to for instance a gesture-speech mismatch would suggest a potential communicative function of abstract pointing. Therefore, we devised a mismatch paradigm in which participants watched a video where a female was interviewed on various topics. During her responses, she established two concepts in space using abstract pointing (e.g., pointing to the left when saying Donald, and pointing to the right when saying Mickey). In the last response to each topic, the pointing gesture accompanying a target word (e.g., Donald) was either consistent or inconsistent with the previously established location. Event related brain potentials showed an increased N400 and P600 when gesture and speech referred to different referents, indicating that inconsistent use of gesture space impairs language comprehension. Abstract pointing was found to influence comprehension even though gesture was not crucial to understanding the sentences or conducting the experimental task. These data suggest that a referent was retrieved via abstract pointing and that abstract pointing can potentially be used for referent indication in a discourse. We conclude that abstract pointing has a potential communicative function.

Dataset Information

Interaction between language and vision: it's momentary, abstract, and it develops.

Publications

Interaction between language and vision: it's momentary, abstract, and it develops.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets