Infants' conceptual representations of meaningful verbal and nonverbal sounds.
Ontology highlight
ABSTRACT:
SUBMITTER: Sirri L
PROVIDER: S-EPMC7279894 | biostudies-literature | 2020
REPOSITORIES: biostudies-literature
Publications
Infants' conceptual representations of meaningful verbal and nonverbal sounds.
Sirri Louah L Guerra Ernesto E Guerra Ernesto E Linnert Szilvia S Smith Eleanor S ES Reid Vincent V Parise Eugenio E
PloS one 20200608 6
In adults, words are more effective than sounds at activating conceptual representations. We aimed to replicate these findings and extend them to infants. In a series of experiments using an eye tracker object recognition task, suitable for both adults and infants, participants heard either a word (e.g. cow) or an associated sound (e.g. mooing) followed by an image illustrating a target (e.g. cow) and a distracter (e.g. telephone). The results showed that adults reacted faster when the visual ob ...[more]
Similar Datasets
Project description:Working memory (WM) capacity limit has been extensively studied in the domains of visual and verbal stimuli. Previous studies have suggested a fixed WM capacity of typically about three or four items, on the basis of the number of items in working memory reaching a plateau after several items as the set size increases. However, the fixed WM capacity estimate appears to rely on categorical information in the stimulus set (Olsson & Poom Proceedings of the National Academy of Sciences 102:8776-8780, 2005). We designed a series of experiments to investigate nonverbal auditory WM capacity and its dependence on categorical information. Experiments 1 and 2 used simple tones and revealed capacity limit of up to two tones following a 6-s retention interval. Importantly, performance was significantly higher at set sizes 2, 3, and 4 when the frequency difference between target and test tones was relatively large. In Experiment 3, we added categorical information to the simple tones, and the effect of tone change magnitude decreased. Maximal capacity for each individual was just over three sounds, in the range of typical visual procedures. We propose that two types of information, categorical and detailed acoustic information, are kept in WM and that categorical information is critical for high WM performance.
| S-EPMC3527657 | biostudies-literature
Project description:To what extent does language shape how we think about the world? Studies suggest that linguistic symbols expressing conceptual categories ('apple', 'squirrel') make us focus on categorical information (e.g. that you saw a squirrel) and disregard individual information (e.g. whether that squirrel had a long or short tail). Across two experiments with preverbal infants, we demonstrated that it is not language but nonverbal category knowledge that determines what information is packed into object representations. Twelve-month-olds (N = 48) participated in an electroencephalography (EEG) change-detection task involving objects undergoing a brief occlusion. When viewing objects from unfamiliar categories, infants detected both across- and within-category changes, as evidenced by their negative central wave (Nc) event-related potential. Conversely, when viewing objects from familiar categories, they did not respond to within-category changes, which indicates that nonverbal category knowledge interfered with the representation of individual surface features necessary to detect such changes. Furthermore, distinct patterns of γ and α oscillations between familiar and unfamiliar categories were evident before and during occlusion, suggesting that categorization had an influence on the format of recruited object representations. Thus, we show that nonverbal category knowledge has rapid and enduring effects on object representation and discuss their functional significance for generic knowledge acquisition in the absence of language.
| S-EPMC8101279 | biostudies-literature
Project description:Neurocognitive effects of prenatal alcohol exposure in adulthood are not well documented. Questions persist regarding the extent to which there are specific, measurable effects beyond those associated with global ability deficits, whether individuals without the full fetal alcohol syndrome (FAS) demonstrate alcohol-related cognitive impairments, and whether observed memory effects are specific to a particular modality, i.e., verbal vs. visual/spatial domains.In this study, verbal and nonverbal selective reminding paradigms were used to assess memory function in 234 young adults (M age: 22.78, SD: 1.79). Alcohol exposure was quantified prenatally. Alcohol groups included: Individuals with physical effects of alcohol exposure (Dysmorphic group, n = 47); Exposed individuals without such effects (n = 74). Contrast groups included: Controls (n = 59) matched for ethnicity, socioeconomic status, and hospital of birth; Special Education contrast group (n = 54) included to control for disability status. Memory outcomes entailed total recall, delayed recall, and measures of encoding and retrieval, and learning over trials as indexed by slope.Results indicated that Dysmorphic individuals were significantly less efficient in memory performance than Controls on all of the outcomes measured, but they did not differ from those in the Special Education contrast group. The nondysmorphic, alcohol-exposed group was intermediate in their performance, suggesting a continuum of effects of prenatal exposure. Evaluation of the encoding and retrieval aspects of memory performance indicated that learning rather than forgetting accounted for the deficits associated with prenatal alcohol exposure. Finally, no interaction was found between modality of presentation (verbal and nonverbal) and effects of alcohol exposure on memory performance.These findings indicate that prenatal alcohol exposure is associated with persistent and specific effects on memory performance, and these problems result from less efficient encoding of information across both verbal and nonverbal modalities. Education and training efforts with this clinical group should take these characteristics into account.
| S-EPMC3754445 | biostudies-literature
Project description:The study of executive function (EF) has become increasingly popular in multiple areas of research. A wealth of evidence has supported the value of EF in shaping notable outcomes across typical and atypical development; however, little evidence has supported the cognitive contributors to early EF development. The current study used data from a large longitudinal sample of healthy children to investigate the differential influence of verbal and nonverbal cognition on later EF. Participants were assessed at 2 years of age using the Mullen Scales of Early Learning, and Mullen scores were used to calculate nonverbal and verbal developmental quotients. Executive function was measured at 6 years using assessments from the Stanford-Binet, Cambridge Neuropsychological Test Automated Battery, and the Behavior Rating Inventory of Executive Function. Results suggested that early nonverbal cognition was a better predictor of 6-year EF as measured by task-based laboratory assessments, whereas verbal cognition was a better predictor of parent-reported EF. Findings are discussed in regard to EF development and characteristics of EF measurement.
| S-EPMC6186452 | biostudies-literature
Project description:The brain's capacity to process unexpected events is key to cognitive flexibility. The most well-known effect of unexpected events is the interruption of attentional engagement (distraction). We tested whether unexpected events interrupt attentional representations by activating a neural mechanism for inhibitory control. This mechanism is most well characterized within the motor system. However, recent work showed that it is automatically activated by unexpected events and can explain some of their nonmotor effects (e.g., on working memory representations). Here, human participants attended to lateralized flickering visual stimuli, producing steady-state visual evoked potentials (SSVEPs) in the scalp electroencephalogram. After unexpected sounds, the SSVEP was rapidly suppressed. Using a functional localizer (stop-signal) task and independent component analysis, we then identified a fronto-central EEG source whose activity indexes inhibitory motor control. Unexpected sounds in the SSVEP task also activated this source. Using single-trial analyses, we found that subcomponents of this source differentially relate to sound-induced SSVEP changes: While its N2 component predicted the subsequent suppression of the attended-stimulus SSVEP, the P3 component predicted the suppression of the SSVEP to the unattended stimulus. These results shed new light on the processes underlying fronto-central control signals and have implications for phenomena such as distraction and the attentional blink.
| S-EPMC7869093 | biostudies-literature
Project description:The semantic variant of primary progressive aphasia (PPA-S) is diagnosed based on impaired single-word comprehension, but nonverbal impairments in face and object recognition can also be present, particularly in later disease stages. PPA-S is associated with focal atrophy in the left anterior temporal lobe (ATL), often accompanied by a lesser degree of atrophy in the right ATL. According to a dual-route account, the left ATL is critical for verbal access to conceptual knowledge while nonverbal access to conceptual knowledge depends upon the integrity of right ATL. Consistent with this view, single-word comprehension deficits in PPA-S have consistently been linked to the degree of atrophy in left ATL. In the current study we examined object processing and cortical thickness in 19 patients diagnosed with PPA-S, to evaluate the hypothesis that nonverbal object impairments would instead be determined by the amount of atrophy in the right ATL. All patients demonstrated inability to access conceptual knowledge on standardized tests with word stimuli: they were unable to match spoken words with their corresponding pictures on the Peabody Picture Vocabulary Test. Only a minority of patients, however, performed abnormally on an experimental thematic verification task, which requires judgments as to whether pairs of object pictures are thematically-associated, and does not rely on auditory or visual word input. The entire PPA-S group showed cortical thinning in left ATL, but atrophy in right ATL was more prominent in the subgroup with low verification scores. Thematic verification scores were correlated with cortical thickness in the right rather than left ATL, an asymmetric mapping which persisted when controlling for the degree of atrophy in the contralateral hemisphere. These results are consistent with a dual-route account of conceptual knowledge: breakdown of the verbal left hemispheric route produces an aphasic syndrome, which is only accompanied by visual object processing impairments when the nonverbal right hemispheric route is also compromised.
| S-EPMC6344946 | biostudies-literature
Project description:Through selective attention, decision-makers can learn to ignore behaviorally irrelevant stimulus dimensions. This can improve learning and increase the perceptual discriminability of relevant stimulus information. Across cognitive models of categorization, this is typically accomplished through the inclusion of attentional parameters, which provide information about the importance assigned to each stimulus dimension by each participant. The effect of these parameters on psychological representation is often described geometrically, such that perceptual differences over relevant psychological dimensions are accentuated (or stretched), and differences over irrelevant dimensions are down-weighted (or compressed). In sensory and association cortex, representations of stimulus features are known to covary with their behavioral relevance. Although this implies that neural representational space might closely resemble that hypothesized by formal categorization theory, to date, attentional effects in the brain have been demonstrated through powerful experimental manipulations (e.g., contrasts between relevant and irrelevant features). This approach sidesteps the role of idiosyncratic conceptual knowledge in guiding attention to useful information sources. To bridge this divide, we used formal categorization models, which were fit to behavioral data, to make inferences about the concepts and strategies used by individual participants during decision-making. We found that when greater attentional weight was devoted to a particular visual feature (e.g., "color"), its value (e.g., "red") was more accurately decoded from occipitotemporal cortex. We also found that this effect was sufficiently sensitive to reflect individual differences in conceptual knowledge, indicating that occipitotemporal stimulus representations are embedded within a space closely resembling that formalized by classic categorization theory. (PsycINFO Database Record (c) 2019 APA, all rights reserved).
| S-EPMC6586152 | biostudies-literature
Project description:Conceptual knowledge is fundamental to human cognition. Yet, the extent to which it is influenced by language is unclear. Studies of semantic processing show that similar neural patterns are evoked by the same concepts presented in different modalities (e.g., spoken words and pictures or text) [1-3]. This suggests that conceptual representations are "modality independent." However, an alternative possibility is that the similarity reflects retrieval of common spoken language representations. Indeed, in hearing spoken language users, text and spoken language are co-dependent [4, 5], and pictures are encoded via visual and verbal routes [6]. A parallel approach investigating semantic cognition shows that bilinguals activate similar patterns for the same words in their different languages [7, 8]. This suggests that conceptual representations are "language independent." However, this has only been tested in spoken language bilinguals. If different languages evoke different conceptual representations, this should be most apparent comparing languages that differ greatly in structure. Hearing people with signing deaf parents are bilingual in sign and speech: languages conveyed in different modalities. Here, we test the influence of modality and bilingualism on conceptual representation by comparing semantic representations elicited by spoken British English and British Sign Language in hearing early, sign-speech bilinguals. We show that representations of semantic categories are shared for sign and speech, but not for individual spoken words and signs. This provides evidence for partially shared representations for sign and speech and shows that language acts as a subtle filter through which we understand and interact with the world.
| S-EPMC6839399 | biostudies-literature
Project description:Sounds in our environment like voices, animal calls or musical instruments are easily recognized by human listeners. Understanding the key features underlying this robust sound recognition is an important question in auditory science. Here, we studied the recognition by human listeners of new classes of sounds: acoustic and auditory sketches, sounds that are severely impoverished but still recognizable. Starting from a time-frequency representation, a sketch is obtained by keeping only sparse elements of the original signal, here, by means of a simple peak-picking algorithm. Two time-frequency representations were compared: a biologically grounded one, the auditory spectrogram, which simulates peripheral auditory filtering, and a simple acoustic spectrogram, based on a Fourier transform. Three degrees of sparsity were also investigated. Listeners were asked to recognize the category to which a sketch sound belongs: singing voices, bird calls, musical instruments, and vehicle engine noises. Results showed that, with the exception of voice sounds, very sparse representations of sounds (10 features, or energy peaks, per second) could be recognized above chance. No clear differences could be observed between the acoustic and the auditory sketches. For the voice sounds, however, a completely different pattern of results emerged, with at-chance or even below-chance recognition performances, suggesting that the important features of the voice, whatever they are, were removed by the sketch process. Overall, these perceptual results were well correlated with a model of auditory distances, based on spectro-temporal excitation patterns (STEPs). This study confirms the potential of these new classes of sounds, acoustic and auditory sketches, to study sound recognition.
| S-EPMC4780819 | biostudies-literature
Project description:A major part of learning a language is learning to map spoken words onto objects in the environment. An open question is what are the consequences of this learning for cognition and perception? Here, we present a series of experiments that examine effects of verbal labels on the activation of conceptual information as measured through picture verification tasks. We find that verbal cues, such as the word "cat," lead to faster and more accurate verification of congruent objects and rejection of incongruent objects than do either nonverbal cues, such as the sound of a cat meowing, or words that do not directly refer to the object, such as the word "meowing." This label advantage does not arise from verbal labels being more familiar or easier to process than other cues, and it does extends to newly learned labels and sounds. Despite having equivalent facility in learning associations between novel objects and labels or sounds, conceptual information is activated more effectively through verbal means than through nonverbal means. Thus, rather than simply accessing nonverbal concepts, language activates aspects of a conceptual representation in a particularly effective way. We offer preliminary support that representations activated via verbal means are more categorical and show greater consistency between subjects. These results inform the understanding of how human cognition is shaped by language and hint at effects that different patterns of naming can have on conceptual structure.
| S-EPMC4124531 | biostudies-literature