Dataset Information

Visual and Proprioceptive Perceptions Evoke Motion-Sound Symbolism: Different Acceleration Profiles Are Associated With Different Types of Consonants.

ABSTRACT: A growing body of literature has shown that one perceptual modality can be systematically associated with sensation in another. However, the cross-modal relationship between linguistic sounds and motions (i.e., motion-sound symbolism) is an extremely understudied area of research. Against this background, this paper examines the cross-modal correspondences between categories of consonants on one hand and different acceleration profiles of motion stimuli on the other. In the two experiments that we conducted, we mechanically manipulated the acceleration profiles of the stimuli while holding the trajectory paths constant, thus distinguishing the effect of acceleration profiles from that of motion path shapes. The results show that different acceleration profiles can be associated with different types of consonants; in particular, movements with acceleration and deceleration tend to be associated with a class of sounds called obstruents, whereas movements without much acceleration tend to be associated with a class of sounds called sonorants. Moreover, the current experiments show that this sort of cross-modal correspondence arises even when the stimuli are not presented visually, namely, when the participants' hands were moved passively by a manipulandum. In conclusion, the present study adds an additional piece of evidence demonstrating that bodily action-based information, i.e., proprioception as a very feasible candidate, could lead to sound symbolic patterns.

SUBMITTER: Shinohara K

PROVIDER: S-EPMC7688920 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Visual and Proprioceptive Perceptions Evoke Motion-Sound Symbolism: Different Acceleration Profiles Are Associated With Different Types of Consonants.

Shinohara Kazuko K Kawahara Shigeto S Tanaka Hideyuki H

Frontiers in psychology 20201112

A growing body of literature has shown that one perceptual modality can be systematically associated with sensation in another. However, the cross-modal relationship between linguistic sounds and motions (i.e., motion-sound symbolism) is an extremely understudied area of research. Against this background, this paper examines the cross-modal correspondences between categories of consonants on one hand and different acceleration profiles of motion stimuli on the other. In the two experiments that ...[more]

PMID: 33281688

Similar Datasets

Project description:Cross-modal interactions between auditory and haptic perception manifest themselves in language, such as sound symbolic words: crunch, splash, and creak. Several studies have shown strong associations between sound symbolic words, shapes (e.g., Bouba/Kiki effect), and materials. Here, we identified these material associations in Turkish sound symbolic words and then tested for their effect on softness perception. First, we used a rating task in a semantic differentiation method to extract the perceived softness dimensions from words and materials. We then tested whether Turkish onomatopoeic words can be used to manipulate the perceived softness of everyday materials such as honey, silk, or sand across different dimensions of softness. In the first preliminary study, we used 40 material videos and 29 adjectives in a rating task with a semantic differentiation method to extract the main softness dimensions. A principal component analysis revealed seven softness components, including Deformability, Viscosity, Surface Softness, and Granularity, in line with the literature. The second preliminary study used 27 onomatopoeic words and 21 adjectives in the same rating task. Again, the findings aligned with the literature, revealing dimensions such as Viscosity, Granularity, and Surface Softness. However, no factors related to Deformability were found due to the absence of sound symbolic words in this category. Next, we paired the onomatopoeic words and material videos based on their associations with each softness dimension. We conducted a new rating task, synchronously presenting material videos and spoken onomatopoeic words. We hypothesized that congruent word-video pairs would produce significantly higher ratings for dimension-related adjectives, while incongruent word-video pairs would decrease these ratings, and the ratings of unrelated adjectives would remain the same. Our results revealed that onomatopoeic words selectively alter the perceived material qualities, providing evidence and insight into the cross-modality of perceived softness.

Project description:In neurological diseases, muscles often become hyper-resistant to stretch due to hyperreflexia, an exaggerated stretch reflex response that is considered to primarily depend on the muscle's stretch velocity. However, there is still limited understanding of how different biomechanical triggers applied during clinical tests evoke these reflex responses. We examined the effect of imposing a rotation with increasing velocity vs. increasing acceleration on triceps surae muscle repsonse in children with spastic paresis (SP) and compared the responses to those measured in typically developing (TD) children. A motor-operated ankle manipulator was used to apply different bell-shaped movement profiles, with three levels of maximum velocity (70, 110, and 150°/s) and three levels of maximum acceleration (500, 750, and 1,000°/s2). For each profile and both groups, we evaluated the amount of evoked triceps surae muscle activation. In SP, we evaluated two additional characteristics: the intensity of the response (peak EMG burst) and the time from movement initiation to onset of the EMG burst. As expected, the amount of evoked muscle activation was larger in SP compared to TD (all muscles: p < 0.001) and only sensitive to biomechanical triggers in SP. Further investigation of the responses in SP showed that peak EMG bursts increased in profiles with higher peak velocity (lateral gastrocnemius: p = 0.04), which was emphasized by fair correlations with increased velocity at EMG burst onset (all muscles: r > 0.33-0.36, p ≤ 0.008), but showed no significant effect for acceleration. However, the EMG burst was evoked faster with higher peak acceleration (all muscles p < 0.001) whereas it was delayed in profiles with higher peak velocity (medial gastrocnemius and soleus: p < 0.006). We conclude that while exaggerated response intensity (peak EMG burst) seems linked to stretch velocity, higher accelerations seem to evoke faster responses (time to EMG burst onset) in triceps surae muscles in SP. Understanding and controlling for the distinct effects of different biological triggers, including velocity, acceleration but also length and force of the applied movement, will contribute to the development of more precise clinical measurement tools. This is especially important when aiming to understand the role of hyperreflexia during functional movements where the biomechanical inputs are multiple and changing.

Dataset Information

Visual and Proprioceptive Perceptions Evoke Motion-Sound Symbolism: Different Acceleration Profiles Are Associated With Different Types of Consonants.

Publications

Visual and Proprioceptive Perceptions Evoke Motion-Sound Symbolism: Different Acceleration Profiles Are Associated With Different Types of Consonants.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets