Visual tuning and metrical perception of realistic point-light dance movements.
Ontology highlight
ABSTRACT:
SUBMITTER: Su YH
PROVIDER: S-EPMC4780026 | biostudies-other | 2016 Mar
REPOSITORIES: biostudies-other
Similar Datasets
Project description:Rhythm perception and synchronization have been extensively investigated in the auditory domain, as they underlie means of human communication such as music and speech. Although recent studies suggest comparable mechanisms for synchronizing with periodically moving visual objects, the extent to which it applies to ecologically relevant information, such as the rhythm of complex biological motion, remains unknown. The present study addressed this issue by linking rhythm of music and dance in the framework of action-perception coupling. As a previous study showed that observers perceived multiple metrical periodicities in dance movements that embodied this structure, the present study examined whether sensorimotor synchronization (SMS) to dance movements resembles what is known of auditory SMS. Participants watched a point-light figure performing two basic steps of Swing dance cyclically, in which the trunk bounced at every beat and the limbs moved at every second beat, forming two metrical periodicities. Participants tapped synchronously to the bounce of the trunk with or without the limbs moving in the stimuli (Experiment 1), or tapped synchronously to the leg movements with or without the trunk bouncing simultaneously (Experiment 2). Results showed that, while synchronization with the bounce (lower-level pulse) was not influenced by the presence or absence of limb movements (metrical accent), synchronization with the legs (beat) was improved by the presence of the bounce (metrical subdivision) across different movement types. The latter finding parallels the "subdivision benefit" often demonstrated in auditory tasks, suggesting common sensorimotor mechanisms for visual rhythms in dance and auditory rhythms in music.
| S-EPMC4846664 | biostudies-literature
Project description:The anatomy of cerebral cortex is characterized by two genetically independent variables, cortical thickness and cortical surface area, that jointly determine cortical volume. It remains unclear how cortical anatomy might influence neural response properties and whether such influences would have behavioral consequences. Here, we report that thickness and surface area of human early visual cortices exert opposite influences on neural population tuning with behavioral consequences for perceptual acuity. We found that visual cortical thickness correlated negatively with the sharpness of neural population tuning and the accuracy of perceptual discrimination at different visual field positions. In contrast, visual cortical surface area correlated positively with neural population tuning sharpness and perceptual discrimination accuracy. Our findings reveal a central role for neural population tuning in linking visual cortical anatomy to visual perception and suggest that a perceptually advantageous visual cortex is a thinned one with an enlarged surface area.
| S-EPMC4321887 | biostudies-other
Project description:Reactivation of earlier perceptual activity is thought to underlie long-term memory recall. Despite evidence for this view, it is unclear whether mnemonic activity exhibits the same tuning properties as feedforward perceptual activity. Here, we leverage population receptive field models to parameterize fMRI activity in human visual cortex during spatial memory retrieval. Though retinotopic organization is present during both perception and memory, large systematic differences in tuning are also evident. Whereas there is a three-fold decline in spatial precision from early to late visual areas during perception, this pattern is not observed during memory retrieval. This difference cannot be explained by reduced signal-to-noise or poor performance on memory trials. Instead, by simulating top-down activity in a network model of cortex, we demonstrate that this property is well explained by the hierarchical structure of the visual system. Together, modeling and empirical results suggest that computational constraints imposed by visual system architecture limit the fidelity of memory reactivation in sensory cortex.
| S-EPMC9579130 | biostudies-literature
Project description:Dance and music often co-occur as evidenced when viewing choreographed dances or singers moving while performing. This study investigated how the viewing of dance motions shapes sound perception. Previous research has shown that dance reflects the temporal structure of its accompanying music, communicating musical meter (i.e. a hierarchical organization of beats) via coordinated movement patterns that indicate where strong and weak beats occur. Experiments here investigated the effects of dance cues on meter perception, hypothesizing that dance could embody the musical meter, thereby shaping participant reaction times (RTs) to sound targets occurring at different metrical positions.In experiment 1, participants viewed a video with dance choreography indicating 4/4 meter (dance condition) or a series of color changes repeated in sequences of four to indicate 4/4 meter (picture condition). A sound track accompanied these videos and participants reacted to timbre targets at different metrical positions. Participants had the slowest RT's at the strongest beats in the dance condition only. In experiment 2, participants viewed the choreography of the horse-riding dance from Psy's "Gangnam Style" in order to examine how a familiar dance might affect meter perception. Moreover, participants in this experiment were divided into a group with experience dancing this choreography and a group without experience. Results again showed slower RTs to stronger metrical positions and the group with experience demonstrated a more refined perception of metrical hierarchy. Results likely stem from the temporally selective division of attention between auditory and visual domains. This study has implications for understanding: 1) the impact of splitting attention among different sensory modalities, and 2) the impact of embodiment, on perception of musical meter. Viewing dance may interfere with sound processing, particularly at critical metrical positions, but embodied familiarity with dance choreography may facilitate meter awareness. Results shed light on the processing of multimedia environments.
| S-EPMC4550453 | biostudies-literature
Project description:The human brain has the extraordinary capability to transform cluttered sensory input into distinct object representations. For example, it is able to rapidly and seemingly without effort detect object categories in complex natural scenes. Surprisingly, category tuning is not sufficient to achieve conscious recognition of objects. What neural process beyond category extraction might elevate neural representations to the level where objects are consciously perceived? Here we show that visible and invisible faces produce similar category-selective responses in the ventral visual cortex. The pattern of neural activity evoked by visible faces could be used to decode the presence of invisible faces and vice versa. However, only visible faces caused extensive response enhancements and changes in neural oscillatory synchronization, as well as increased functional connectivity between higher and lower visual areas. We conclude that conscious face perception is more tightly linked to neural processes of sustained information integration and binding than to processes accommodating face category tuning.
| S-EPMC3535630 | biostudies-literature
Project description:The purpose of this paper is to examine, whether and under which conditions humans are able to predict the putting distance of a robotic device. Based on the "flash-lag effect" (FLE) it was expected that the prediction errors increase with increasing putting velocity. Furthermore, we hypothesized that the predictions are more accurate and more confident if human observers operate under full vision (F-RCHB) compared to either temporal occlusion (I-RCHB) or spatial occlusion (invisible ball, F-RHC, or club, F-B). In two experiments, 48 video sequences of putt movements performed by a BioRob robot arm were presented to thirty-nine students (age: 24.49±3.20 years). In the experiments, video sequences included six putting distances (1.5, 2.0, 2.5, 3.0, 3.5, and 4.0 m; experiment 1) under full versus incomplete vision (F-RCHB versus I-RCHB) and three putting distances (2. 0, 3.0, and 4.0 m; experiment 2) under the four visual conditions (F-RCHB, I-RCHB, F-RCH, and F-B). After the presentation of each video sequence, the participants estimated the putting distance on a scale from 0 to 6 m and provided their confidence of prediction on a 5-point scale. Both experiments show comparable results for the respective dependent variables (error and confidence measures). The participants consistently overestimated the putting distance under the full vision conditions; however, the experiments did not show a pattern that was consistent with the FLE. Under the temporal occlusion condition, a prediction was not possible; rather a random estimation pattern was found around the centre of the prediction scale (3 m). Spatial occlusion did not affect errors and confidence of prediction. The experiments indicate that temporal constraints seem to be more critical than spatial constraints. The FLE may not apply to distance prediction compared to location estimation.
| S-EPMC8064581 | biostudies-literature
Project description:Bioluminescence is a fascinating phenomenon and can be found in many different organisms including fish. It has been suggested that bioluminescence is used for example for defense, prey attraction, and for intraspecific communication to attract for example sexual partners. The flashlight fish, Anomalops katoptron (A. katoptron), is a nocturnal fish that produces bioluminescence and lives in shallow waters, which makes it ideal for laboratory studies. In order to understand A. katoptron's ability to detect bioluminescent light (480 to 490 nm) at night, we characterized the visual system adaptation of A. katoptron using phylogenetic, electrophysiological and behavioral studies. We found that the retinae of A. katoptron contain rods and sparse cones. A. katoptron retinae express two main visual pigments, rhodopsin (RH1), and to a lesser extent, rhodopsin-like opsin (RH2). Interestingly, recombinant RH1 and RH2 are maximally sensitive to a wavelength of approximately 490 nm light (λmax), which correspond to the spectral peak of in vivo electroretinogram (ERG) measurements. In addition, behavioral assays revealed that A. katoptron is attracted by low intensity blue but not red light. Collectively, our results suggest that the A. katoptron visual system is optimized to detect blue light in the frequency range of its own bioluminescence and residual starlight.
| S-EPMC6040694 | biostudies-literature
Project description:Seeing a talker's face can aid audiovisual (AV) integration when speech is presented in noise. However, few studies have simultaneously manipulated auditory and visual degradation. We aimed to establish how degrading the auditory and visual signal affected AV integration. Where people look on the face in this context is also of interest; Buchan, Paré and Munhall (Brain Research, 1242, 162-171, 2008) found fixations on the mouth increased in the presence of auditory noise whilst Wilson, Alsius, Paré and Munhall (Journal of Speech, Language, and Hearing Research, 59(4), 601-615, 2016) found mouth fixations decreased with decreasing visual resolution. In Condition 1, participants listened to clear speech, and in Condition 2, participants listened to vocoded speech designed to simulate the information provided by a cochlear implant. Speech was presented in three levels of auditory noise and three levels of visual blurring. Adding noise to the auditory signal increased McGurk responses, while blurring the visual signal decreased McGurk responses. Participants fixated the mouth more on trials when the McGurk effect was perceived. Adding auditory noise led to people fixating the mouth more, while visual degradation led to people fixating the mouth less. Combined, the results suggest that modality preference and where people look during AV integration of incongruent syllables varies according to the quality of information available.
| S-EPMC7788022 | biostudies-literature
Project description:Rbfox1 is a splicing regulator that has been associated with various neurological conditions such as autism spectrum disorder, mental retardation, epilepsy, attention-deficit/hyperactivity disorder, and schizophrenia. We show that in adult rodent retinas, Rbfox1 is expressed in all types of retinal ganglion cells (RGCs) as well as in certain subsets of amacrine cells (ACs) within the inner nuclear and ganglion cell layers. In developing retinas, Rbfox1 can be detected as early as E12. At that age, Rbfox1 is localized in the cytoplasm of differentiated RGCs. Between P0 and P5, strong expression of Rbfox1 in the inner plexiform layer was observed. This coincided with switching of Rbfox1 localization in RGC somas from cytoplasmic to a predominantly nuclear. Dynamic changes in Rbfox1 expression during first 10 postnatal days are correlated with the stage II spontaneous retinal waves of excitation, which in mice begins around the time of birth and continues for as long as two weeks. By P10, dendritic staining of Rbfox1 was dramatically reduced and remained so in the fully developed retina. In Rbfox1 knockout (KO) animals no detectable changes in retinal gross morphology were observed two months after Rbfox1 downregulation. However, the visual cliff test revealed marked abnormalities of depth perception of these animals. Retinal transcriptome analysis of Rbfox1 KO mice identified a number of genes that are involved in establishing neural circuits and synaptic transmission, including Vamp1, Vamp2, Snap25, Trak2, and Slc1A7, suggesting a role of Rbfox1 in the regulation of genes that facilitate AC and RGC synaptic communication.
2018-07-19 | GSE105084 | GEO
Project description:Music perception of cochlear implants (CI) users is constrained by the absence of salient musical pitch cues crucial for melody identification, but is made possible by timing cues that are largely preserved by current devices. While musical timing cues, including beats and rhythms, are a potential route to music learning, it is not known what extent they are perceptible to CI users in complex sound scenes, especially when pitch and timbral features can co-occur and obscure these musical features. The task at hand, then, becomes one of optimizing the available timing cues for young CI users by exploring ways that they might be perceived and encoded simultaneously across multiple modalities. Accordingly, we examined whether training tasks that engage active music listening through dance might enhance the song identification skills of deaf children with CIs. Nine CI children learned new songs in two training conditions: (a) listening only (auditory learning), and (2) listening and dancing (auditory-motor learning). We examined children's ability to identify original song excerpts, as well as mistuned, and piano versions from a closed-set task. While CI children were less accurate than their normal hearing peers, they showed greater song identification accuracies in versions that preserved the original instrumental beats following learning that engaged active listening with dance. The observed performance advantage is further qualified by a medium effect size, indicating that the gains afforded by auditory-motor learning are practically meaningful. Furthermore, kinematic analyses of body movements showed that CI children synchronized to temporal structures in music in a manner that was comparable to normal hearing age-matched peers. Our findings are the first to indicate that input from CI devices enables good auditory-motor integration of timing cues in child CI users for the purposes of listening and dancing to music. Beyond the heightened arousal from active engagement with music, our findings indicate that a more robust representation or memory of musical timing features was made possible by multimodal processing. Methods that encourage CI children to entrain, or track musical timing with body movements, may be particularly effective in consolidating musical knowledge than methods that engage listening only.
| S-EPMC4908111 | biostudies-literature