Neural representations of kinematic laws of motion: evidence for action-perception coupling.
Ontology highlight
ABSTRACT:
SUBMITTER: Dayan E
PROVIDER: S-EPMC2154474 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Grounded cognition accounts of semantic representation posit that brain regions traditionally linked to perception and action play a role in grounding the semantic content of words and sentences. Sensory-motor systems are thought to support partially abstract simulations through which conceptual content is grounded. However, which details of sensory-motor experience are included in, or excluded from these simulations, is not well understood. We investigated whether sensory-motor brain regions are differentially involved depending on the speed of actions described in a sentence. We addressed this issue by examining the neural signature of relatively fast (The old lady scurried across the road) and slow (The old lady strolled across the road) action sentences. The results showed that sentences that implied fast motion modulated activity within the right posterior superior temporal sulcus and the angular and middle occipital gyri, areas associated with biological motion and action perception. Sentences that implied slow motion resulted in greater signal within the right primary motor cortex and anterior inferior parietal lobule, areas associated with action execution and planning. These results suggest that the speed of described motion influences representational content and modulates the nature of conceptual grounding. Fast motion events are represented more visually whereas motor regions play a greater role in representing conceptual content associated with slow motion.
| S-EPMC5366268 | biostudies-literature
Project description:Movement covariates, such as electromyographic or kinematic activity, have been proposed as candidates for the neural representation of hand control. However, it remains unclear how these movement covariates are reflected in electroencephalographic (EEG) activity during different stages of grasping movements. In this exploratory study, we simultaneously acquired EEG, kinematic and electromyographic recordings of human subjects performing 33 types of grasps, yielding the largest such dataset to date. We observed that EEG activity reflected different movement covariates in different stages of grasping. During the pre-shaping stage, centro-parietal EEG in the lower beta frequency band reflected the object's shape and size, whereas during the finalization and holding stages, contralateral parietal EEG in the mu frequency band reflected muscle activity. These findings contribute to the understanding of the temporal organization of neural grasping patterns, and could inform the design of noninvasive neuroprosthetics and brain-computer interfaces with more natural control.
| S-EPMC6232146 | biostudies-literature
Project description:This multiple single case study contrasted left hemisphere stroke patients (N = 6) to healthy age-matched control participants (N = 15) on their understanding of action (e.g., holding, clenching) and motion verbs (e.g., crumbling, flowing). The tasks required participants to correctly identify the matching verb or associated picture. Dissociations on action and motion verb content depending on lesion site were expected. As predicted for verbs containing an action and/or motion content, modified t-tests confirmed selective deficits in processing motion verbs in patients with lesions involving posterior parietal and lateral occipitotemporal cortex. In contrast, deficits in verbs describing motionless actions were found in patients with more anterior lesions sparing posterior parietal and lateral occipitotemporal cortex. These findings support the hypotheses that semantic representations for action and motion are behaviorally and neuro-anatomically dissociable. The findings clarify the differential and critical role of perceptual and motor regions in processing modality-specific semantic knowledge as opposed to a supportive but not necessary role. We contextualize these results within theories from both cognitive psychology and cognitive neuroscience that make claims over the role of sensory and motor information in semantic representation.
| S-EPMC5306207 | biostudies-literature
Project description:Humans can distinguish flying birds from drones based solely on motion features when no image information is available. However, it remains unclear which motion features of animate motion induce our animacy perception. To address this, we first analyzed the differences in centroid motion between birds and drones, and discovered that birds exhibit greater acceleration, angular speed, and trajectory fluctuations. We further determined the order of their importance in evoking animacy perception was trajectory fluctuations, acceleration, and speed. More interestingly, people judge whether a moving object is alive using a feature-matching strategy, implying that animacy perception is induced in a key feature-triggered way rather than relying on the accumulation of evidence. Our findings not only shed light on the critical motion features that induce animacy perception and their relative contributions but also have important implications for developing target classification algorithms based on motion features.
| S-EPMC10472316 | biostudies-literature
Project description:Even though reciprocal inhibitory vestibular interactions following visual stimulation have been understood as sensory-reweighting mechanisms to stabilize motion perception; this hypothesis has not been thoroughly investigated with temporal dynamic measurements. Recently, virtual reality technology has been implemented in different medical domains. However, exposure in virtual reality environments can cause discomfort, including nausea or headache, due to visual-vestibular conflicts. We speculated that self-motion perception could be altered by accelerative visual motion stimulation in the virtual reality situation because of the absence of vestibular signals (visual-vestibular sensory conflict), which could result in the sickness. The current study investigated spatio-temporal profiles for motion perception using immersive virtual reality. We demonstrated alterations in neural dynamics under the sensory mismatch condition (accelerative visual motion stimulation) and in participants with high levels of sickness after driving simulation. Additionally, an event-related potentials study revealed that the high-sickness group presented with higher P3 amplitudes in sensory mismatch conditions, suggesting that it would be a substantial demand of cognitive resources for motion perception on sensory mismatch conditions.
| S-EPMC7710904 | biostudies-literature
Project description:Recognizing the actions of others from visual stimuli is a crucial aspect of human perception that allows individuals to respond to social cues. Humans are able to discriminate between similar actions despite transformations, like changes in viewpoint or actor, that substantially alter the visual appearance of a scene. This ability to generalize across complex transformations is a hallmark of human visual intelligence. Advances in understanding action recognition at the neural level have not always translated into precise accounts of the computational principles underlying what representations of action sequences are constructed by human visual cortex. Here we test the hypothesis that invariant action discrimination might fill this gap. Recently, the study of artificial systems for static object perception has produced models, Convolutional Neural Networks (CNNs), that achieve human level performance in complex discriminative tasks. Within this class, architectures that better support invariant object recognition also produce image representations that better match those implied by human and primate neural data. However, whether these models produce representations of action sequences that support recognition across complex transformations and closely follow neural representations of actions remains unknown. Here we show that spatiotemporal CNNs accurately categorize video stimuli into action classes, and that deliberate model modifications that improve performance on an invariant action recognition task lead to data representations that better match human neural recordings. Our results support our hypothesis that performance on invariant discrimination dictates the neural representations of actions computed in the brain. These results broaden the scope of the invariant recognition framework for understanding visual intelligence from perception of inanimate objects and faces in static images to the study of human perception of action sequences.
| S-EPMC5749869 | biostudies-literature
Project description:Retinal motion of the visual scene is not consciously perceived during ocular saccades in normal everyday conditions. It has been suggested that extra-retinal signals actively suppress intra-saccadic motion perception to preserve stable perception of the visual world. However, using stimuli optimized to preferentially activate the M-pathway, Castet and Masson (2000) demonstrated that motion can be perceived during a saccade. Based on this psychophysical paradigm, we used electroencephalography and eye-tracking recordings to investigate the neural correlates related to the conscious perception of intra-saccadic motion. We demonstrated the effective involvement during saccades of the cortical areas V1-V2 and MT-V5, which convey motion information along the M-pathway. We also showed that individual motion perception was related to retinal temporal frequency.
| S-EPMC8556557 | biostudies-literature
Project description:The visual system can compute summary statistics of several visual elements at a glance. Numerous studies have shown that an ensemble of different visual features can be perceived over 50-200 ms; however, the time point at which the visual system forms an accurate ensemble representation associated with an individual's perception remains unclear. This is mainly because most previous studies have not fully addressed time-resolved neural representations that occur during ensemble perception, particularly lacking quantification of the representational strength of ensembles and their correlation with behavior. Here, we conducted orientation ensemble discrimination tasks and electroencephalogram (EEG) recordings to decode orientation representations over time while human observers discriminated an average of multiple orientations. We modeled EEG signals as a linear sum of hypothetical orientation channel responses and inverted this model to quantify the representational strength of orientation ensemble. Our analysis using this inverted encoding model revealed stronger representations of the average orientation over 400-700 ms. We also correlated the orientation representation estimated from EEG signals with the perceived average orientation reported in the ensemble discrimination task with adjustment methods. We found that the estimated orientation at approximately 600-700 ms significantly correlated with the individual differences in perceived average orientation. These results suggest that although ensembles can be quickly and roughly computed, the visual system may gradually compute an orientation ensemble over several hundred milliseconds to achieve a more accurate ensemble representation.
| S-EPMC11325722 | biostudies-literature
Project description:Understanding how perception and action are coupled in the brain has important implications for training, rehabilitation, and brain-machine interfaces. Ideomotor theory postulates that willed actions are represented through previously experienced effects and initiated by the anticipation of those effects. Previous research has accordingly found that sensory events, if previously associated with action outcomes, can induce activity in motor regions. However, it remains unclear whether the motor-related activity induced during perception of more naturalistic sequences of actions actually represents "sequence-specific" information. In the present study, nonmusicians were firstly trained to play two melodies on the piano; secondly, they performed an fMRI experiment while listening to these melodies as well as novel, untrained melodies; thirdly, multivariate pattern analysis was used to test if voxel-wise patterns of brain activity could identify trained, but not novel melodies. The results importantly show that after associative learning, a series of sensory events can trigger sequence-specific representations in both sensory and motor networks. Interestingly, also novel melodies could be classified in multiple regions, including default mode regions. A control experiment confirmed these outcomes to be training-dependent. We discuss how action-perception coupling may enable spontaneous near transfer and action simulation during action observation.
| S-EPMC7472192 | biostudies-literature
Project description:Do people engaged in joint action form action plans that specify joint outcomes at the group level? EEG was recorded from pairs of participants who performed coordinated actions that could result in different postural configurations. To isolate individual and joint action planning processes, a pre-cue specified in advance the individual actions and/or the joint configuration. Participants had 1200?ms to prepare their actions. Then a Go cue specified all action parameters and participants performed a synchronized action as quickly as possible. Action onsets were shorter when the pre-cue specified the joint configuration, regardless of whether individual action was also specified. EEG analyses showed that specifying joint action parameters in advance reduced ambiguity in a structured joint action plan (reflected in the decrease of the amplitude of the P600) and helped with representing action goals and interpersonal coordination patterns in sensorimotor brain areas (reflected in increased alpha/mu suppression and CNV amplitudes). These results provide clear evidence that joint action is driven not only by action plans that specify individual contributions, but also by action plans that specify joint action outcomes at the group level.
| S-EPMC6667733 | biostudies-literature