Accurate Decoding of Imagined and Heard Melodies.
Ontology highlight
ABSTRACT:
SUBMITTER: Di Liberto GM
PROVIDER: S-EPMC8375770 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Music is commonly used to facilitate or support movement, and increasingly used in movement rehabilitation. Additionally, there is some evidence to suggest that music imagery, which is reported to lead to brain signatures similar to music perception, may also assist movement. However, it is not yet known whether either imagined or musical cueing changes the way in which the motor system of the human brain is activated during simple movements. Here, functional magnetic resonance imaging was used to compare neural activity during wrist flexions performed to either heard or imagined music with self-pacing of the same movement without any cueing. Focusing specifically on the motor network of the brain, analyses were performed within a mask of BA4, BA6, the basal ganglia (putamen, caudate, and pallidum), the motor nuclei of the thalamus, and the whole cerebellum. Results revealed that moving to music compared with self-paced movement resulted in significantly increased activation in left cerebellum VI. Moving to imagined music led to significantly more activation in pre-supplementary motor area (pre-SMA) and right globus pallidus, relative to self-paced movement. When the music and imagery cueing conditions were contrasted directly, movements in the music condition showed significantly more activity in left hemisphere cerebellum VII and right hemisphere and vermis of cerebellum IX, while the imagery condition revealed more significant activity in pre-SMA. These results suggest that cueing movement with actual or imagined music impacts upon engagement of motor network regions during the movement, and suggest that heard and imagined cues can modulate movement in subtly different ways. These results may have implications for the applicability of auditory cueing in movement rehabilitation for different patient populations.
| S-EPMC4176038 | biostudies-literature
Project description:Object recognition is a key function in both human and machine vision. While brain decoding of seen and imagined objects has been achieved, the prediction is limited to training examples. We present a decoding approach for arbitrary objects using the machine vision principle that an object category is represented by a set of features rendered invariant through hierarchical processing. We show that visual features, including those derived from a deep convolutional neural network, can be predicted from fMRI patterns, and that greater accuracy is achieved for low-/high-level features with lower-/higher-level visual areas, respectively. Predicted features are used to identify seen/imagined object categories (extending beyond decoder training) from a set of computed features for numerous object images. Furthermore, decoding of imagined objects reveals progressive recruitment of higher-to-lower visual representations. Our results demonstrate a homology between human and machine vision and its utility for brain-based information retrieval.
| S-EPMC5458127 | biostudies-literature
Project description:Several stories in the popular media have speculated that it may be possible to infer from the brain which word a person is speaking or even thinking. While recent studies have demonstrated that brain signals can give detailed information about actual and imagined actions, such as different types of limb movements or spoken words, concrete experimental evidence for the possibility to 'read the mind', i.e. to interpret internally-generated speech, has been scarce. In this study, we found that it is possible to use signals recorded from the surface of the brain (electrocorticography) to discriminate the vowels and consonants embedded in spoken and in imagined words, and we defined the cortical areas that held the most information about discrimination of vowels and consonants. The results shed light on the distinct mechanisms associated with production of vowels and consonants, and could provide the basis for brain-based communication using imagined speech.
| S-EPMC3772685 | biostudies-literature
Project description:Classification of electroencephalography (EEG) signals corresponding to imagined speech production is important for the development of a direct-speech brain-computer interface (DS-BCI). Deep learning (DL) has been utilized with great success across several domains. However, it remains an open question whether DL methods provide significant advances over traditional machine learning (ML) approaches for classification of imagined speech. Furthermore, hyperparameter (HP) optimization has been neglected in DL-EEG studies, resulting in the significance of its effects remaining uncertain. In this study, we aim to improve classification of imagined speech EEG by employing DL methods while also statistically evaluating the impact of HP optimization on classifier performance. We trained three distinct convolutional neural networks (CNN) on imagined speech EEG using a nested cross-validation approach to HP optimization. Each of the CNNs evaluated was designed specifically for EEG decoding. An imagined speech EEG dataset consisting of both words and vowels facilitated training on both sets independently. CNN results were compared with three benchmark ML methods: Support Vector Machine, Random Forest and regularized Linear Discriminant Analysis. Intra- and inter-subject methods of HP optimization were tested and the effects of HPs statistically analyzed. Accuracies obtained by the CNNs were significantly greater than the benchmark methods when trained on both datasets (words: 24.97%, p < 1 × 10-7, chance: 16.67%; vowels: 30.00%, p < 1 × 10-7, chance: 20%). The effects of varying HP values, and interactions between HPs and the CNNs were both statistically significant. The results of HP optimization demonstrate how critical it is for training CNNs to decode imagined speech.
| S-EPMC7472624 | biostudies-literature
Project description:Background: Realization of online control of an artificial or virtual arm using information decoded from EEG normally occurs by classifying different activation states or voluntary modulation of the sensorimotor activity linked to different overt actions of the subject. However, using a more natural control scheme, such as decoding the trajectory of imagined 3D arm movements to move a prosthetic, robotic, or virtual arm has been reported in a limited amount of studies, all using offline feed-forward control schemes. Objective: In this study, we report the first attempt to realize online control of two virtual arms generating movements toward three targets/arm in 3D space. The 3D trajectory of imagined arm movements was decoded from power spectral density of mu, low beta, high beta, and low gamma EEG oscillations using multiple linear regression. The analysis was performed on a dataset recorded from three subjects in seven sessions wherein each session comprised three experimental blocks: an offline calibration block and two online feedback blocks. Target classification accuracy using predicted trajectories of the virtual arms was computed and compared with results of a filter-bank common spatial patterns (FBCSP) based multi-class classification method involving mutual information (MI) selection and linear discriminant analysis (LDA) modules. Main Results: Target classification accuracy from predicted trajectory of imagined 3D arm movements in the offline runs for two subjects (mean 45%, std 5%) was significantly higher (p < 0.05) than chance level (33.3%). Nevertheless, the accuracy during real-time control of the virtual arms using the trajectory decoded directly from EEG was in the range of chance level (33.3%). However, the results of two subjects show that false-positive feedback may increase the accuracy in closed-loop. The FBCSP based multi-class classification method distinguished imagined movements of left and right arm with reasonable accuracy for two of the three subjects (mean 70%, std 5% compared to 50% chance level). However, classification of the imagined arm movement toward three targets was not successful with the FBCSP classifier as the achieved accuracy (mean 33%, std 5%) was similar to the chance level (33.3%). Sub-optimal components of the multi-session experimental paradigm were identified, and an improved paradigm proposed.
| S-EPMC6868122 | biostudies-literature
Project description:Bacterial transfer RNAs (tRNAs) contain evolutionarily conserved sequences and modifications that ensure uniform binding to the ribosome and optimal translational accuracy despite differences in their aminoacyl attachments and anticodon nucleotide sequences. In the tRNA anticodon stem-loop, the anticodon sequence is correlated with a base pair in the anticodon loop (nucleotides 32 and 38) to tune the binding of each tRNA to the decoding center in the ribosome. Disruption of this correlation renders the ribosome unable to distinguish correct from incorrect tRNAs. The molecular basis for how these two tRNA features combine to ensure accurate decoding is unclear. Here, we solved structures of the bacterial ribosome containing either wild-type [Formula: see text] or [Formula: see text] containing a reversed 32-38 pair on cognate and near-cognate codons. Structures of wild-type [Formula: see text] bound to the ribosome reveal 23S ribosomal RNA (rRNA) nucleotide A1913 positional changes that are dependent on whether the codon-anticodon interaction is cognate or near cognate. Further, the 32-38 pair is destabilized in the context of a near-cognate codon-anticodon pair. Reversal of the pairing in [Formula: see text] ablates A1913 movement regardless of whether the interaction is cognate or near cognate. These results demonstrate that disrupting 32-38 and anticodon sequences alters interactions with the ribosome that directly contribute to misreading.
| S-EPMC7368331 | biostudies-literature
Project description:Aminoacyl-tRNA synthetases attach specific amino acids to cognate tRNAs. Prolyl-tRNA synthetases are known to mischarge tRNA(Pro) with the smaller amino acid alanine and with cysteine, which is the same size as proline. Quality control in proline codon translation is partly ensured by an editing domain (INS) present in most bacterial prolyl-tRNA synthetases that hydrolyzes smaller Ala-tRNA(Pro) and excludes Pro-tRNA(Pro). In contrast, Cys-tRNA(Pro) is cleared by a freestanding INS domain homolog, YbaK. Here, we have investigated the molecular mechanism of catalysis and substrate recognition by Hemophilus influenzae YbaK using site-directed mutagenesis, enzymatic assays of isosteric substrates and functional group analogs, and computational modeling. These studies together with mass spectrometric characterization of the YbaK-catalyzed reaction products support a novel substrate-assisted mechanism of Cys-tRNA(Pro) deacylation that prevents nonspecific Pro-tRNA(Pro) hydrolysis. Collectively, we propose that the INS and YbaK domains co-evolved distinct mechanisms involving steric exclusion and thiol-specific chemistry, respectively, to ensure accurate decoding of proline codons.
| S-EPMC3173103 | biostudies-literature
Project description:Objective: To date, motion trajectory prediction (MTP) of a limb from non-invasive electroencephalography (EEG) has relied, primarily, on band-pass filtered samples of EEG potentials i.e., the potential time-series model. Most MTP studies involve decoding 2D and 3D arm movements i.e., executed arm movements. Decoding of observed or imagined 3D movements has been demonstrated with limited success and only reported in a few studies. MTP studies normally use EEG potentials filtered in the low delta (~1 Hz) band for reconstructing the trajectory of an executed or an imagined/observed movement. In contrast to MTP, multiclass classification based sensorimotor rhythm brain-computer interfaces aim to classify movements using the power spectral density of mu (8-12 Hz) and beta (12-28 Hz) bands. Approach: We investigated if replacing the standard potentials time-series input with a power spectral density based bandpower time-series improves trajectory decoding accuracy of kinesthetically imagined 3D hand movement tasks (i.e., imagined 3D trajectory of the hand joint) and whether imagined 3D hand movements kinematics are encoded also in mu and beta bands. Twelve naïve subjects were asked to generate or imagine generating pointing movements with their right dominant arm to four targets distributed in 3D space in synchrony with an auditory cue (beep). Main results: Using the bandpower time-series based model, the highest decoding accuracy for motor execution was observed in mu and beta bands whilst for imagined movements the low gamma (28-40 Hz) band was also observed to improve decoding accuracy for some subjects. Moreover, for both (executed and imagined) movements, the bandpower time-series model with mu, beta, and low gamma bands produced significantly higher reconstruction accuracy than the commonly used potential time-series model and delta oscillations. Significance: Contrary to many studies that investigated only executed hand movements and recommend using delta oscillations for decoding directional information of a single limb joint, our findings suggest that motor kinematics for imagined movements are reflected mostly in power spectral density of mu, beta and low gamma bands, and that these bands may be most informative for decoding 3D trajectories of imagined limb movements.
| S-EPMC5869206 | biostudies-literature
Project description:Cells sense external concentrations and, via biochemical signaling, respond by regulating the expression of target proteins. Both in signaling networks and gene regulation there are two main mechanisms by which the concentration can be encoded internally: amplitude modulation (AM), where the absolute concentration of an internal signaling molecule encodes the stimulus, and frequency modulation (FM), where the period between successive bursts represents the stimulus. Although both mechanisms have been observed in biological systems, the question of when it is beneficial for cells to use either AM or FM is largely unanswered. Here, we first consider a simple model for a single receptor (or ion channel), which can either signal continuously whenever a ligand is bound, or produce a burst in signaling molecule upon receptor binding. We find that bursty signaling is more accurate than continuous signaling only for sufficiently fast dynamics. This suggests that modulation based on bursts may be more common in signaling networks than in gene regulation. We then extend our model to multiple receptors, where continuous and bursty signaling are equivalent to AM and FM respectively, finding that AM is always more accurate. This implies that the reason some cells use FM is related to factors other than accuracy, such as the ability to coordinate expression of multiple genes or to implement threshold crossing mechanisms.
| S-EPMC4452646 | biostudies-literature
Project description:The smellscape is the olfactory environment as perceived and understood, consisting of odours and scents from multiple smell sources. To what extent can audiovisual information evoke the smells of a real, complex, and multimodal environment? To investigate smellscape imagination, we compared results from two studies. In the first, onsite participants (N = 15) made a sensory walk through seven locations of an open-air market. In the second, online participants (N = 53) made a virtual walk through the same locations reproduced with audio and video recordings. Responses in the form of free-form verbal annotations, ratings with semantic scales, and a 'smell wheel', were analysed for environmental quality, smell source type and strength, and hedonic tone. The degree of association between real and imagined smellscapes was measured through canonical correlation analysis. Hedonic tone, as expressed through frequency counts of keywords in free-form annotations was significantly associated, suggesting that smell sources might generally be correctly inferred from audiovisual information, when such imagination is required. On the other hand, onsite ratings of olfactory quality were not significantly associated with online ratings of audiovisual reproductions, when participants were not specifically asked to imagine smells. We discuss findings in the light of cross-modal association, categorisation, and memory recall of smells.
| S-EPMC8740324 | biostudies-literature