Stable representation of a naturalistic movie emerges from episodic activity with gain variability.
Ontology highlight
ABSTRACT:
SUBMITTER: Xia J
PROVIDER: S-EPMC8397750 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Uncertainty is intrinsic to perception. Neural circuits which process sensory information must therefore also represent the reliability of this information. How they do so is a topic of debate. We propose a model of visual cortex in which average neural response strength encodes stimulus features, while cross-neuron variability in response gain encodes the uncertainty of these features. To test this model, we studied spiking activity of neurons in macaque V1 and V2 elicited by repeated presentations of stimuli whose uncertainty was manipulated in distinct ways. We show that gain variability of individual neurons is tuned to stimulus uncertainty, that this tuning is specific to the features encoded by these neurons and largely invariant to the source of uncertainty. We demonstrate that this behavior naturally arises from known gain-control mechanisms, and illustrate how downstream circuits can jointly decode stimulus features and their uncertainty from sensory population activity.
| S-EPMC7237668 | biostudies-literature
Project description:Episodic memories are long lasting and full of detail, yet imperfect and malleable. We quantitatively evaluated recollection of short audiovisual segments from movies as a proxy to real-life memory formation in 161 subjects at 15 minutes up to a year after encoding. Memories were reproducible within and across individuals, showed the typical decay with time elapsed between encoding and testing, were fallible yet accurate, and were insensitive to low-level stimulus manipulations but sensitive to high-level stimulus properties. Remarkably, memorability was also high for single movie frames, even one year post-encoding. To evaluate what determines the efficacy of long-term memory formation, we developed an extensive set of content annotations that included actions, emotional valence, visual cues and auditory cues. These annotations enabled us to document the content properties that showed a stronger correlation with recognition memory and to build a machine-learning computational model that accounted for episodic memory formation in single events for group averages and individual subjects with an accuracy of up to 80%. These results provide initial steps towards the development of a quantitative computational theory capable of explaining the subjective filtering steps that lead to how humans learn and consolidate memories.
| S-EPMC5043190 | biostudies-literature
Project description:While much has been learned regarding the neural substrates supporting episodic encoding using highly controlled experimental protocols, relatively little is known regarding the neural bases of episodic encoding of real-world events. In an effort to examine this issue, we measured fMRI activity while observers viewed a novel TV sitcom. Three weeks later, subsequent memory (SM) for the narrative content of movie events was assessed. We analyzed the encoding data for intersubject correlations (ISC) based on subjects' subsequent memory (ISC-SM) performance to identify brain regions whose BOLD response is significantly more correlated across subjects during portions of the movie that are successfully as compared to unsuccessfully encoded. These regions include the parahippocampal gyrus, superior temporal gyrus, anterior temporal poles, and the temporal-parietal junction. Further analyses reveal (1) that these correlated regions can display distinct activation profiles and (2) that the results seen with the ISC-SM analysis are complementary to more traditional linear models and allow analysis of complex time course data. Thus, the ISC-SM analysis extends traditional subsequent memory findings to a rich, dynamic and more ecologically valid situation.
| S-EPMC2789242 | biostudies-literature
Project description:Human eye blinking is cognitively suppressed to minimize loss of visual information for important real-world events. Despite the relationship between eye blinking and cognitive state, the effect of eye blinks on cognition in real-world environments has received limited research attention. In this study, we focused on the temporal pattern of inter-eye blink interval (IEBI) during movie watching and investigated its relationship with episodic memory. As a control condition, 24 healthy subjects watched a nature documentary that lacked a specific story line while electroencephalography was performed. Immediately after viewing the movie, the subjects were asked to report its most memorable scene. Four weeks later, subjects were asked to score 32 randomly selected scenes from the movie, based on how much they were able to remember and describe. The results showed that the average IEBI was significantly longer during the movie than in the control condition. In addition, the significant increase in IEBI when watching a movie coincided with the most memorable scenes of the movie. The results suggested that the interesting episodic narrative of the movie attracted the subjects' visual attention relative to the documentary clip that did not have a story line. In the episodic memory test executed four weeks later, memory performance was significantly positively correlated with IEBI (p<0.001). In summary, IEBI may be a reliable bio-marker of the degree of concentration on naturalistic content that requires visual attention, such as a movie.
| S-EPMC4631519 | biostudies-literature
Project description:Episodic memories are contextual experiences ordered in time. This is underpinned by associative binding between events within the same contexts. The role of prediction errors in declarative memory is well established but has not been investigated in the time dimension of complex episodic memories. Here we combine these two properties of episodic memory, extend them into the temporal domain and demonstrate that prediction errors in different naturalistic contexts lead to changes in the temporal ordering of event structures in them. The wrongly predicted older sequences were weakened despite their reactivation. Interestingly the newly encoded sequences with prediction errors, seen once, showed accuracy as high as control sequences which were viewed repeatedly without change. Drift-diffusion modelling revealed a lower decision threshold for the newer sequences than older sequences, reflected by their faster recall. Moreover, participants' adjustments to their decision threshold significantly correlated with their relative speed of sequence memory recall. These results suggest a temporally distinct and adaptive role for prediction errors in learning and reorganizing episodic temporal sequences.
| S-EPMC8196002 | biostudies-literature
Project description:Naturalistic stimuli evoke strong, consistent, and information-rich patterns of brain activity, and engage large extents of the human brain. They allow researchers to compare highly similar brain responses across subjects, and to study how complex representations are encoded in brain activity. Here, we describe and share a dataset where 25 subjects watched part of the feature film "The Grand Budapest Hotel" by Wes Anderson. The movie has a large cast with many famous actors. Throughout the story, the camera shots highlight faces and expressions, which are fundamental to understand the complex narrative of the movie. This movie was chosen to sample brain activity specifically related to social interactions and face processing. This dataset provides researchers with fMRI data that can be used to explore social cognitive processes and face processing, adding to the existing neuroimaging datasets that sample brain activity with naturalistic movies.
| S-EPMC7658985 | biostudies-literature
Project description:We introduce a novel and simple method for assessing audiences' emotional responses to audiovisuals (e.g. films). Viewers (N = 21) watched movies and TV commercials from different genres while wearing photoplethysmography (PPG) optic sensors on their wrists. Heart rate variability (HRV) synchrony was observed among the audience. Based on this between-subject synchrony measure, we identified emotionally arousing segments from the materials. New participants (N = 24; N = 16) were then invited to watch these identified segments along with some randomly selected segments as control; they reported that the former was more engaging (effect size w = .67; w = .5). This finding was confirmed in an online study with a larger cohort (N = 300). While some specific effects varied depending on movie genre or gender, HRV-based editing generally performed better than the control. These findings suggest that HRV synchrony can be used as a new tool for audience psychology, and potentially also for automatically creating short trailers out of movies in a principled manner while taking into account the human perspective.
| S-EPMC7904173 | biostudies-literature
Project description:Naturalistic stimuli like movies evoke complex perceptual processes, which are of great interest in the study of human cognition by functional MRI (fMRI). However, conventional fMRI analysis based on statistical parametric mapping (SPM) and the general linear model (GLM) is hampered by a lack of accurate parametric models of the BOLD response to complex stimuli. In this situation, statistical machine-learning methods, a.k.a. multivariate pattern analysis (MVPA), have received growing attention for their ability to generate stimulus response models in a data-driven fashion. However, machine-learning methods typically require large amounts of training data as well as computational resources. In the past, this has largely limited their application to fMRI experiments involving small sets of stimulus categories and small regions of interest in the brain. By contrast, the present study compares several classification algorithms known as Nearest Neighbor (NN), Gaussian Naïve Bayes (GNB), and (regularized) Linear Discriminant Analysis (LDA) in terms of their classification accuracy in discriminating the global fMRI response patterns evoked by a large number of naturalistic visual stimuli presented as a movie. Results show that LDA regularized by principal component analysis (PCA) achieved high classification accuracies, above 90% on average for single fMRI volumes acquired 2 s apart during a 300 s movie (chance level 0.7% = 2 s/300 s). The largest source of classification errors were autocorrelations in the BOLD signal compounded by the similarity of consecutive stimuli. All classifiers performed best when given input features from a large region of interest comprising around 25% of the voxels that responded significantly to the visual stimulus. Consistent with this, the most informative principal components represented widespread distributions of co-activated brain regions that were similar between subjects and may represent functional networks. In light of these results, the combination of naturalistic movie stimuli and classification analysis in fMRI experiments may prove to be a sensitive tool for the assessment of changes in natural cognitive processes under experimental manipulation.
| S-EPMC4815557 | biostudies-literature
Project description:All animals must transform ambiguous sensory data into successful behavior. This requires sensory representations that accurately reflect the statistics of natural stimuli and behavior. Multiple studies show that visual motion processing is tuned for accuracy under naturalistic conditions, but the sensorimotor circuits extracting these cues and implementing motion-guided behavior remain unclear. Here we show that the larval zebrafish retina extracts a diversity of naturalistic motion cues, and the retinorecipient pretectum organizes these cues around the elements of behavior. We find that higher-order motion stimuli, gliders, induce optomotor behavior matching expectations from natural scene analyses. We then image activity of retinal ganglion cell terminals and pretectal neurons. The retina exhibits direction-selective responses across glider stimuli, and anatomically clustered pretectal neurons respond with magnitudes matching behavior. Peripheral computations thus reflect natural input statistics, whereas central brain activity precisely codes information needed for behavior. This general principle could organize sensorimotor transformations across animal species.
| S-EPMC7314654 | biostudies-literature
Project description:We investigated whether dogs remember their spontaneous past actions relying on episodic-like memory. Dogs were trained to repeat a small set of actions upon request. Then we tested them on their ability to repeat other actions produced by themselves, including actions performed spontaneously in everyday situations. Dogs repeated their own actions after delays ranging from a few seconds to 1?hour, with their performance showing a decay typical of episodic memory. The combined evidence of representing own actions and using episodic-like memory to recall them suggests a far more complex representation of a key feature of the self than previously attributed to dogs. Our method is applicable to various species, paving the way for comparative investigations on the evolution and complexity of self-representation.
| S-EPMC7320188 | biostudies-literature