High spectro-temporal compression on a nonlinear CMOS-chip.
Ontology highlight
ABSTRACT:
SUBMITTER: Choi JW
PROVIDER: S-EPMC8211677 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Multi-electrode arrays, both active or passive, emerged as ideal technologies to unveil intricated electrophysiological dynamics of cells and tissues. Active MEAs, designed using complementary metal oxide semiconductor technology (CMOS), stand over passive devices thanks to the possibility of achieving single-cell resolution, the reduced electrode size, the reduced crosstalk and the higher functionality and portability. Nevertheless, most of the reported CMOS MEA systems mainly rely on a single operational modality, which strongly hampers the applicability range of a single device. This can be a limiting factor considering that most biological and electrophysiological dynamics are often based on the synergy of multiple and complex mechanisms acting from different angles on the same phenomena. Here, we designed a CMOS MEA chip with 16,384 titanium nitride electrodes, 6 independent operational modalities and 1,024 parallel recording channels for neuro-electrophysiological studies. Sixteen independent active areas are patterned on the chip surface forming a 4 × 4 matrix, each one including 1,024 electrodes. Electrodes of four different sizes are present on the chip surface, ranging from 2.5 × 3.5 ?m2 up to 11 × 11.0 ?m2, with 15 ?m pitch. In this paper, we exploited the impedance monitoring and voltage recording modalities not only to monitor the growth and development of primary rat hippocampal neurons, but also to assess their electrophysiological activity over time showing a mean spike amplitude of 144.8 ± 84.6 ?V. Fixed frequency (1 kHz) and high sampling rate (30 kHz) impedance measurements were used to evaluate the cellular adhesion and growth on the chip surface. Thanks to the high-density configuration of the electrodes, as well as their dimension and pitch, the chip can appreciate the evolutions of the cell culture morphology starting from the moment of the seeding up to mature culture conditions. The measurements were confirmed by fluorescent staining. The effect of the different electrode sizes on the spike amplitudes and noise were also discussed. The multi-modality of the presented CMOS MEA allows for the simultaneous assessment of different physiological properties of the cultured neurons. Therefore, it can pave the way both to answer complex fundamental neuroscience questions as well as to aid the current drug-development paradigm.
| S-EPMC6603149 | biostudies-literature
Project description:Temporal variability of neuronal response characteristics during sensory stimulation is a ubiquitous phenomenon that may reflect processes such as stimulus-driven adaptation, top-down modulation or spontaneous fluctuations. It poses a challenge to functional characterization methods such as the receptive field, since these often assume stationarity. We propose a novel method for estimation of sensory neurons' receptive fields that extends the classic static linear receptive field model to the time-varying case. Here, the long-term estimate of the static receptive field serves as the mean of a probabilistic prior distribution from which the short-term temporally localized receptive field may deviate stochastically with time-varying standard deviation. The derived corresponding generalized linear model permits robust characterization of temporal variability in receptive field structure also for highly non-Gaussian stimulus ensembles. We computed and analyzed short-term auditory spectro-temporal receptive field (STRF) estimates with characteristic temporal resolution 5-30 s based on model simulations and responses from in total 60 single-unit recordings in anesthetized Mongolian gerbil auditory midbrain and cortex. Stimulation was performed with short (100 ms) overlapping frequency-modulated tones. Results demonstrate identification of time-varying STRFs, with obtained predictive model likelihoods exceeding those from baseline static STRF estimation. Quantitative characterization of STRF variability reveals a higher degree thereof in auditory cortex compared to midbrain. Cluster analysis indicates that significant deviations from the long-term static STRF are brief, but reliably estimated. We hypothesize that the observed variability more likely reflects spontaneous or state-dependent internal fluctuations that interact with stimulus-induced processing, rather than experimental or stimulus design.
| S-EPMC4274980 | biostudies-literature
Project description:All-optical circuits for computing and information processing could overcome the speed limitations intrinsic to electronics. However, in photonics, very few fundamental 'building blocks' equivalent to those used in multi-functional electronic circuits exist. In this study, we report the first all-optical temporal integrator in a monolithic, integrated platform. Our device--a lightwave 'capacitor-like' element based on a passive micro-ring resonator--performs the time integral of the complex field of an arbitrary optical waveform with a time resolution of a few picoseconds, corresponding to a processing speed of ∼200 GHz, and a 'hold' time approaching a nanosecond. This device, compatible with electronic technology (complementary metal-oxide semiconductor), will be one of the building blocks of next-generation ultrafast data-processing technology, enabling optical memories and real-time differential equation computing units.
| S-EPMC2982162 | biostudies-other
Project description:Lexical access during speech comprehension comprises numerous computations, including activation, competition, and selection. The spatio-temporal profile of these processes involves neural activity in peri-auditory cortices at least as early as 200 ms after stimulation. Their oscillatory dynamics are less well understood, although reports link alpha band de-synchronization with lexical processing. We used magnetoencephalography (MEG) to examine whether these alpha-related oscillations reflect the speed of lexical access, as would be predicted if they index lexical activation. In an auditory semantic priming protocol, monosyllabic nouns were presented while participants performed a lexical decision task. Spatially-localizing beamforming was used to examine spectro-temporal effects in left and right auditory cortex time-locked to target word onset. Alpha and beta de-synchronization (10-20 Hz ERD) was attenuated for words following a related prime compared to an unrelated prime beginning about 270 ms after stimulus onset. This timing is consistent with how information about word identity unfolds incrementally in speech, quantified in information-theoretic terms. These findings suggest that alpha de-synchronization during auditory word processing is associated with early stages of lexical access.
| S-EPMC4104786 | biostudies-literature
Project description:The auditory system extracts behaviorally relevant information from acoustic stimuli. The average activity in auditory cortex is known to be sensitive to spectro-temporal patterns in sounds. However, it is not known whether the auditory cortex also processes more abstract features of sounds, which may be more behaviorally relevant than spectro-temporal patterns. Using recordings from three stations of the auditory pathway, the inferior colliculus (IC), the ventral division of the medial geniculate body (MGB) of the thalamus, and the primary auditory cortex (A1) of the cat in response to natural sounds, we compared the amount of information that spikes contained about two aspects of the stimuli: spectro-temporal patterns, and abstract entities present in the same stimuli such as a bird chirp, its echoes, and the ambient noise. IC spikes conveyed on average approximately the same amount of information about spectro-temporal patterns as they conveyed about abstract auditory entities, but A1 and the MGB neurons conveyed on average three times more information about abstract auditory entities than about spectro-temporal patterns. Thus, the majority of neurons in auditory thalamus and cortex coded well the presence of abstract entities in the sounds without containing much information about their spectro-temporal structure, suggesting that they are sensitive to abstract features in these sounds.
| S-EPMC3503225 | biostudies-literature
Project description:Are visual and auditory stimuli processed by similar mechanisms in the human cerebral cortex? Images can be thought of as light energy modulations over two spatial dimensions, and low-level visual areas analyze images by decomposition into spatial frequencies. Similarly, sounds are energy modulations over time and frequency, and they can be identified and discriminated by the content of such modulations. An obvious question is therefore whether human auditory areas, in direct analogy to visual areas, represent the spectro-temporal modulation content of acoustic stimuli. To answer this question, we measured spectro-temporal modulation transfer functions of single voxels in the human auditory cortex with functional magnetic resonance imaging. We presented dynamic ripples, complex broadband stimuli with a drifting sinusoidal spectral envelope. Dynamic ripples are the auditory equivalent of the gratings often used in studies of the visual system. We demonstrate selective tuning to combined spectro-temporal modulations in the primary and secondary auditory cortex. We describe several types of modulation transfer functions, extracting different spectro-temporal features, with a high degree of interaction between spectral and temporal parameters. The overall low-pass modulation rate preference of the cortex matches the modulation content of natural sounds. These results demonstrate that combined spectro-temporal modulations are represented in the human auditory cortex, and suggest that complex signals are decomposed and processed according to their modulation content, the same transformation used by the visual system.
| S-EPMC2732853 | biostudies-other
Project description:Neural processing of sounds in the dorsal and ventral streams of the (human) auditory cortex is optimized for analyzing fine-grained temporal and spectral information, respectively. Here we use a Wilson and Cowan firing-rate modeling framework to simulate spectro-temporal processing of sounds in these auditory streams and to investigate the link between neural population activity and behavioral results of psychoacoustic experiments. The proposed model consisted of two core (A1 and R, representing primary areas) and two belt (Slow and Fast, representing rostral and caudal processing respectively) areas, differing in terms of their spectral and temporal response properties. First, we simulated the responses to amplitude modulated (AM) noise and tones. In agreement with electrophysiological results, we observed an area-dependent transition from a temporal (synchronization) to a rate code when moving from low to high modulation rates. Simulated neural responses in a task of amplitude modulation detection suggested that thresholds derived from population responses in core areas closely resembled those of psychoacoustic experiments in human listeners. For tones, simulated modulation threshold functions were found to be dependent on the carrier frequency. Second, we simulated the responses to complex tones with missing fundamental stimuli and found that synchronization of responses in the Fast area accurately encoded pitch, with the strength of synchronization depending on number and order of harmonic components. Finally, using speech stimuli, we showed that the spectral and temporal structure of the speech was reflected in parallel by the modeled areas. The analyses highlighted that the Slow stream coded with high spectral precision the aspects of the speech signal characterized by slow temporal changes (e.g., prosody), while the Fast stream encoded primarily the faster changes (e.g., phonemes, consonants, temporal pitch). Interestingly, the pitch of a speaker was encoded both spatially (i.e., tonotopically) in Slow area and temporally in Fast area. Overall, performed simulations showed that the model is valuable for generating hypotheses on how the different cortical areas/streams may contribute toward behaviorally relevant aspects of auditory processing. The model can be used in combination with physiological models of neurovascular coupling to generate predictions for human functional MRI experiments.
| S-EPMC6987265 | biostudies-literature
Project description:Real-time optical spectrum analysis is an essential tool in observing ultrafast phenomena, such as the dynamic monitoring of spectrum evolution. However, conventional method such as optical spectrum analyzers disperse the spectrum in space and allocate it in time sequence by mechanical rotation of a grating, so are incapable of operating at high speed. A more recent method all-optically stretches the spectrum in time domain, but is limited by the allowable input condition. In view of these constraints, here we present a real-time spectrum analyzer called parametric spectro-temporal analyzer (PASTA), which is based on the time-lens focusing mechanism. It achieves a frame rate as high as 100 MHz and accommodates various input conditions. As a proof of concept and also for the first time, we verify its applications in observing the dynamic spectrum of a Fourier domain mode-locked laser, and the spectrum evolution of a laser cavity during its stabilizing process.
| S-EPMC3690390 | biostudies-other
Project description:We previously characterized the steady-state spectro-temporal tuning properties of cortical cells with respect to broadband sounds by using sounds with sinusoidal spectro-temporal modulation envelope where spectral density and temporal periodicity were constant over several seconds. However, since speech and other natural sounds have spectro-temporal features that change substantially over milliseconds, we study the dynamics of tuning by using stimuli of constant overall intensity, but alternating between a flat spectro-temporal envelope and a modulated envelope with well defined spectral density and temporal periodicity. This allows us to define the tuning of cortical cells to speech-like and other rapid transitions, on the order of milliseconds, as well as the time evolution of this tuning in response to the appearance of new features in a sound. Responses of 92 cells in AI were analyzed based on the temporal evolution of the following measures of tuning after a rapid transition in the stimulus: center of mass and breadth of tuning; separability and direction selectivity; temporal and spectral asymmetry. We find that tuning center of mass increased in 70% of cells for spectral density and in 68% of cells for temporal periodicity, while roughly half of cells (47%) broadened their tuning, with the other half (53%) sharpening tuning. The majority of cells (73%) were initially not direction selective, as measured by an inseparability index, which had an initial low value that then increased to a higher steady state value. Most cells were characterized by temporal symmetry, while spectral symmetry was initially high and then progressed to low steady-state values (61%). We demonstrate that cortical neurons can be characterized by a lag-dependent modulation transfer function. This characterization, when measured through to steady-state, becomes equivalent to the classical spectro-temporal receptive field.
| S-EPMC2808190 | biostudies-literature
Project description:Psychophysical tests of spectro-temporal resolution may aid the evaluation of methods for improving hearing by cochlear implant (CI) listeners. Here the STRIPES (Spectro-Temporal Ripple for Investigating Processor EffectivenesS) test is described and validated. Like speech, the test requires both spectral and temporal processing to perform well. Listeners discriminate between complexes of sine sweeps which increase or decrease in frequency; difficulty is controlled by changing the stimulus spectro-temporal density. Care was taken to minimize extraneous cues, forcing listeners to perform the task only on the direction of the sweeps. Vocoder simulations with normal hearing listeners showed that the STRIPES test was sensitive to the number of channels and temporal information fidelity. An evaluation with CI listeners compared a standard processing strategy with one having very wide filters, thereby spectrally blurring the stimulus. Psychometric functions were monotonic for both strategies and five of six participants performed better with the standard strategy. An adaptive procedure revealed significant differences, all in favour of the standard strategy, at the individual listener level for six of eight CI listeners. Subsequent measures validated a faster version of the test, and showed that STRIPES could be performed by recently implanted listeners having no experience of psychophysical testing.
| S-EPMC6805218 | biostudies-literature