Browse
Submit Data
Databases
API
Help

Dataset Information

17 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Event-Based Tone Mapping for Asynchronous Time-Based Image Sensor.

ABSTRACT: The asynchronous time-based neuromorphic image sensor ATIS is an array of autonomously operating pixels able to encode luminance information with an exceptionally high dynamic range (>143 dB). This paper introduces an event-based methodology to display data from this type of event-based imagers, taking into account the large dynamic range and high temporal accuracy that go beyond available mainstream display technologies. We introduce an event-based tone mapping methodology for asynchronously acquired time encoded gray-level data. A global and a local tone mapping operator are proposed. Both are designed to operate on a stream of incoming events rather than on time frame windows. Experimental results on real outdoor scenes are presented to evaluate the performance of the tone mapping operators in terms of quality, temporal stability, adaptation capability, and computational time.

SUBMITTER: Simon Chane C

PROVIDER: S-EPMC5015463 | biostudies-literature | 2016

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Event-Based Tone Mapping for Asynchronous Time-Based Image Sensor.

Simon Chane Camille C Ieng Sio-Hoi SH Posch Christoph C Benosman Ryad B RB

Frontiers in neuroscience 20160831

The asynchronous time-based neuromorphic image sensor ATIS is an array of autonomously operating pixels able to encode luminance information with an exceptionally high dynamic range (>143 dB). This paper introduces an event-based methodology to display data from this type of event-based imagers, taking into account the large dynamic range and high temporal accuracy that go beyond available mainstream display technologies. We introduce an event-based tone mapping methodology for asynchronously ac ...[more]

PMID: 27642275

Similar Datasets

Event-Driven Data Gathering in Pure Asynchronous Multi-Hop Underwater Acoustic Sensor Networks.

Project description:In underwater acoustic modem design, pure asynchrony can contribute to improved wake-up coordination, thus avoiding energy-inefficient synchronization mechanisms. Nodes are designed with a pre-receptor and an acoustically adapted Radio Frequency Identification system, which wakes up the node when it receives an external tone. The facts that no synchronism protocol is necessary and that the time between waking up and packet reception is narrow make pure asynchronism highly efficient for energy saving. However, handshaking in the Medium Control Access layer must be adapted to maintain the premise of pure asynchronism. This paper explores different models to carry out this type of adaptation, comparing them via simulation in ns-3. Moreover, because energy saving is highly important to data gathering driven by underwater vehicles, where nodes can spend long periods without connection, this paper is focused on multi-hop topologies. When a vehicle appears in a 3D scenario, it is expected to gather as much information as possible in the minimum amount of time. Vehicle appearance is the event that triggers the gathering process, not only from the nearest nodes but from every node in the 3D volume. Therefore, this paper assumes, as a requirement, a topology of at least three hops. The results show that classic handshaking will perform better than tone reservation because hidden nodes annulate the positive effect of channel reservation. However, in highly dense networks, a combination model with polling will shorten the gathering time.

| S-EPMC7085773 | biostudies-literature

A Noise Filtering Algorithm for Event-Based Asynchronous Change Detection Image Sensors on TrueNorth and Its Implementation on TrueNorth.

Project description:Asynchronous event-based sensors, or "silicon retinae," are a new class of vision sensors inspired by biological vision systems. The output of these sensors often contains a significant number of noise events along with the signal. Filtering these noise events is a common preprocessing step before using the data for tasks such as tracking and classification. This paper presents a novel spiking neural network-based approach to filtering noise events from data captured by an Asynchronous Time-based Image Sensor on a neuromorphic processor, the IBM TrueNorth Neurosynaptic System. The significant contribution of this work is that it demonstrates our proposed filtering algorithm outperforms the traditional nearest neighbor noise filter in achieving higher signal to noise ratio (~10 dB higher) and retaining the events related to signal (~3X more). In addition, for our envisioned application of object tracking and classification under some parameter settings, it can also generate some of the missing events in the spatial neighborhood of the signal for all classes of moving objects in the data which are unattainable using the nearest neighbor filter.

| S-EPMC5844986 | biostudies-literature

Real-time quasi-distributed fiber optic sensor based on resonance frequency mapping.

Project description:Distributed optical fiber sensors (DOFS) based on Raman, Brillouin, and Rayleigh scattering have recently attracted considerable attention for various sensing applications, especially large-scale monitoring, owing to their capacity for measuring strain or temperature distributions. However, ultraweak backscatter signals within optical fibers constitute an inevitable problem for DOFS, thereby increasing the burden on the entire system in terms of limited spatial resolution, low measurement speed, high system complexity, or high cost. We propose a novel resonance frequency mapping for a real-time quasi-distributed fiber optic sensor based on identical weak fiber Bragg gratings (FBG), which has stronger reflection signals and high sensitivity to multiple sensing parameters. The resonance configuration, which amplifies optical signals during multiple round-trip propagations, can simply and efficiently address the intrinsic problems in conventional single round-trip measurements for identical weak FBG sensors, such as crosstalk and optical power depletion. Moreover, it is technically feasible to perform individual measurements for a large number of quasi-distributed identical weak FBGs with relatively high signal-to-noise ratio (SNR), low crosstalk, and low optical power depletion. By mapping the resonance frequency spectrum, the dynamic response of each identical weak FBG is rapidly acquired in the order of kilohertz, and direct interrogation in real time is possible without time-consuming computation, such as fast Fourier transformation (FFT). This resonance frequency spectrum is obtained on the basis of an all-fiber electro-optic configuration that allows simultaneous measurement of quasi-distributed strain responses with high speed (>5 kHz), high stability (~2.4 με), and high linearity (R2 = 0.9999).

| S-EPMC6408579 | biostudies-literature

Robotic goalie with 3 ms reaction time at 4% CPU load using event-based dynamic vision sensor.

Project description:Conventional vision-based robotic systems that must operate quickly require high video frame rates and consequently high computational costs. Visual response latencies are lower-bound by the frame period, e.g., 20 ms for 50 Hz frame rate. This paper shows how an asynchronous neuromorphic dynamic vision sensor (DVS) silicon retina is used to build a fast self-calibrating robotic goalie, which offers high update rates and low latency at low CPU load. Independent and asynchronous per pixel illumination change events from the DVS signify moving objects and are used in software to track multiple balls. Motor actions to block the most "threatening" ball are based on measured ball positions and velocities. The goalie also sees its single-axis goalie arm and calibrates the motor output map during idle periods so that it can plan open-loop arm movements to desired visual locations. Blocking capability is about 80% for balls shot from 1 m from the goal even with the fastest-shots, and approaches 100% accuracy when the ball does not beat the limits of the servo motor to move the arm to the necessary position in time. Running with standard USB buses under a standard preemptive multitasking operating system (Windows), the goalie robot achieves median update rates of 550 Hz, with latencies of 2.2 ± 2 ms from ball movement to motor command at a peak CPU load of less than 4%. Practical observations and measurements of USB device latency are provided.

| S-EPMC3836084 | biostudies-other

Event-Based Color Segmentation With a High Dynamic Range Sensor.

Project description:This paper introduces a color asynchronous neuromorphic event-based camera and a methodology to process color output from the device to perform color segmentation and tracking at the native temporal resolution of the sensor (down to one microsecond). Our color vision sensor prototype is a combination of three Asynchronous Time-based Image Sensors, sensitive to absolute color information. We devise a color processing algorithm leveraging this information. It is designed to be computationally cheap, thus showing how low level processing benefits from asynchronous acquisition and high temporal resolution data. The resulting color segmentation and tracking performance is assessed both with an indoor controlled scene and two outdoor uncontrolled scenes. The tracking's mean error to the ground truth for the objects of the outdoor scenes ranges from two to twenty pixels.

| S-EPMC5904265 | biostudies-literature

ESPEE: Event-Based Sensor Pose Estimation Using an Extended Kalman Filter.

Project description:Event-based vision sensors show great promise for use in embedded applications requiring low-latency passive sensing at a low computational cost. In this paper, we present an event-based algorithm that relies on an Extended Kalman Filter for 6-Degree of Freedom sensor pose estimation. The algorithm updates the sensor pose event-by-event with low latency (worst case of less than 2 μs on an FPGA). Using a single handheld sensor, we test the algorithm on multiple recordings, ranging from a high contrast printed planar scene to a more natural scene consisting of objects viewed from above. The pose is accurately estimated under rapid motions, up to 2.7 m/s. Thereafter, an extension to multiple sensors is described and tested, highlighting the improved performance of such a setup, as well as the integration with an off-the-shelf mapping algorithm to allow point cloud updates with a 3D scene and enhance the potential applications of this visual odometry solution.

| S-EPMC8659537 | biostudies-literature

Doc2 is a Ca2+ sensor required for asynchronous neurotransmitter release.

Project description:Synaptic transmission involves a fast synchronous phase and a slower asynchronous phase of neurotransmitter release that are regulated by distinct Ca(2+) sensors. Though the Ca(2+) sensor for rapid exocytosis, synaptotagmin I, has been studied in depth, the sensor for asynchronous release remains unknown. In a screen for neuronal Ca(2+) sensors that respond to changes in [Ca(2+)] with markedly slower kinetics than synaptotagmin I, we observed that Doc2--another Ca(2+), SNARE, and lipid-binding protein--operates on timescales consistent with asynchronous release. Moreover, up- and downregulation of Doc2 expression levels in hippocampal neurons increased or decreased, respectively, the slow phase of synaptic transmission. Synchronous release, when triggered by single action potentials, was unaffected by manipulation of Doc2 but was enhanced during repetitive stimulation in Doc2 knockdown neurons, potentially due to greater vesicle availability. In summary, we propose that Doc2 is a Ca(2+) sensor that is kinetically tuned to regulate asynchronous neurotransmitter release.

| S-EPMC3220409 | biostudies-literature

Evaluating and Mapping Grape Color Using Image-Based Phenotyping.

Project description:Grape berry color is an economically important trait that is controlled by two major genes influencing anthocyanin synthesis in the skin. Color is often described qualitatively using six major categories; however, this is a subjective rating that often fails to describe variation within these six classes. To investigate minor genes influencing berry color, image analysis was used to quantify berry color using different color spaces. An image analysis pipeline was developed and utilized to quantify color in a segregating hybrid wine grape population across two years. Images were collected from grape clusters immediately after harvest and segmented by color to determine the red, green, and blue (RGB); hue, saturation, and intensity (HSI); and lightness, red-green, and blue-yellow values (L∗a∗b∗) of berries. QTL analysis identified known major QTL for color on chromosome 2 along with several previously unreported smaller-effect QTL on chromosomes 1, 5, 6, 7, 10, 15, 18, and 19. This study demonstrated the ability of an image analysis phenotyping system to characterize berry color and to more effectively capture variability within a population and identify genetic regions of interest.

| S-EPMC7706331 | biostudies-literature

Wavefront image sensor chip.

Project description:We report the implementation of an image sensor chip, termed wavefront image sensor chip (WIS), that can measure both intensity/amplitude and phase front variations of a light wave separately and quantitatively. By monitoring the tightly confined transmitted light spots through a circular aperture grid in a high Fresnel number regime, we can measure both intensity and phase front variations with a high sampling density (11 microm) and high sensitivity (the sensitivity of normalized phase gradient measurement is 0.1 mrad under the typical working condition). By using WIS in a standard microscope, we can collect both bright-field (transmitted light intensity) and normalized phase gradient images. Our experiments further demonstrate that the normalized phase gradient images of polystyrene microspheres, unstained and stained starfish embryos, and strongly birefringent potato starch granules are improved versions of their corresponding differential interference contrast (DIC) microscope images in that they are artifact-free and quantitative. Besides phase microscopy, WIS can benefit machine recognition, object ranging, and texture assessment for a variety of applications.

| S-EPMC3408896 | biostudies-other

Event-Based Eccentric Motion Detection Exploiting Time Difference Encoding.

Project description:Attentional selectivity tends to follow events considered as interesting stimuli. Indeed, the motion of visual stimuli present in the environment attract our attention and allow us to react and interact with our surroundings. Extracting relevant motion information from the environment presents a challenge with regards to the high information content of the visual input. In this work we propose a novel integration between an eccentric down-sampling of the visual field, taking inspiration from the varying size of receptive fields (RFs) in the mammalian retina, and the Spiking Elementary Motion Detector (sEMD) model. We characterize the system functionality with simulated data and real world data collected with bio-inspired event driven cameras, successfully implementing motion detection along the four cardinal directions and diagonally.

| S-EPMC7227134 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data