Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Event-Based Color Segmentation With a High Dynamic Range Sensor.

ABSTRACT: This paper introduces a color asynchronous neuromorphic event-based camera and a methodology to process color output from the device to perform color segmentation and tracking at the native temporal resolution of the sensor (down to one microsecond). Our color vision sensor prototype is a combination of three Asynchronous Time-based Image Sensors, sensitive to absolute color information. We devise a color processing algorithm leveraging this information. It is designed to be computationally cheap, thus showing how low level processing benefits from asynchronous acquisition and high temporal resolution data. The resulting color segmentation and tracking performance is assessed both with an indoor controlled scene and two outdoor uncontrolled scenes. The tracking's mean error to the ground truth for the objects of the outdoor scenes ranges from two to twenty pixels.

SUBMITTER: Marcireau A

PROVIDER: S-EPMC5904265 | biostudies-literature | 2018

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Event-Based Color Segmentation With a High Dynamic Range Sensor.

Marcireau Alexandre A Ieng Sio-Hoi SH Simon-Chane Camille C Benosman Ryad B RB

Frontiers in neuroscience 20180411

This paper introduces a color asynchronous neuromorphic event-based camera and a methodology to process color output from the device to perform color segmentation and tracking at the native temporal resolution of the sensor (down to one microsecond). Our color vision sensor prototype is a combination of three Asynchronous Time-based Image Sensors, sensitive to absolute color information. We devise a color processing algorithm leveraging this information. It is designed to be computationally chea ...[more]

PMID: 29695948

Similar Datasets

Graph Cut-Based Human Body Segmentation in Color Images Using Skeleton Information from the Depth Sensor.

Project description:Segmentation of human bodies in images is useful for a variety of applications, including background substitution, human activity recognition, security, and video surveillance applications. However, human body segmentation has been a challenging problem, due to the complicated shape and motion of a non-rigid human body. Meanwhile, depth sensors with advanced pattern recognition algorithms provide human body skeletons in real time with reasonable accuracy. In this study, we propose an algorithm that projects the human body skeleton from a depth image to a color image, where the human body region is segmented in the color image by using the projected skeleton as a segmentation cue. Experimental results using the Kinect sensor demonstrate that the proposed method provides high quality segmentation results and outperforms the conventional methods.

| S-EPMC6358916 | biostudies-literature

A biochemical logarithmic sensor with broad dynamic range.

Project description:Sensory perception often scales logarithmically with the input level. Similarly, the output response of biochemical systems sometimes scales logarithmically with the input signal that drives the system. How biochemical systems achieve logarithmic sensing remains an open puzzle. This article shows how a biochemical logarithmic sensor can be constructed from the most basic principles of chemical reactions. Assuming that reactions follow the classic Michaelis-Menten kinetics of mass action or the more generalized and commonly observed Hill equation response, the summed output of several simple reactions with different sensitivities to the input will often give an aggregate output response that logarithmically transforms the input. The logarithmic response is robust to stochastic fluctuations in parameter values. This model emphasizes the simplicity and robustness by which aggregate chemical circuits composed of sloppy components can achieve precise response characteristics. Both natural and synthetic designs gain from the power of this aggregate approach.

| S-EPMC5897783 | biostudies-other

Color image segmentation based on different color space models using automatic GrabCut.

Project description:This paper presents a comparative study using different color spaces to evaluate the performance of color image segmentation using the automatic GrabCut technique. GrabCut is considered as one of the semiautomatic image segmentation techniques, since it requires user interaction for the initialization of the segmentation process. The automation of the GrabCut technique is proposed as a modification of the original semiautomatic one in order to eliminate the user interaction. The automatic GrabCut utilizes the unsupervised Orchard and Bouman clustering technique for the initialization phase. Comparisons with the original GrabCut show the efficiency of the proposed automatic technique in terms of segmentation, quality, and accuracy. As no explicit color space is recommended for every segmentation problem, automatic GrabCut is applied with RGB, HSV, CMY, XYZ, and YUV color spaces. The comparative study and experimental results using different color images show that RGB color space is the best color space representation for the set of the images used.

| S-EPMC4165205 | biostudies-literature

High Dynamic Range Nanowire Resonators.

Project description:Dynamic range quantifies the linear operation regime available in nanomechanical resonators. Nonlinearities dominate the response of flexural beams in the limit of very high aspect ratio and very small diameter, which leads to expectation of low dynamic range for nanowire resonators in general. However, the highest achievable dynamic range for nanowire resonators with practical dimensions remains to be determined. We report dynamic range measurements on singly clamped silicon nanowire resonators reaching remarkably high values of up to 90 dB obtained with a simple harmonic actuation scheme. We explain these measurements by a comprehensive theoretical examination of dynamic range in singly clamped flexural beams including the effect of tapering, a usual feature of semiconductor nanowires. Our analysis reveals the nanowire characteristics required for broad linear operation, and given the relationship between dynamic range and mass sensing performance, it also enables analytical determination of mass detection limits, reaching atomic-scale resolution for feasible nanowires.

| S-EPMC8361434 | biostudies-literature

Graded intrafillable architecture-based iontronic pressure sensor with ultra-broad-range high sensitivity.

Project description:Sensitivity is a crucial parameter for flexible pressure sensors and electronic skins. While introducing microstructures (e.g., micro-pyramids) can effectively improve the sensitivity, it in turn leads to a limited pressure-response range due to the poor structural compressibility. Here, we report a strategy of engineering intrafillable microstructures that can significantly boost the sensitivity while simultaneously broadening the pressure responding range. Such intrafillable microstructures feature undercuts and grooves that accommodate deformed surface microstructures, effectively enhancing the structural compressibility and the pressure-response range. The intrafillable iontronic sensor exhibits an unprecedentedly high sensitivity (Smin > 220 kPa-1) over a broad pressure regime (0.08 Pa-360 kPa), and an ultrahigh pressure resolution (18 Pa or 0.0056%) over the full pressure range, together with remarkable mechanical stability. The intrafillable structure is a general design expected to be applied to other types of sensors to achieve a broader pressure-response range and a higher sensitivity.

| S-EPMC6954251 | biostudies-literature

Robotic goalie with 3 ms reaction time at 4% CPU load using event-based dynamic vision sensor.

Project description:Conventional vision-based robotic systems that must operate quickly require high video frame rates and consequently high computational costs. Visual response latencies are lower-bound by the frame period, e.g., 20 ms for 50 Hz frame rate. This paper shows how an asynchronous neuromorphic dynamic vision sensor (DVS) silicon retina is used to build a fast self-calibrating robotic goalie, which offers high update rates and low latency at low CPU load. Independent and asynchronous per pixel illumination change events from the DVS signify moving objects and are used in software to track multiple balls. Motor actions to block the most "threatening" ball are based on measured ball positions and velocities. The goalie also sees its single-axis goalie arm and calibrates the motor output map during idle periods so that it can plan open-loop arm movements to desired visual locations. Blocking capability is about 80% for balls shot from 1 m from the goal even with the fastest-shots, and approaches 100% accuracy when the ball does not beat the limits of the servo motor to move the arm to the necessary position in time. Running with standard USB buses under a standard preemptive multitasking operating system (Windows), the goalie robot achieves median update rates of 550 Hz, with latencies of 2.2 ± 2 ms from ball movement to motor command at a peak CPU load of less than 4%. Practical observations and measurements of USB device latency are provided.

| S-EPMC3836084 | biostudies-literature

A mTurquoise-based cAMP sensor for both FLIM and ratiometric read-out has improved dynamic range.

Project description:FRET-based sensors for cyclic Adenosine Mono Phosphate (cAMP) have revolutionized the way in which this important intracellular messenger is studied. The currently prevailing sensors consist of the cAMP-binding protein Epac1, sandwiched between suitable donor- and acceptor fluorescent proteins (FPs). Through a conformational change in Epac1, alterations in cellular cAMP levels lead to a change in FRET that is most commonly detected by either Fluorescence Lifetime Imaging (FLIM) or by Sensitized Emission (SE), e.g., by simple ratio-imaging. We recently reported a range of different Epac-based cAMP sensors with high dynamic range and signal-to-noise ratio. We showed that constructs with cyan FP as donor are optimal for readout by SE, whereas other constructs with green FP donors appeared much more suited for FLIM detection. In this study, we present a new cAMP sensor, termed (T)Epac(VV), which employs mTurquoise as donor. Spectrally very similar to CFP, mTurquoise has about doubled quantum efficiency and unlike CFP, its fluorescence decay is strictly single-exponential. We show that (T)Epac(VV) appears optimal for detection both by FLIM and SE, that it has outstanding FRET span and signal-to-noise ratio, and improved photostability. Hence, (T)Epac(VV) should become the cAMP sensor of choice for new experiments, both for FLIM and ratiometric detection.

| S-EPMC3084777 | biostudies-literature

Stereo Vision-Based High Dynamic Range Imaging Using Differently-Exposed Image Pair.

Project description:In this paper, a high dynamic range (HDR) imaging method based on the stereo vision system is presented. The proposed method uses differently exposed low dynamic range (LDR) images captured from a stereo camera. The stereo LDR images are first converted to initial stereo HDR images using the inverse camera response function estimated from the LDR images. However, due to the limited dynamic range of the stereo LDR camera, the radiance values in under/over-exposed regions of the initial main-view (MV) HDR image can be lost. To restore these radiance values, the proposed stereo matching and hole-filling algorithms are applied to the stereo HDR images. Specifically, the auxiliary-view (AV) HDR image is warped by using the estimated disparity between initial the stereo HDR images and then effective hole-filling is applied to the warped AV HDR image. To reconstruct the final MV HDR, the warped and hole-filled AV HDR image is fused with the initial MV HDR image using the weight map. The experimental results demonstrate objectively and subjectively that the proposed stereo HDR imaging method provides better performance compared to the conventional method.

| S-EPMC5539793 | biostudies-other

Event segmentation ability uniquely predicts event memory.

Project description:Memory for everyday events plays a central role in tasks of daily living, autobiographical memory, and planning. Event memory depends in part on segmenting ongoing activity into meaningful units. This study examined the relationship between event segmentation and memory in a lifespan sample to answer the following question: Is the ability to segment activity into meaningful events a unique predictor of subsequent memory, or is the relationship between event perception and memory accounted for by general cognitive abilities? Two hundred and eight adults ranging from 20 to 79years old segmented movies of everyday events and attempted to remember the events afterwards. They also completed psychometric ability tests and tests measuring script knowledge for everyday events. Event segmentation and script knowledge both explained unique variance in event memory above and beyond the psychometric measures, and did so as strongly in older as in younger adults. These results suggest that event segmentation is a basic cognitive mechanism, important for memory across the lifespan.

| S-EPMC3821069 | biostudies-literature

Dynamic models of stress-smoking responses based on high-frequency sensor data.

Project description:Self-reports indicate that stress increases the risk for smoking; however, intensive data from sensors can provide a more nuanced understanding of stress in the moments leading up to and following smoking events. Identifying personalized dynamical models of stress-smoking responses can improve characterizations of smoking responses following stress, but techniques used to identify these models require intensive longitudinal data. This study leveraged advances in wearable sensing technology and digital markers of stress and smoking to identify person-specific models of stress and smoking system dynamics by considering stress immediately before, during, and after smoking events. Adult smokers (n = 45) wore the AutoSense chestband (respiration-inductive plethysmograph, electrocardiogram, accelerometer) with MotionSense (accelerometers, gyroscopes) on each wrist for three days prior to a quit attempt. The odds of minute-level smoking events were regressed on minute-level stress probabilities to identify person-specific dynamic models of smoking responses to stress. Simulated pulse responses to a continuous stress episode revealed a consistent pattern of increased odds of smoking either shortly after the beginning of the simulated stress episode or with a delay, for all participants. This pattern is followed by a dramatic reduction in the probability of smoking thereafter, for about half of the participants (49%). Sensor-detected stress probabilities indicate a vulnerability for smoking that may be used as a tailoring variable for just-in-time interventions to support quit attempts.

| S-EPMC8611062 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data