Active Multimodal Sensor System for Target Recognition and Tracking.
Ontology highlight
ABSTRACT:
SUBMITTER: Qu Y
PROVIDER: S-EPMC5539591 | biostudies-other | 2017 Jun
REPOSITORIES: biostudies-other
Similar Datasets
Project description:Recognizing emotions during social interactions has many potential applications with the popularization of low-cost mobile sensors, but a challenge remains with the lack of naturalistic affective interaction data. Most existing emotion datasets do not support studying idiosyncratic emotions arising in the wild as they were collected in constrained environments. Therefore, studying emotions in the context of social interactions requires a novel dataset, and K-EmoCon is such a multimodal dataset with comprehensive annotations of continuous emotions during naturalistic conversations. The dataset contains multimodal measurements, including audiovisual recordings, EEG, and peripheral physiological signals, acquired with off-the-shelf devices from 16 sessions of approximately 10-minute long paired debates on a social issue. Distinct from previous datasets, it includes emotion annotations from all three available perspectives: self, debate partner, and external observers. Raters annotated emotional displays at intervals of every 5 seconds while viewing the debate footage, in terms of arousal-valence and 18 additional categorical emotions. The resulting K-EmoCon is the first publicly available emotion dataset accommodating the multiperspective assessment of emotions during social interactions.
| S-EPMC7479607 | biostudies-literature
Project description:BackgroundNeuronal calcium sensor (NCS) proteins, a sub-branch of the calmodulin superfamily, are expressed in the brain and retina where they transduce calcium signals and are genetically linked to degenerative diseases. The amino acid sequences of NCS proteins are highly conserved but their physiological functions are quite distinct. Retinal recoverin and guanylate cyclase activating proteins (GCAPs) both serve as calcium sensors in retinal rod cells, neuronal frequenin (NCS1) modulate synaptic activity and neuronal secretion, K+ channel interacting proteins (KChIPs) regulate ion channels to control neuronal excitability, and DREAM (KChIP3) is a transcriptional repressor that regulates neuronal gene expression.Scope of reviewHere we review the molecular structures of myristoylated forms of NCS1, recoverin, and GCAP1 that all look very different, suggesting that the sequestered myristoyl group helps to refold these highly homologous proteins into very different structures. The molecular structure of NCS target complexes have been solved for recoverin bound to rhodopsin kinase, NCS-1 bound to phosphatidylinositol 4-kinase, and KChIP1 bound to A-type K+ channels.Major conclusionsWe propose the idea that N-terminal myristoylation is critical for shaping each NCS family member into a unique structure, which upon Ca2+-induced extrusion of the myristoyl group exposes a unique set of previously masked residues, thereby exposing a distinctive ensemble of hydrophobic residues to associate specifically with a particular physiological target. This article is part of a Special Issue entitled Biochemical, biophysical and genetic approaches to intracellular calcium signaling.
| S-EPMC3266469 | biostudies-literature
Project description:Neuronal calcium sensor (NCS) proteins, a sub-branch of the EF-hand superfamily, are expressed in the brain and retina where they transduce calcium signals and are genetically linked to degenerative diseases. The amino acid sequences of NCS proteins are highly conserved but their physiological functions are quite distinct. Retinal recoverin and guanylate cyclase activating proteins (GCAPs) both serve as calcium sensors in retinal rod cells, neuronal frequenin (NCS1) modulates synaptic activity and neuronal secretion, K(+) channel interacting proteins (KChIPs) regulate ion channels to control neuronal excitability, and DREAM (KChIP3) is a transcriptional repressor that regulates neuronal gene expression. Here we review the molecular structures of myristoylated forms of NCS1, recoverin, and GCAP1 that all look very different, suggesting that the sequestered myristoyl group helps to refold these highly homologous proteins into very different structures. The molecular structure of NCS target complexes have been solved for recoverin bound to rhodopsin kinase (RK), NCS-1 bound to phosphatidylinositol 4-kinase, and KChIP1 bound to A-type K(+) channels. We propose that N-terminal myristoylation is critical for shaping each NCS family member into a different structure, which upon Ca(2+)-induced extrusion of the myristoyl group exposes a unique set of previously masked residues that interact with a particular physiological target.
| S-EPMC3275791 | biostudies-literature
Project description:Although at present legislation does not allow drivers in a Level 3 autonomous vehicle to engage in a secondary task, there may become a time when it does. Monitoring the behaviour of drivers engaging in various non-driving activities (NDAs) is crucial to decide how well the driver will be able to take over control of the vehicle. One limitation of the commonly used face-based head tracking system, using cameras, is that sufficient features of the face must be visible, which limits the detectable angle of head movement and thereby measurable NDAs, unless multiple cameras are used. This paper proposes a novel orientation sensor based head tracking system that includes twin devices, one of which measures the movement of the vehicle while the other measures the absolute movement of the head. Measurement error in the shaking and nodding axes were less than 0.4°, while error in the rolling axis was less than 2°. Comparison with a camera-based system, through in-house tests and on-road tests, showed that the main advantage of the proposed system is the ability to detect angles larger than 20° in the shaking and nodding axes. Finally, a case study demonstrated that the measurement of the shaking and nodding angles, produced from the proposed system, can effectively characterise the drivers' behaviour while engaged in the NDAs of chatting to a passenger and playing on a smartphone.
| S-EPMC5713139 | biostudies-literature
Project description:In this paper, we describe DECAL, a prototype Monolithic Active Pixel Sensor (MAPS) device designed to demonstrate the feasibility of both digital calorimetry and reconfigurability in ASICs for particle physics. The goal of this architecture is to help reduce the development and manufacturing costs of detectors for future colliders by developing a chip that can operate both as a digital silicon calorimeter and a tracking chip. The prototype sensor consists of a matrix of 64 × 64 55 μm pixels, and provides a readout at 40 MHz of the number of particles which have struck the matrix in the preceding 25 ns. It can be configured to report this as a total sum across the sensor (equivalent to the pad of an analogue calorimeter) or the sum per column (equivalent to a traditional strip detector). The design and operation of the sensor are described, and the results of chip characterisation are reported and compared to simulations.
| S-EPMC9506098 | biostudies-literature
Project description:We report a self-powered, lightweight and cost-effective active sensor system for vibration monitoring with multiplexed operation based on contact electrification between sensor and detected objects. The as-fabricated sensor matrix is capable of monitoring and mapping the vibration state of large amounts of units. The monitoring contents include: on-off state, vibration frequency and vibration amplitude of each unit. The active sensor system delivers a detection range of 0-60 Hz, high accuracy (relative error below 0.42%), long-term stability (10000 cycles). On the time dimension, the sensor can provide the vibration process memory by recording the outputs of the sensor system in an extend period of time. Besides, the developed sensor system can realize detection under contact mode and non-contact mode. Its high performance is not sensitive to the shape or the conductivity of the detected object. With these features, the active sensor system has great potential in automatic control, remote operation, surveillance and security systems.
| S-EPMC4633595 | biostudies-literature
Project description:BackgroundDespite the widespread use of sensors in engineering systems like robots and automation systems, the common paradigm is to have fixed sensor morphology tailored to fulfill a specific application. On the other hand, robotic systems are expected to operate in ever more uncertain environments. In order to cope with the challenge, it is worthy of note that biological systems show the importance of suitable sensor morphology and active sensing capability to handle different kinds of sensing tasks with particular requirements.MethodologyThis paper presents a robotics active sensing system which is able to adjust its sensor morphology in situ in order to sense different physical quantities with desirable sensing characteristics. The approach taken is to use thermoplastic adhesive material, i.e. Hot Melt Adhesive (HMA). It will be shown that the thermoplastic and thermoadhesive nature of HMA enables the system to repeatedly fabricate, attach and detach mechanical structures with a variety of shape and size to the robot end effector for sensing purposes. Via active sensing capability, the robotic system utilizes the structure to physically probe an unknown target object with suitable motion and transduce the arising physical stimuli into information usable by a camera as its only built-in sensor.Conclusions/significanceThe efficacy of the proposed system is verified based on two results. Firstly, it is confirmed that suitable sensor morphology and active sensing capability enables the system to sense different physical quantities, i.e. softness and temperature, with desirable sensing characteristics. Secondly, given tasks of discriminating two visually indistinguishable objects with respect to softness and temperature, it is confirmed that the proposed robotic system is able to autonomously accomplish them. The way the results motivate new research directions which focus on in situ adjustment of sensor morphology will also be discussed.
| S-EPMC3887119 | biostudies-literature
Project description:As a reinforcement technology that improves load-bearing ability and prevents injuries, assisted exoskeleton robots have extensive applications in freight transport and health care. The perception of gait information by such robots is vital for their control. This information is the basis for motion planning in assistive and collaborative functions. Here, a wearable gait recognition sensor system for exoskeleton robots is presented. Pressure sensor arrays based on laser-induced graphene are developed with flexibility and reliability. Multiple sensor units are integrated into an insole to detect real-time pressure at key plantar positions. In addition, the circuit hardware and the algorithm are designed to reinforce the sensor system with the capability of gait recognition. The experimental results show that the accuracy of gait recognition by the proposed system is 99.85%, and the effectiveness of the system is further verified through testing on an exoskeleton robot.
| S-EPMC11002036 | biostudies-literature
Project description:Mind wandering is a drift of attention away from the physical world and towards our thoughts and concerns. Mind wandering affects our cognitive state in ways that can foster creativity but hinder productivity. In the context of learning, mind wandering is primarily associated with lower performance. This study has two goals. First, we investigate the effects of text semantics and music on the frequency and type of mind wandering. Second, using eye-tracking and electrodermal features, we propose a novel technique for automatic, user-independent detection of mind wandering. We find that mind wandering was most frequent in texts for which readers had high expertise and that were combined with sad music. Furthermore, a significant increase in task-related thoughts was observed for texts for which readers had little prior knowledge. A Random Forest classification model yielded an F 1 -Score of 0.78 when using only electrodermal features to detect mind wandering, of 0.80 when using only eye-movement features, and of 0.83 when using both. Our findings pave the way for building applications which automatically detect events of mind wandering during reading.
| S-EPMC7248717 | biostudies-literature
Project description:A mirror-based active system capable of changing the view's direction of a pre-existing fixed camera is presented. The aim of this research work is to extend the perceptual tracking capabilities of an underwater robot without altering its structure. The ability to control the view's direction allows the robot to explore its entire surroundings without any actual displacement, which can be useful for more effective motion planning and for different navigation strategies, such as object tracking and/or obstacle evasion, which are of great importance for natural preservation in environments as complex and fragile as coral reefs. Active vision systems based on mirrors had been used mainly in terrestrial platforms to capture the motion of fast projectiles using high-speed cameras of considerable size and weight, but they had not been used on underwater platforms. In this sense, our approach incorporates a lightweight design adapted to an underwater robot using affordable and easy-access technology (i.e., 3D printing). Our active system consists of two arranged mirrors, one of which remains static in front of the robot's camera, while the orientation of the second mirror is controlled by two servomotors. Object tracking is performed by using only the pixels contained on the homography of a defined area in the active mirror. HSV color space is used to reduce lighting change effects. Since color and geometry information of the tracking object are previously known, a window filter is applied over the H-channel for color blobs detection, then, noise is filtered and the object's centroid is estimated. If the object is lost, a Kalman filter is applied to predict its position. Finally, with this information, an image PD controller computes the servomotor articular values. We have carried out experiments in real environments, testing our active vision system in an object-tracking application where an artificial object is manually displaced on the periphery of the robot and the mirror system is automatically reconfigured to keep such object focused by the camera, having satisfactory results in real time for detecting objects of low complexity and in poor lighting conditions.
| S-EPMC8255918 | biostudies-literature