Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Real Time 3D Facial Movement Tracking Using a Monocular Camera.

ABSTRACT: The paper proposes a robust framework for 3D facial movement tracking in real time using a monocular camera. It is designed to estimate the 3D face pose and local facial animation such as eyelid movement and mouth movement. The framework firstly utilizes the Discriminative Shape Regression method to locate the facial feature points on the 2D image and fuses the 2D data with a 3D face model using Extended Kalman Filter to yield 3D facial movement information. An alternating optimizing strategy is adopted to fit to different persons automatically. Experiments show that the proposed framework could track the 3D facial movement across various poses and illumination conditions. Given the real face scale the framework could track the eyelid with an error of 1 mm and mouth with an error of 2 mm. The tracking result is reliable for expression analysis or mental state inference.

SUBMITTER: Dong Y

PROVIDER: S-EPMC5017323 | biostudies-literature | 2016 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Real Time 3D Facial Movement Tracking Using a Monocular Camera.

Dong Yanchao Y Wang Yanming Y Yue Jiguang J Hu Zhencheng Z

Sensors (Basel, Switzerland) 20160725 8

The paper proposes a robust framework for 3D facial movement tracking in real time using a monocular camera. It is designed to estimate the 3D face pose and local facial animation such as eyelid movement and mouth movement. The framework firstly utilizes the Discriminative Shape Regression method to locate the facial feature points on the 2D image and fuses the 2D data with a 3D face model using Extended Kalman Filter to yield 3D facial movement information. An alternating optimizing strategy is ...[more]

PMID: 27463714

Similar Datasets

Competition for roadside camera monocular 3D object detection.

Project description: Not available

| S-EPMC10246814 | biostudies-literature

Real-Time Dynamic 3D Shape Reconstruction with SWIR InGaAs Camera.

Project description:In this paper, a real-time, dynamic three-dimensional (3D) shape reconstruction scheme based on the Fourier-transform profilometry (FTP) method is achieved with a short-wave infrared (SWIR) indium gallium arsenide (InGaAs) camera for monitoring applications in low illumination environments. A SWIR 3D shape reconstruction system is built for generating and acquiring the SWIR two-dimensional (2D) fringe pattern of the target. The depth information of the target is reconstructed by employing an improved FTP method, which has the advantages of high reconstruction accuracy and speed. The maximum error in depth for static 3D shape reconstruction is 1.15 mm for a plastic model with a maximum depth of 36 mm. Meanwhile, a real-time 3D shape reconstruction with a frame rate of 25 Hz can be realized by this system, which has great application prospects in real-time dynamic 3D shape reconstruction, such as low illumination monitoring. In addition, for real-time dynamic 3D shape reconstruction, without considering the edge areas, the maximum error in depth among all frames is 1.42 mm for a hemisphere with a depth of 35 mm, and the maximum error of the average of all frames in depth is 0.52 mm.

| S-EPMC7014486 | biostudies-literature

A Protocol for Real-time 3D Single Particle Tracking.

Project description:Real-time three-dimensional single particle tracking (RT-3D-SPT) has the potential to shed light on fast, 3D processes in cellular systems. Although various RT-3D-SPT methods have been put forward in recent years, tracking high speed 3D diffusing particles at low photon count rates remains a challenge. Moreover, RT-3D-SPT setups are generally complex and difficult to implement, limiting their widespread application to biological problems. This protocol presents a RT-3D-SPT system named 3D Dynamic Photon Localization Tracking (3D-DyPLoT), which can track particles with high diffusive speed (up to 20 µm2/s) at low photon count rates (down to 10 kHz). 3D-DyPLoT employs a 2D electro-optic deflector (2D-EOD) and a tunable acoustic gradient (TAG) lens to drive a single focused laser spot dynamically in 3D. Combined with an optimized position estimation algorithm, 3D-DyPLoT can lock onto single particles with high tracking speed and high localization precision. Owing to the single excitation and single detection path layout, 3D-DyPLoT is robust and easy to set up. This protocol discusses how to build 3D-DyPLoT step by step. First, the optical layout is described. Next, the system is calibrated and optimized by raster scanning a 190 nm fluorescent bead with the piezoelectric nanopositioner. Finally, to demonstrate real-time 3D tracking ability, 110 nm fluorescent beads are tracked in water.

| S-EPMC5897059 | biostudies-literature

Camera-based three-dimensional real-time particle tracking at kHz rates and Angstrom accuracy.

Project description:Optical and magnetic tweezers are widely employed to probe the mechanics and activity of individual biomolecular complexes. They rely on micrometre-sized particles to detect molecular conformational changes from the particle position. Real-time particle tracking with Ångström accuracy has so far been only achieved using laser detection through photodiodes. Here we demonstrate that camera-based imaging can provide a similar performance for all three dimensions. Particle imaging at kHz rates is combined, with real-time data processing being accelerated by a graphics-processing unit. For particles that are fixed in the sample cell we can detect 3-Å-sized steps that are introduced by cell translations at rates of 10 Hz, while for DNA-tethered particles 5 Å steps at 1 Hz can be resolved. Moreover, 20 particles can be tracked in parallel with comparable accuracy. Our approach provides a simple and robust way for high-resolution tweezer experiments using multiple particles at a time.

| S-EPMC4338538 | biostudies-literature

Fast, Flexible Closed-Loop Feedback: Tracking Movement in "Real-Millisecond-Time".

Project description:One of the principal functions of the brain is to control movement and rapidly adapt behavior to a changing external environment. Over the last decades our ability to monitor activity in the brain, manipulate it while also manipulating the environment the animal moves through, has been tackled with increasing sophistication. However, our ability to track the movement of the animal in real time has not kept pace. Here, we use a dynamic vision sensor (DVS) based event-driven neuromorphic camera system to implement real-time, low-latency tracking of a single whisker that mice can move at ∼25 Hz. The customized DVS system described here converts whisker motion into a series of events that can be used to estimate the position of the whisker and to trigger a position-based output interactively within 2 ms. This neuromorphic chip-based closed-loop system provides feedback rapidly and flexibly. With this system, it becomes possible to use the movement of whiskers or in principal, movement of any part of the body to reward, punish, in a rapidly reconfigurable way. These methods can be used to manipulate behavior, and the neural circuits that help animals adapt to changing values of a sequence of motor actions.

| S-EPMC6825957 | biostudies-literature

Robust real-time heart rate prediction for multiple subjects from facial video using compressive tracking and support vector machine.

Project description:Remote monitoring of vital physiological signs allows for unobtrusive, nonrestrictive, and noncontact assessment of an individual's health. We demonstrate a simple but robust image photoplethysmography-based heart rate (HR) estimation method for multiple subjects. In contrast to previous studies, a self-learning procedure of tech was developed in our study. We improved compress tracking algorithm to track the regions of interest from video sequences and used support vector machine to filter out potentially false beats caused by variations in the reflected light from the face. The experiment results on 40 subjects show that the absolute value of mean error reduces from 3.6 to 1.3??beats/min . We further explore experiments for 10 subjects simultaneously, regardless of the videos at a resolution of 600 by 800, the HR is predicted real-time and the results reveal modest but significant effects on HR prediction.

| S-EPMC6025486 | biostudies-literature

Real-time 3D movement correction for two-photon imaging in behaving animals.

Project description:Two-photon microscopy is widely used to investigate brain function across multiple spatial scales. However, measurements of neural activity are compromised by brain movement in behaving animals. Brain motion-induced artifacts are typically corrected using post hoc processing of two-dimensional images, but this approach is slow and does not correct for axial movements. Moreover, the deleterious effects of brain movement on high-speed imaging of small regions of interest and photostimulation cannot be corrected post hoc. To address this problem, we combined random-access three-dimensional (3D) laser scanning using an acousto-optic lens and rapid closed-loop field programmable gate array processing to track 3D brain movement and correct motion artifacts in real time at up to 1 kHz. Our recordings from synapses, dendrites and large neuronal populations in behaving mice and zebrafish demonstrate real-time movement-corrected 3D two-photon imaging with submicrometer precision.

| S-EPMC7370269 | biostudies-literature

Real-Time 3D Tracking of Laparoscopy Training Instruments for Assessment and Feedback.

Project description:Assessment of minimally invasive surgical skills is a non-trivial task, usually requiring the presence and time of expert observers, including subjectivity and requiring special and expensive equipment and software. Although there are virtual simulators that provide self-assessment features, they are limited as the trainee loses the immediate feedback from realistic physical interaction. The physical training boxes, on the other hand, preserve the immediate physical feedback, but lack the automated self-assessment facilities. This study develops an algorithm for real-time tracking of laparoscopy instruments in the video cues of a standard physical laparoscopy training box with a single fisheye camera. The developed visual tracking algorithm recovers the 3D positions of the laparoscopic instrument tips, to which simple colored tapes (markers) are attached. With such system, the extracted instrument trajectories can be digitally processed, and automated self-assessment feedback can be provided. In this way, both the physical interaction feedback would be preserved and the need for the observance of an expert would be overcome. Real-time instrument tracking with a suitable assessment criterion would constitute a significant step towards provision of real-time (immediate) feedback to correct trainee actions and show them how the action should be performed. This study is a step towards achieving this with a low cost, automated, and widely applicable laparoscopy training and assessment system using a standard physical training box equipped with a fisheye camera.

| S-EPMC8600079 | biostudies-literature

Real-Time MRI-Guided Catheter Tracking Using Hyperpolarized Silicon Particles.

Project description:Visualizing the movement of angiocatheters during endovascular interventions is typically accomplished using x-ray fluoroscopy. There are many potential advantages to developing magnetic resonance imaging-based approaches that will allow three-dimensional imaging of the tissue/vasculature interface while monitoring other physiologically-relevant criteria, without exposing the patient or clinician team to ionizing radiation. Here we introduce a proof-of-concept development of a magnetic resonance imaging-guided catheter tracking method that utilizes hyperpolarized silicon particles. The increased signal of the silicon particles is generated via low-temperature, solid-state dynamic nuclear polarization, and the particles retain their enhanced signal for ? 40 minutes--allowing imaging experiments over extended time durations. The particles are affixed to the tip of standard medical-grade catheters and are used to track passage under set distal and temporal points in phantoms and live mouse models. With continued development, this method has the potential to supplement x-ray fluoroscopy and other MRI-guided catheter tracking methods as a zero-background, positive contrast agent that does not require ionizing radiation.

| S-EPMC4523869 | biostudies-other

Improved automatic identification of isolated rapid eye movement sleep behavior disorder with a 3D time-of-flight camera.

Project description:Background and purposeAutomatic 3D video analysis of the lower body during rapid eye movement (REM) sleep has been recently proposed as a novel tool for identifying people with isolated REM sleep behavior disorder (iRBD), but, so far, it has not been validated on unseen subjects. This study aims at validating this technology in a large cohort and at improving its performances by also including an analysis of movements in the head, hands and upper body.MethodsFifty-three people with iRBD and 128 people without RBD (of whom 89 had sleep disorders considered RBD differential diagnoses) were included in the study. An automatic algorithm identified movements from 3D videos during REM sleep in four regions of interest (ROIs): head, hands, upper body and lower body. The movements were divided into categories according to duration: short (0.1-2 s), medium (2-15 s) and long (15-300 s). For each ROI and duration range, features were obtained from the identified movements. Logistic regression models using as predictors the features from one single ROI or a combination of ROIs were trained and tested in a 10-runs 10-fold cross-validation scheme on the task of differentiating people with iRBD from people without RBD.ResultsThe best differentiation was achieved using short movements in all four ROIs (test accuracy 0.866 ± 0.007, test F1 score = 0.783 ± 0.010). Single group analyses showed that people with iRBD were distinguished successfully from subjects with RBD differential diagnoses.ConclusionsAutomatic 3D video analysis might be implemented in clinical routine as a supportive screening tool for identifying people with RBD.

| S-EPMC10947372 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data