Dataset Information

A Novel Approach for 3D-Structural Identification through Video Recording: Magnified Tracking.

ABSTRACT: Advancements in optical imaging devices and computer vision algorithms allow the exploration of novel diagnostic techniques for use within engineering systems. A recent field of application lies in the adoption of such devices for non-contact vibrational response recordings of structures, allowing high spatial density measurements without the burden of heavy cabling associated with conventional technologies. This, however, is not a straightforward task due to the typically low-amplitude displacement response of structures under ambient operational conditions. A novel framework, namely Magnified Tracking (MT), is proposed herein to overcome this limitation through the synergistic use of two computer vision techniques. The recently proposed phase-based motion magnification (PBMM) framework, for amplifying motion in a video within a defined frequency band, is coupled with motion tracking by means of particle tracking velocimetry (PTV). An experimental campaign was conducted to validate a proof-of-concept, where the dynamic response of a shear frame was measured both by conventional sensors as well as a video camera setup, and cross-compared to prove the feasibility of the proposed non-contact approach. The methodology was explored both in 2D and 3D configurations, with PTV revealing a powerful tool for the measurement of perceptible motion. When MT is utilized for tracking "imperceptible" structural responses (i.e., below PTV sensitivity), via the use of PBMM around the resonant frequencies of the structure, the amplified motion reveals the operational deflection shapes, which are otherwise intractable. The modal results extracted from the magnified videos, using PTV, demonstrate MT to be a viable non-contact alternative for 3D modal identification with the benefit of a spatially dense measurement grid.

SUBMITTER: Harmanci YE

PROVIDER: S-EPMC6427300 | biostudies-literature | 2019 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A Novel Approach for 3D-Structural Identification through Video Recording: Magnified Tracking.

Harmanci Yunus Emre YE Gülan Utku U Holzner Markus M Chatzi Eleni E

Sensors (Basel, Switzerland) 20190311 5

Advancements in optical imaging devices and computer vision algorithms allow the exploration of novel diagnostic techniques for use within engineering systems. A recent field of application lies in the adoption of such devices for non-contact vibrational response recordings of structures, allowing high spatial density measurements without the burden of heavy cabling associated with conventional technologies. This, however, is not a straightforward task due to the typically low-amplitude displace ...[more]

PMID: 30862051

Similar Datasets

Project description:Introduction: Video-based clinical rating plays an important role in assessing dystonia and monitoring the effect of treatment in dyskinetic cerebral palsy (CP). However, evaluation by clinicians is time-consuming, and the quality of rating is dependent on experience. The aim of the current study is to provide a proof-of-concept for a machine learning approach to automatically assess scoring of dystonia using 2D stick figures extracted from videos. Model performance was compared to human performance. Methods: A total of 187 video sequences of 34 individuals with dyskinetic CP (8-23 years, all non-ambulatory) were filmed at rest during lying and supported sitting. Videos were scored by three raters according to the Dyskinesia Impairment Scale (DIS) for arm and leg dystonia (normalized scores ranging from 0-1). Coordinates in pixels of the left and right wrist, elbow, shoulder, hip, knee and ankle were extracted using DeepLabCut, an open source toolbox that builds on a pose estimation algorithm. Within a subset, tracking accuracy was assessed for a pretrained human model and for models trained with an increasing number of manually labeled frames. The mean absolute error (MAE) between DeepLabCut's prediction of the position of body points and manual labels was calculated. Subsequently, movement and position features were calculated from extracted body point coordinates. These features were fed into a Random Forest Regressor to train a model to predict the clinical scores. The model performance trained with data from one rater evaluated by MAEs (model-rater) was compared to inter-rater accuracy. Results: A tracking accuracy of 4.5 pixels (approximately 1.5 cm) could be achieved by adding 15-20 manually labeled frames per video. The MAEs for the trained models ranged from 0.21 ± 0.15 for arm dystonia to 0.14 ± 0.10 for leg dystonia (normalized DIS scores). The inter-rater MAEs were 0.21 ± 0.22 and 0.16 ± 0.20, respectively. Conclusion: This proof-of-concept study shows the potential of using stick figures extracted from common videos in a machine learning approach to automatically assess dystonia. Sufficient tracking accuracy can be reached by manually adding labels within 15-20 frames per video. With a relatively small data set, it is possible to train a model that can automatically assess dystonia with a performance comparable to human scoring.

Dataset Information

A Novel Approach for 3D-Structural Identification through Video Recording: Magnified Tracking.

Publications

A Novel Approach for 3D-Structural Identification through Video Recording: Magnified Tracking.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets