Browse
Submit Data
Databases
API
Help

Dataset Information

20 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Real-Time 3D Tracking of Laparoscopy Training Instruments for Assessment and Feedback.

ABSTRACT: Assessment of minimally invasive surgical skills is a non-trivial task, usually requiring the presence and time of expert observers, including subjectivity and requiring special and expensive equipment and software. Although there are virtual simulators that provide self-assessment features, they are limited as the trainee loses the immediate feedback from realistic physical interaction. The physical training boxes, on the other hand, preserve the immediate physical feedback, but lack the automated self-assessment facilities. This study develops an algorithm for real-time tracking of laparoscopy instruments in the video cues of a standard physical laparoscopy training box with a single fisheye camera. The developed visual tracking algorithm recovers the 3D positions of the laparoscopic instrument tips, to which simple colored tapes (markers) are attached. With such system, the extracted instrument trajectories can be digitally processed, and automated self-assessment feedback can be provided. In this way, both the physical interaction feedback would be preserved and the need for the observance of an expert would be overcome. Real-time instrument tracking with a suitable assessment criterion would constitute a significant step towards provision of real-time (immediate) feedback to correct trainee actions and show them how the action should be performed. This study is a step towards achieving this with a low cost, automated, and widely applicable laparoscopy training and assessment system using a standard physical training box equipped with a fisheye camera.

SUBMITTER: Gautier B

PROVIDER: S-EPMC8600079 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

Laparoscopy training of novices with complex curved instruments using 2D- and 3D-visualization.

Project description:PurposeBeside many advantages, disadvantages such as reduced degrees of freedom and poorer depth perception are still apparent in laparoscopic surgery. 3D visualization and the development of complex instruments are intended to counteract the disadvantages. We want to find out whether the use of complex instruments and 3D visualization has an influence on the performance of novices.Methods48 medical students with no experience in laparoscopic surgery or simulator-based laparoscopy training were included. They were randomized in four groups according to a stratification assessment. During a structured training period they completed the FLS-Tasks "PEG Transfer", "Pattern Cut" and "Intracorporeal Suture" and a transfer task based on these three. Two groups used conventional laparoscopic instruments with 3D or 2D visualization, two groups used complex curved instruments. The groups were compared in terms of their performance.ResultsIn 2D laparoscopy there was a better performance with straight instruments vs. curved instruments in PEG Transfer and Intracorporeal Suture. In the transfer task, fewer errors were made with straight instruments. In 2D vs. 3D laparoscopy when using complex curved instruments there was an advantage in Intracorporeal Suture and PEG Transfer for 3D visualization. Regarding the transfer exercise, a better performance was observed and fewer errors were made in 3D group.ConclusionWe could show that learning laparoscopic techniques with complex curved instruments is more difficult with standard 2D visualization and can be overcome using 3D optics. The use of curved instruments under 3D vision seems to be advantageous when working on more difficult tasks.

| S-EPMC10990991 | biostudies-literature

A Protocol for Real-time 3D Single Particle Tracking.

Project description:Real-time three-dimensional single particle tracking (RT-3D-SPT) has the potential to shed light on fast, 3D processes in cellular systems. Although various RT-3D-SPT methods have been put forward in recent years, tracking high speed 3D diffusing particles at low photon count rates remains a challenge. Moreover, RT-3D-SPT setups are generally complex and difficult to implement, limiting their widespread application to biological problems. This protocol presents a RT-3D-SPT system named 3D Dynamic Photon Localization Tracking (3D-DyPLoT), which can track particles with high diffusive speed (up to 20 µm2/s) at low photon count rates (down to 10 kHz). 3D-DyPLoT employs a 2D electro-optic deflector (2D-EOD) and a tunable acoustic gradient (TAG) lens to drive a single focused laser spot dynamically in 3D. Combined with an optimized position estimation algorithm, 3D-DyPLoT can lock onto single particles with high tracking speed and high localization precision. Owing to the single excitation and single detection path layout, 3D-DyPLoT is robust and easy to set up. This protocol discusses how to build 3D-DyPLoT step by step. First, the optical layout is described. Next, the system is calibrated and optimized by raster scanning a 190 nm fluorescent bead with the piezoelectric nanopositioner. Finally, to demonstrate real-time 3D tracking ability, 110 nm fluorescent beads are tracked in water.

| S-EPMC5897059 | biostudies-literature

Real-time, low-latency closed-loop feedback using markerless posture tracking.

Project description:The ability to control a behavioral task or stimulate neural activity based on animal behavior in real-time is an important tool for experimental neuroscientists. Ideally, such tools are noninvasive, low-latency, and provide interfaces to trigger external hardware based on posture. Recent advances in pose estimation with deep learning allows researchers to train deep neural networks to accurately quantify a wide variety of animal behaviors. Here, we provide a new DeepLabCut-Live! package that achieves low-latency real-time pose estimation (within 15 ms, >100 FPS), with an additional forward-prediction module that achieves zero-latency feedback, and a dynamic-cropping mode that allows for higher inference speeds. We also provide three options for using this tool with ease: (1) a stand-alone GUI (called DLC-Live! GUI), and integration into (2) Bonsai, and (3) AutoPilot. Lastly, we benchmarked performance on a wide range of systems so that experimentalists can easily decide what hardware is required for their needs.

| S-EPMC7781595 | biostudies-literature

Fast, Flexible Closed-Loop Feedback: Tracking Movement in "Real-Millisecond-Time".

Project description:One of the principal functions of the brain is to control movement and rapidly adapt behavior to a changing external environment. Over the last decades our ability to monitor activity in the brain, manipulate it while also manipulating the environment the animal moves through, has been tackled with increasing sophistication. However, our ability to track the movement of the animal in real time has not kept pace. Here, we use a dynamic vision sensor (DVS) based event-driven neuromorphic camera system to implement real-time, low-latency tracking of a single whisker that mice can move at ∼25 Hz. The customized DVS system described here converts whisker motion into a series of events that can be used to estimate the position of the whisker and to trigger a position-based output interactively within 2 ms. This neuromorphic chip-based closed-loop system provides feedback rapidly and flexibly. With this system, it becomes possible to use the movement of whiskers or in principal, movement of any part of the body to reward, punish, in a rapidly reconfigurable way. These methods can be used to manipulate behavior, and the neural circuits that help animals adapt to changing values of a sequence of motor actions.

| S-EPMC6825957 | biostudies-literature

Real Time 3D Facial Movement Tracking Using a Monocular Camera.

Project description:The paper proposes a robust framework for 3D facial movement tracking in real time using a monocular camera. It is designed to estimate the 3D face pose and local facial animation such as eyelid movement and mouth movement. The framework firstly utilizes the Discriminative Shape Regression method to locate the facial feature points on the 2D image and fuses the 2D data with a 3D face model using Extended Kalman Filter to yield 3D facial movement information. An alternating optimizing strategy is adopted to fit to different persons automatically. Experiments show that the proposed framework could track the 3D facial movement across various poses and illumination conditions. Given the real face scale the framework could track the eyelid with an error of 1 mm and mouth with an error of 2 mm. The tracking result is reliable for expression analysis or mental state inference.

| S-EPMC5017323 | biostudies-literature

An Adaptive Real-Time 3D Single Particle Tracking Method for Monitoring Viral First Contacts.

Project description:Here, an adaptive real-time 3D single particle tracking method is proposed, which is capable of capturing heterogeneous dynamics. Using a real-time measurement of a rapidly diffusing particle's positional variance, the 3D precision adaptive real-time tracking (3D-PART) microscope adjusts active-feedback parameters to trade tracking speed for precision on demand. This technique is demonstrated first on immobilized fluorescent nanoparticles, with a greater than twofold increase in the lateral localization precision (?25 to ?11 nm at 1 ms sampling) as well as a smaller increase in the axial localization precision (? 68 to ?45 nm). 3D-PART also shows a marked increase in the precision when tracking freely diffusing particles, with lateral precision increasing from ?100 to ?70 nm for particles diffusing at 4 µm2 s-1 , although with a sacrifice in the axial precision (?250 to ?350 nm). This adaptive microscope is then applied to monitoring the viral first contacts of virus-like particles to the surface of live cells, allowing direct and continuous measurement of the viral particle at initial contact with the cell surface.

| S-EPMC6824287 | biostudies-literature

Real-time single-molecule 3D tracking in E. coli based on cross-entropy minimization.

Project description:Reaching sub-millisecond 3D tracking of individual molecules in living cells would enable direct measurements of diffusion-limited macromolecular interactions under physiological conditions. Here, we present a 3D tracking principle that approaches the relevant regime. The method is based on the true excitation point spread function and cross-entropy minimization for position localization of moving fluorescent reporters. Tests on beads moving on a stage reaches 67 nm lateral and 109 nm axial precision with a time resolution of 0.84 ms at a photon count rate of 60 kHz; the measurements agree with the theoretical and simulated predictions. Our implementation also features a method for microsecond 3D PSF positioning and an estimator for diffusion analysis of tracking data. Finally, we successfully apply these methods to track the Trigger Factor protein in living bacterial cells. Overall, our results show that while it is possible to reach sub-millisecond live-cell single-molecule tracking, it is still hard to resolve state transitions based on diffusivity at this time scale.

| S-EPMC10008558 | biostudies-literature

Nanoresolution real-time 3D orbital tracking for studying mitochondrial trafficking in vertebrate axons in vivo.

Project description:We present the development and in vivo application of a feedback-based tracking microscope to follow individual mitochondria in sensory neurons of zebrafish larvae with nanometer precision and millisecond temporal resolution. By combining various technical improvements, we tracked individual mitochondria with unprecedented spatiotemporal resolution over distances of >100 µm. Using these nanoscopic trajectory data, we discriminated five motional states: a fast and a slow directional motion state in both the anterograde and retrograde directions and a stationary state. The transition pattern revealed that, after a pause, mitochondria predominantly persist in the original direction of travel, while transient changes of direction often exhibited longer pauses. Moreover, mitochondria in the vicinity of a second, stationary mitochondria displayed an increased probability to pause. The capability of following and optically manipulating a single organelle with high spatiotemporal resolution in a living organism offers a new approach to elucidating their function in its complete physiological context.

| S-EPMC6579510 | biostudies-literature

Nuclear accessibility of β-actin mRNA is measured by 3D single-molecule real-time tracking.

Project description:Imaging single proteins or RNAs allows direct visualization of the inner workings of the cell. Typically, three-dimensional (3D) images are acquired by sequentially capturing a series of 2D sections. The time required to step through the sample often impedes imaging of large numbers of rapidly moving molecules. Here we applied multifocus microscopy (MFM) to instantaneously capture 3D single-molecule real-time images in live cells, visualizing cell nuclei at 10 volumes per second. We developed image analysis techniques to analyze messenger RNA (mRNA) diffusion in the entire volume of the nucleus. Combining MFM with precise registration between fluorescently labeled mRNA, nuclear pore complexes, and chromatin, we obtained globally optimal image alignment within 80-nm precision using transformation models. We show that β-actin mRNAs freely access the entire nucleus and fewer than 60% of mRNAs are more than 0.5 µm away from a nuclear pore, and we do so for the first time accounting for spatial inhomogeneity of nuclear organization.

| S-EPMC4442804 | biostudies-literature

Performing real-time interactive fiber tracking.

Project description:Fiber tracking is a technique that, based on a diffusion tensor magnetic resonance imaging dataset, locates the fiber bundles in the human brain. Because it is a computationally expensive process, the interactivity of current fiber tracking tools is limited. We propose a new approach, which we termed real-time interactive fiber tracking, which aims at providing a rich and intuitive environment for the neuroradiologist. In this approach, fiber tracking is executed automatically every time the user acts upon the application. Particularly, when the volume of interest from which fiber trajectories are calculated is moved on the screen, fiber tracking is executed, even while it is being moved. We present our fiber tracking tool, which implements the real-time fiber tracking concept by using the video card's graphics processing units to execute the fiber tracking algorithm. Results show that real-time interactive fiber tracking is feasible on computers equipped with common, low-cost video cards.

| S-EPMC3056974 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data