Automatic Recording of the Target Location During Smooth Pursuit Eye Movement Testing Using Video-Oculography and Deep Learning-Based Object Detection.
Ontology highlight
ABSTRACT: Purpose
To accurately record the movements of a hand-held target together with the smooth pursuit eye movements (SPEMs) elicited with video-oculography (VOG) combined with deep learning-based object detection using a single-shot multibox detector (SSD).Methods
The SPEMs of 11 healthy volunteers (21.3 ± 0.9 years) were recorded using VOG. The subjects fixated on a moving target that was manually moved at a distance of 1 m by the examiner. An automatic recording system was developed using SSD to predict the type and location of objects in a single image. The 400 images that were taken of one subject using a VOG scene camera were distributed into 2 groups (300 and 100) for training and validation. The testing data included 1100 images of all subjects (100 images/subject). The method achieved 75% average precision (AP75) for the relationship between the location of the fixated target (as calculated by SSD) and the position of each eye (as recorded by VOG).Results
The AP75 for all subjects was 99.7% ± 0.6%. The horizontal and vertical target locations were significantly and positively correlated with each eye position in the horizontal and vertical directions (adjusted R2 ≥ 0.955, P < 0.001).Conclusions
The addition of SSD-driven recording of hand-held target positions with VOG allows for quantitative assessment of SPEMs following a target during an SPEM test.Translational relevance
The combined methods of VOG and SSD can be used to detect SPEMs with greater accuracy, which can improve the outcome of clinical evaluations.
SUBMITTER: Hirota M
PROVIDER: S-EPMC8107482 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:During smooth pursuit eye movement, observers often misperceive velocity. Pursued stimuli appear slower (Aubert-Fleishl phenomenon [1, 2]), stationary objects appear to move (Filehne illusion [3]), the perceived direction of moving objects is distorted (trajectory misperception [4]), and self-motion veers away from its true path (e.g., the slalom illusion [5]). Each illusion demonstrates that eye speed is underestimated with respect to image speed, a finding that has been taken as evidence of early sensory signals that differ in accuracy [4, 6-11]. Here we present an alternative Bayesian account, based on the idea that perceptual estimates are increasingly influenced by prior expectations as signals become more uncertain [12-15]. We show that the speeds of pursued stimuli are more difficult to discriminate than fixated stimuli. Observers are therefore less certain about motion signals encoding the speed of pursued stimuli, a finding we use to quantify the Aubert-Fleischl phenomenon based on the assumption that the prior for motion is centered on zero [16-20]. In doing so, we reveal an important property currently overlooked by Bayesian models of motion perception. Two Bayes estimates are needed at a relatively early stage in processing, one for pursued targets and one for image motion.
| S-EPMC2861164 | biostudies-literature
Project description:Amyotrophic lateral sclerosis (ALS) is a neurodegenerative disorder causing a progressive motor weakness of all voluntary muscles, whose progression challenges communication modalities such as handwriting or speech. The current study investigated whether ALS subjects can use Eye-On-Line (EOL), a novel eye-operated communication device allowing, after training, to voluntarily control smooth-pursuit eye-movements (SPEM) so as to eye-write in cursive. To that aim, ALS participants (n = 12) with preserved eye-movements but impaired handwriting were trained during six on-site visits. The primary outcome of the study was the recognition of eye-written digits (0-9) from ALS and healthy control subjects by naïve "readers." Changes in oculomotor performance and the safety of EOL were also evaluated. At the end of the program, 69.4% of the eye-written digits from 11 ALS subjects were recognized by naïve readers, similar to the 67.3% found for eye-written digits from controls participants, with however, large inter-individual differences in both groups of "writers." Training with EOL was associated with a transient fatigue leading one ALS subject to drop out the study at the fifth visit. Otherwise, itching eyes was the most common adverse event (3 subjects). This study shows that, despite the impact of ALS on the motor system, most ALS participants could improve their mastering of eye-movements, so as to produce recognizable eye-written digits, although the eye-traces sometimes needed smoothing to ease digit legibility from both ALS subjects and control participants. The capability to endogenously and voluntarily generate eye-traces using EOL brings a novel way to communicate for disabled individuals, allowing creative personal and emotional expression.
| S-EPMC6548885 | biostudies-literature
Project description:Several studies have indicated that human observers are very efficient at tracking self-generated hand movements with their gaze, yet it is not clear whether this is simply a by-product of the predictability of self-generated actions or if it results from a deeper coupling of the somatomotor and oculomotor systems. In a first behavioral experiment we compared pursuit performance as observers either followed their own finger or tracked a dot whose motion was externally generated but mimicked their finger motion. We found that even when the dot motion was completely predictable in terms of both onset time and kinematics, pursuit was not identical to that produced as the observers tracked their finger, as evidenced by increased rate of catch-up saccades and by the fact that in the initial phase of the movement gaze was lagging behind the dot, whereas it was ahead of the finger. In a second experiment we recorded EEG in the attempt to find a direct link between the finger motor preparation, indexed by the lateralized readiness potential (LRP) and the latency of smooth pursuit. After taking into account finger movement onset variability, we observed larger LRP amplitudes associated with earlier smooth pursuit onset across trials. The same held across subjects, where average LRP onset correlated with average eye latency. The evidence from both experiments concurs to indicate that a strong coupling exists between the motor systems leading to eye and finger movements and that simple top-down predictive signals are unlikely to support optimal coordination.
| S-EPMC4961754 | biostudies-literature
Project description:Previous studies have reported that concurrent manual tracking enhances smooth pursuit eye movements only when tracking a self-driven or a predictable moving target. Here, we used a control-theoretic approach to examine whether concurrent manual tracking enhances smooth pursuit of an unpredictable moving target. In the eye-hand tracking condition, participants used their eyes to track a Gaussian target that moved randomly along a horizontal axis. In the meantime, they used their dominant hand to move a mouse to control the horizontal movement of a Gaussian cursor to vertically align it with the target. In the eye-alone tracking condition, the target and cursor positions recorded in the eye-hand tracking condition were replayed, and participants only performed eye tracking of the target. Catch-up saccades were identified and removed from the recorded eye movements, allowing for a frequency-response analysis of the smooth pursuit response to unpredictable target motion. We found that the overall smooth pursuit gain was higher and the number of catch-up saccades made was less when eye tracking was accompanied by manual tracking than when not. We conclude that concurrent manual tracking enhances smooth pursuit. This enhancement is a fundamental property of eye-hand coordination that occurs regardless of the predictability of the target motion.
| S-EPMC4669211 | biostudies-literature
Project description:Patients with schizophrenia as well as individuals with high levels of schizotypy are known to have deficits in smooth pursuit eye movements (SPEM). Here, we investigated, for the first time, the neural mechanisms underlying SPEM performance in high schizotypy. Thirty-one healthy participants [N?=?19 low schizotypes, N?=?12 high schizotypes (HS)] underwent functional magnetic resonance imaging at 3T with concurrent oculographic recording while performing a SPEM task with sinusoidal stimuli at two velocities (0.2 and 0.4 Hz). Behaviorally, a significant interaction between schizotypy group and velocity was found for frequency of saccades during SPEM, indicating impairments in HS in the slow but not the fast condition. On the neural level, HS demonstrated lower brain activation in different regions of the occipital lobe known to be associated with early sensory and attentional processing and motion perception (V3A, middle occipital gyrus, and fusiform gyrus). This group difference in neural activation was independent of target velocity. Together, these findings replicate the observation of altered pursuit performance in highly schizotypal individuals and, for the first time, identify brain activation patterns accompanying these performance changes. These posterior activation differences are compatible with evidence of motion processing deficits from the schizophrenia literature and, therefore, suggest overlap between schizotypy and schizophrenia both on cognitive-perceptual and neurophysiological levels. However, deficits in frontal motor areas observed during pursuit in schizophrenia were not seen here, suggesting the operation of additional genetic and/or illness-related influences in the clinical disorder.
| S-EPMC6869106 | biostudies-literature
Project description:In this study, we address the question of whether a target is foveated during smooth pursuit. Specifically, we examine whether smooth pursuit eye movements land near the center-of-mass of the target, as is the case for saccades. To that end, we instructed eight untrained, healthy participants to follow moving targets, presented monocularly in a scanning laser ophthalmoscope. Stimuli moved either in a modified step-ramp (smooth pursuit), or made a single step (saccade), stepping 6° from the center. Targets were ring-shaped and either 0.6° or 1.7° in diameter. In an additional set of experiments, two participants collected more extensive data on smooth pursuit and saccades for a larger range of target sizes (0.6°, 1.7°, or 4.3°). During pursuit, eyes were rarely placed at target center, even when participants' fixational stability was taken into account. Furthermore, there was a clear tendency for distance from target center to increase with target size. This outcome was in contrast to saccades, where there was no effect of target size across participants. The difference in foveal placement between the two types of eye movements is consistent with their different purposes: closer inspection of the target for saccades versus maintenance of the target in the visual field for smooth pursuit.
| S-EPMC5213993 | biostudies-literature
Project description:Smooth pursuit eye movements (pursuit) are used to minimize the retinal motion of moving objects. During pursuit, the pattern of motion on the retina carries not only information about the object movement but also reafferent information about the eye movement itself. The latter arises from the retinal flow of the stationary world in the direction opposite to the eye movement. To extract the global direction of motion of the tracked object and stationary world, the visual system needs to integrate ambiguous local motion measurements (i.e., the aperture problem). Unlike the tracked object, the stationary world's global motion is entirely determined by the eye movement and thus can be approximately derived from motor commands sent to the eye (i.e., from an efference copy). Because retinal motion opposite to the eye movement is dominant during pursuit, different motion integration mechanisms might be used for retinal motion in the same direction and opposite to pursuit. To investigate motion integration during pursuit, we tested direction discrimination of a brief change in global object motion. The global motion stimulus was a circular array of small static apertures within which one-dimensional gratings moved. We found increased coherence thresholds and a qualitatively different reflexive ocular tracking for global motion opposite to pursuit. Both effects suggest reduced sampling of motion opposite to pursuit, which results in an impaired ability to extract coherence in motion signals in the reafferent direction. We suggest that anisotropic motion integration is an adaptation to asymmetric retinal motion patterns experienced during pursuit eye movements. NEW & NOTEWORTHY This study provides a new understanding of how the visual system achieves coherent perception of an object's motion while the eyes themselves are moving. The visual system integrates local motion measurements to create a coherent percept of object motion. An analysis of perceptual judgments and reflexive eye movements to a brief change in an object's global motion confirms that the visual and oculomotor systems pick fewer samples to extract global motion opposite to the eye movement.
| S-EPMC6589720 | biostudies-literature
Project description:Currently, there are no quantitative studies of smooth pursuit, a behavior attributed to the fovea, in individuals with macular degeneration (MD). We hypothesize that pursuit in MD patients depends on the relative positions of the scotoma and target trajectory. We tested this hypothesis with a scanning laser ophthalmoscope (SLO), which allows for direct visualization of the target on the damaged retina. Monocular microperimetry and eye movements were assessed in eleven individuals with differing degrees of MD. Observers were asked to visually track a 1.7° target that moved in one of eight radial directions at 5°/s-6°/s. Consistent with our hypothesis, pursuit metrics depended on whether the target moved into or out of scotoma. Pursuit gains decreased with increasing scotoma extent in the target's heading direction (p = 0.017). Latencies were higher when the scotoma was present along the target trajectory (in either starting or heading directions, p < 0.001). Furthermore, an analysis of retinal position shows that targets fell on the fixational locus nearly 50% of the time. The results suggest that MD patients are capable of smooth pursuit eye movements, but are limited by target trajectory and scotoma characteristics.
| S-EPMC4748745 | biostudies-literature
Project description:BackgroundPrior studies of oculomotor function in Parkinson's disease (PD) have either focused on saccades without considering smooth pursuit, or tested smooth pursuit while excluding saccades. The present study investigated the control of saccadic eye movements during pursuit tasksand assessed the quality of binocular coordinationas potential sensitive markers of PD.MethodsObservers fixated on a central cross while a target moved toward it. Once the target reached the fixation cross, observers began to pursue the moving target. To further investigate binocular coordination, the moving target was presented on both eyes (binocular condition), or on one eye only (dichoptic condition).ResultsThe PD group made more saccades than age-matched normal control adults (NC) both during fixation and pursuit. The difference between left and right gaze positions increased over time during the pursuit period for PD but not for NC. The findings were not related to age, as NC and young-adult control group (YC) performed similarly on most of the eye movement measures, and were not correlated with classical measures of PD severity (e.g., Unified Parkinson's Disease Rating Scale (UPDRS) score).DiscussionOur results suggest that PD may be associated with impairment not only in saccade inhibition, but also in binocular coordination during pursuit, and these aspects of dysfunction may be useful in PD diagnosis or tracking of disease course.
| S-EPMC6109371 | biostudies-literature
Project description:BackgroundThis study examined smooth pursuit eye movement (SPEM), prepulse inhibition (PPI), and auditory event-related potentials (ERP) to paired stimuli as putative endophenotypes of psychosis across the schizophrenia-bipolar disorder dimension.MethodsSixty-four schizophrenia probands (SZP), 40 psychotic bipolar I disorder probands (BDP), 31 relatives of SZP (SZR), 26 relatives of BDP (BDR), and 53 healthy controls (HC) were tested. Standard clinical characterization, SPEM, PPI, and ERP measures were administered.ResultsThere were no differences between either SZP and BDP or SZR and BDR on any of the SPEM, PPI, or ERP measure. Compared with HC, SZP and BDP had lower SPEM maintenance and predictive pursuit gain and ERP theta/alpha and beta magnitudes to the initial stimulus. PPI did not differ between the psychosis probands and HC. Compared with HC, SZR and BDR had lower predictive pursuit gain and ERP theta/alpha and beta magnitudes to the first stimulus with differences ranging from a significant to a trend level. Neither active symptoms severity nor concomitant medications were associated with neurophysiological outcomes. SPEM, PPI, and ERP scores had low intercorrelations.ConclusionThese findings support SPEM predictive pursuit and lower frequency auditory ERP activity in a paired stimuli paradigm as putative endophenotypes of psychosis common to SZ and BD probands and relatives. PPI did not differ between the psychosis probands and HC. Future studies in larger scale psychosis family samples targeting putative psychosis endophenotypes and underlying molecular and genetic mediators may aid in the development of biology-based diagnostic definitions.
| S-EPMC3984505 | biostudies-literature