Unknown

Dataset Information

0

COCO-Search18 fixation dataset for predicting goal-directed attention control.


ABSTRACT: Attention control is a basic behavioral process that has been studied for decades. The currently best models of attention control are deep networks trained on free-viewing behavior to predict bottom-up attention control - saliency. We introduce COCO-Search18, the first dataset of laboratory-quality goal-directed behavior large enough to train deep-network models. We collected eye-movement behavior from 10 people searching for each of 18 target-object categories in 6202 natural-scene images, yielding [Formula: see text] 300,000 search fixations. We thoroughly characterize COCO-Search18, and benchmark it using three machine-learning methods: a ResNet50 object detector, a ResNet50 trained on fixation-density maps, and an inverse-reinforcement-learning model trained on behavioral search scanpaths. Models were also trained/tested on images transformed to approximate a foveated retina, a fundamental biological constraint. These models, each having a different reliance on behavioral training, collectively comprise the new state-of-the-art in predicting goal-directed search fixations. Our expectation is that future work using COCO-Search18 will far surpass these initial efforts, finding applications in domains ranging from human-computer interactive systems that can anticipate a person's intent and render assistance to the potentially early identification of attention-related clinical disorders (ADHD, PTSD, phobia) based on deviation from neurotypical fixation behavior.

SUBMITTER: Chen Y 

PROVIDER: S-EPMC8062491 | biostudies-literature | 2021 Apr

REPOSITORIES: biostudies-literature

altmetric image

Publications

COCO-Search18 fixation dataset for predicting goal-directed attention control.

Chen Yupei Y   Yang Zhibo Z   Ahn Seoyoung S   Samaras Dimitris D   Hoai Minh M   Zelinsky Gregory G  

Scientific reports 20210422 1


Attention control is a basic behavioral process that has been studied for decades. The currently best models of attention control are deep networks trained on free-viewing behavior to predict bottom-up attention control - saliency. We introduce COCO-Search18, the first dataset of laboratory-quality goal-directed behavior large enough to train deep-network models. We collected eye-movement behavior from 10 people searching for each of 18 target-object categories in 6202 natural-scene images, yiel  ...[more]

Similar Datasets

| S-EPMC8218820 | biostudies-literature
| S-EPMC8218821 | biostudies-literature
| S-EPMC6410956 | biostudies-literature
| S-EPMC4526432 | biostudies-literature
| S-EPMC7004226 | biostudies-literature
| S-EPMC10688971 | biostudies-literature
| S-EPMC11562430 | biostudies-literature
| S-EPMC7040085 | biostudies-literature
| S-EPMC4979628 | biostudies-literature
| S-EPMC7054261 | biostudies-literature