Saccade Gaze Prediction Using a Recurrent Neural Network

Abstract

We present a model that generates close-to-human gaze sequences for a given image in the free viewing task. The proposed approach leverages recent advances in image recognition using convolutional neural networks and sequence modeling with recurrent neural networks. Feature maps from convolutional neural networks are used as inputs to a recurrent neural network. The recurrent neural network acts like a visual working memory that integrates the scene informationand outputs a sequence of saccades. The model is trained end-to-end with real-world human eye-tracking data using back propagation and adaptive stochastic gradient descent. Overall, the proposed model is simple compared to the state-ofthe-art methods while offering favorable performance on a standard eye-tracking data set.

[PDF] [BibTex]
Thuyen Ngo, B.S. Manjunath,
IEEE International Conference on Image Processing, Beijing, China, Sep. 2017.
Node ID: 699 , Lab: VRL , Target: Conference
Subject: [Detection on Images and Videos] « Look up more