Type

Conference Proceedings

Authors

Noel E. O'Connor
Kevin McGuinness
Xavier Giro-i-Nieto
Marc Assens

Subjects

Computer Science

Topics
learning strategies neural network prediction image processing machine learning networks artificial intelligence supervised learning

PathGAN: visual scanpath prediction with generative adversarial networks (2019)

Abstract We introduce PathGAN, a deep neural network for visual scanpath prediction trained on adversarial examples. A visual scanpath is defined as the sequence of fixation points over an image defined by a human observer with its gaze. PathGAN is composed of two parts, the generator and the discriminator. Both parts extract features from images using off-the-shelf networks, and train recurrent layers to generate or discriminate scanpaths accordingly. In scanpath prediction, the stochastic nature of the data makes it very difficult to generate realistic predictions using supervised learning strategies, but we adopt adversarial training as a suitable alternative. Our experiments prove how PathGAN improves the state of the art of visual scanpath prediction on the iSUN and Salient360! datasets.
Collections Ireland -> Dublin City University -> Publication Type = Conference or Workshop Item
Ireland -> Dublin City University -> Subject = Computer Science: Artificial intelligence
Ireland -> Dublin City University -> Subject = Computer Science: Image processing
Ireland -> Dublin City University -> Status = Published
Ireland -> Dublin City University -> DCU Faculties and Centres = DCU Faculties and Schools: Faculty of Engineering and Computing: School of Electronic Engineering
Ireland -> Dublin City University -> DCU Faculties and Centres = Research Initiatives and Centres: INSIGHT Centre for Data Analytics
Ireland -> Dublin City University -> Subject = Computer Science: Machine learning

Full list of authors on original publication

Noel E. O'Connor, Kevin McGuinness, Xavier Giro-i-Nieto, Marc Assens

Experts in our system

1
Noel E. O'Connor
Dublin City University
Total Publications: 474
 
2
Kevin McGuinness
Dublin City University
Total Publications: 93
 
3
Xavier Giro-i-Nieto
Dublin City University
Total Publications: 18
 
4
Marc Assens
Dublin City University
Total Publications: 3