Type

Conference Proceedings

Authors

Noel E. O'Connor
Xavier Giro-i-Nieto
Kevin McGuinness
Marc Assens

Subjects

Computer Science

Topics
images cross entropy prediction neural network machine learning image processing parameters artificial intelligence

SaltiNet: scan-path prediction on 360 degree images using saliency volumes (2017)

Abstract We introduce SaltiNet, a deep neural network for scanpath prediction trained on 360-degree images. The model is based on a temporal-aware novel representation of saliency information named the saliency volume. The first part of the network consists of a model trained to generate saliency volumes, whose parameters are fit by back-propagation computed from a binary cross entropy (BCE) loss over downsampled versions of the saliency volumes. Sampling strategies over these volumes are used to generate scanpaths over the 360-degree images. Our experiments show the advantages of using saliency volumes, and how they can be used for related tasks. Our source code and trained models available at: https://github.com/massens/saliency-360salient-2017
Collections Ireland -> Dublin City University -> Publication Type = Conference or Workshop Item
Ireland -> Dublin City University -> Subject = Computer Science: Artificial intelligence
Ireland -> Dublin City University -> Subject = Computer Science: Image processing
Ireland -> Dublin City University -> Status = Published
Ireland -> Dublin City University -> DCU Faculties and Centres = DCU Faculties and Schools: Faculty of Engineering and Computing: School of Electronic Engineering
Ireland -> Dublin City University -> DCU Faculties and Centres = Research Initiatives and Centres: INSIGHT Centre for Data Analytics
Ireland -> Dublin City University -> Subject = Computer Science: Machine learning

Full list of authors on original publication

Noel E. O'Connor, Xavier Giro-i-Nieto, Kevin McGuinness, Marc Assens

Experts in our system

1
Noel E. O'Connor
Dublin City University
Total Publications: 420
 
2
Xavier Giro-i-Nieto
Dublin City University
Total Publications: 8
 
3
Kevin McGuinness
Dublin City University
Total Publications: 65