Type

Conference Proceedings

Authors

Alan F. Smeaton
Jiang Zhou
Eric Arazo Sanchez
Noel E. O'Connor
Kevin McGuinness
Daniel Cosgrove
Jinhua Du
Feiyan Hu
Haithem Afli

Subjects

Computer Science

Topics
image processing digital video deep learning video captions computational linguistics the dublin city artificial intelligence dublin city

Dublin City University participation in the VTT track at TRECVid 2017 (2017)

Abstract Dublin City University participated in the video-to-text caption generation task in TRECVid and this paper describes the three approaches we took for our 4 submitted runs. The first approach is based on extracting regularly-spaced keyframes from a video, generating a text caption for each keyframe and then combining the keyframe captions into a single caption. The second approach is based on detecting image crops from those keyframes using saliency map to include as much of the attractive part of the image as possible, generating a caption for each crop in each keyframe, and combining the captions into one. The third approach is an end-to-end system, a true deep learning submission based on MS-COCO, an externally available set of training captions. The paper presents a description and the official results of each of the approaches.
Collections Ireland -> Dublin City University -> Publication Type = Conference or Workshop Item
Ireland -> Dublin City University -> DCU Faculties and Centres = DCU Faculties and Schools: Faculty of Engineering and Computing: School of Computing
Ireland -> Dublin City University -> Subject = Computer Science: Artificial intelligence
Ireland -> Dublin City University -> Subject = Computer Science: Image processing
Ireland -> Dublin City University -> Status = Published
Ireland -> Dublin City University -> Subject = Computer Science: Computational linguistics
Ireland -> Dublin City University -> DCU Faculties and Centres = DCU Faculties and Schools: Faculty of Engineering and Computing: School of Electronic Engineering
Ireland -> Dublin City University -> Subject = Computer Science: Digital video
Ireland -> Dublin City University -> DCU Faculties and Centres = Research Initiatives and Centres: INSIGHT Centre for Data Analytics

Full list of authors on original publication

Alan F. Smeaton, Jiang Zhou, Eric Arazo Sanchez, Noel E. O'Connor, Kevin McGuinness, Daniel Cosgrove, Jinhua Du, Feiyan Hu, Haithem Afli

Experts in our system

1
Alan F. Smeaton
Dublin City University
Total Publications: 492
 
2
Jiang Zhou
Dublin City University
Total Publications: 18
 
3
Eric Arazo Sanchez
Dublin City University
Total Publications: 3
 
4
Noel E. O'Connor
Dublin City University
Total Publications: 474
 
5
Kevin McGuinness
Dublin City University
Total Publications: 93
 
6
Jinhua Du
Dublin City University
Total Publications: 39
 
7
Feiyan Hu
Dublin City University
Total Publications: 16
 
8
Haithem Afli
Dublin City University
Total Publications: 14