Type

Conference Proceedings

Authors

Alan F. Smeaton
Andy Way
Wei B. Li
Debasis Ganguly
Jinhua Du
Haithem Afli
Manuela Hurlimann
Brian Davis
Tobias Daudert
Lucas Azevedo
and 7 others

Subjects

Computer Science

Topics
computational linguistics artificial intelligence digital video video captions multimedia systems imaging systems semantic concept image processing machine learning

Dublin City University and Partners’ Participation in the INS and VTT Tracks at TRECVid 2016 (2016)

Abstract Dublin City University participated with a consortium of colleagues from NUI Galway and Universitat Politecnica de Catalunya in two tasks in TRECVid 2016, Instance Search (INS) and Video to Text (VTT). For the INS task we developed a framework consisting of face detection and representation and place detection and representation, with a user annotation of top-ranked videos. For the VTT task we ran 1,000 concept detectors from the VGG-16 deep CNN on 10 keyframes per video and submitted 4 runs for caption re-ranking, based on BM25, Fusion, word2vec and a fusion of baseline BM25 and word2vec. With the same pre-processing for caption generation we used an open source image-to-caption CNN-RNN toolkit NeuralTalk2 to generate a caption for each keyframe and combine them.
Collections Ireland -> Dublin City University -> Status = Published
Ireland -> Dublin City University -> Subject = Engineering: Imaging systems
Ireland -> Dublin City University -> Subject = Computer Science: Computational linguistics
Ireland -> Dublin City University -> Subject = Computer Science: Multimedia systems
Ireland -> Dublin City University -> DCU Faculties and Centres = DCU Faculties and Schools: Faculty of Engineering and Computing: School of Electronic Engineering
Ireland -> Dublin City University -> DCU Faculties and Centres = Research Initiatives and Centres: INSIGHT Centre for Data Analytics
Ireland -> Dublin City University -> Publication Type = Conference or Workshop Item
Ireland -> Dublin City University -> DCU Faculties and Centres = DCU Faculties and Schools: Faculty of Engineering and Computing: School of Computing
Ireland -> Dublin City University -> Subject = Computer Science: Artificial intelligence
Ireland -> Dublin City University -> Subject = Computer Science: Image processing
Ireland -> Dublin City University -> Subject = Computer Science: Digital video
Ireland -> Dublin City University -> Subject = Computer Science: Machine learning

Full list of authors on original publication

Alan F. Smeaton, Andy Way, Wei B. Li, Debasis Ganguly, Jinhua Du, Haithem Afli, Manuela Hurlimann, Brian Davis, Tobias Daudert, Lucas Azevedo and 7 others

Experts in our system

1
Alan F. Smeaton
Dublin City University
Total Publications: 450
 
2
Andy Way
Dublin City University
Total Publications: 149
 
3
Wei Li
Dublin City University
Total Publications: 11
 
4
Debasis Ganguly
Dublin City University
Total Publications: 28
 
5
Jinhua Du
Dublin City University
Total Publications: 22