Type

Journal Article

Authors

Alan F. Smeaton
Yang Shiqiang
Lifeng Sun
Peng Wang

Subjects

Computer Science

Topics
refinement propagation semantic indexing lifelog concept detection enhancement context fusion digital video factorization

Training-free indexing refinement for visual media via multi-semantics (2016)

Abstract Indexing of visual media based on content analysis has now moved beyond using individual concept detectors and there is now a focus on combining concepts by post-processing the outputs of individual concept detection. Due to the limitations and availability of training corpora which are usually sparsely and imprecisely labeled with concept groundtruth, training-based refinement methods for semantic indexing of visual media suffer in correctly capturing relationships between concepts, including co-occurrence and ontological relationships. In contrast to training-dependent methods which dominate this field, this paper presents a training-free refinement (TFR) algorithm for enhancing semantic indexing of visual media based purely on concept detection results, making the refinement of initial concept detections based on semantic enhancement, practical and flexible. This is achieved using what can be called multi-semantics, factoring in semantics from multiple sources. In the case of this paper, global and temporal neighbourhood information inferred from the original concept detections in terms of weighted non-negative matrix factorization and neighbourhood-based graph propagation are both used in the refinement of semantics. Furthermore, any available ontological concept relationships among concepts can also be integrated into this model as an additional source of external a priori knowledge. Extended experiments on two heterogeneous datasets, images from wearable cameras and videos from TRECVid, demonstrate the efficacy of the proposed TFR solution.
Collections Ireland -> Dublin City University -> DCU Faculties and Centres = DCU Faculties and Schools: Faculty of Engineering and Computing: School of Computing
Ireland -> Dublin City University -> Publication Type = Article
Ireland -> Dublin City University -> Status = Published
Ireland -> Dublin City University -> Subject = Computer Science: Lifelog
Ireland -> Dublin City University -> Subject = Computer Science: Digital video
Ireland -> Dublin City University -> DCU Faculties and Centres = Research Initiatives and Centres: INSIGHT Centre for Data Analytics

Full list of authors on original publication

Alan F. Smeaton, Yang Shiqiang, Lifeng Sun, Peng Wang

Experts in our system

1
Alan F. Smeaton
Dublin City University
Total Publications: 475
 
2
Lifeng Sun
Dublin City University
Total Publications: 6
 
3
Peng Wang
Dublin City University
Total Publications: 16