In order to provide content-based search on image media, including images and video, they are typically accessed based on manual or automatically assigned concepts or tags, or sometimes based on image-image similarity depending on the use case. While great progress has been made in very recent years in automatic concept detection using machine learning, we are still left with a mis-match between the semantics of the concepts we can automatically detect, and the semantics of the words used in a user’s query, for example. In this paper we report on a large collection of images from wearable cameras gathered as part of the Kids’Cam project, which have been both manually annotated from a vocabulary of 83 concepts, and automatically annotated from a vocabulary of 1,000 concepts. This collection allows us to explore issues around how language, in the form of two distinct concept vocabularies or spaces, one manually assigned and thus forming a ground-truth, is used to represent images, in our case taken using wearable cameras. It also allows us to discuss, in general terms, issues around mis-match of concepts in visual media, which derive from language mis-matches. We report the data processing we have completed on this collection and some of our initial experimentation in mapping across the two language vocabularies.
Ireland ->
Dublin City University ->
Publication Type = Conference or Workshop Item
Ireland ->
Dublin City University ->
DCU Faculties and Centres = DCU Faculties and Schools: Faculty of Engineering and Computing: School of Computing
Ireland ->
Dublin City University ->
Subject = Computer Science: Image processing
Ireland ->
Dublin City University ->
Status = Published
Ireland ->
Dublin City University ->
Subject = Computer Science: Lifelog
Ireland ->
Dublin City University ->
Subject = Computer Science: Information retrieval
Ireland ->
Dublin City University ->
DCU Faculties and Centres = DCU Faculties and Schools: Faculty of Engineering and Computing: School of Electronic Engineering
Ireland ->
Dublin City University ->
Subject = Business: Marketing
Ireland ->
Dublin City University ->
DCU Faculties and Centres = Research Initiatives and Centres: INSIGHT Centre for Data Analytics
Ireland ->
Dublin City University ->
Subject = Computer Science: Machine learning
Cliona Ní Mhurchú,
Tim Chambers,
Michelle Barr,
James Stanley,
Moira Smith,
Louise Signal,
Andre Freitas,
Lucas Azevedo,
Brian Davis,
Peng Wang
and 5 others