Type

Conference Proceedings

Authors

Noel E. O'Connor
Gareth J. F. Jones
Andrew Salway
Mark Hughes

Subjects

Computer Science

Topics
image processing low level features relations multimedia communication multimedia analysis semantic media adaptation and personalisation information retrieval personalization

Analyzing image-text relations for semantic media adaptation and personalization (2007)

Abstract Progress in semantic media adaptation and personalisation requires that we know more about how different media types, such as texts and images, work together in multimedia communication. To this end, we present our ongoing investigation into image-text relations. Our idea is that the ways in which the meanings of images and texts relate in multimodal documents, such as web pages, can be classified on the basis of low-level media features and that this classification should be an early processing step in systems targeting semantic multimedia analysis. In this paper we present the first empirical evidence that humans can predict something about the main theme of a text from an accompanying image, and that this prediction can be emulated by a machine via analysis of low- level image features. We close by discussing how these findings could impact on applications for news adaptation and personalisation, and how they may generalise to other kinds of multimodal documents and to applications for semantic media retrieval, browsing, adaptation and creation.
Collections Ireland -> Dublin City University -> Publication Type = Conference or Workshop Item
Ireland -> Dublin City University -> Subject = Computer Science: Image processing
Ireland -> Dublin City University -> Subject = Computer Science
Ireland -> Dublin City University -> DCU Faculties and Centres = Research Initiatives and Centres: Centre for Digital Video Processing (CDVP)
Ireland -> Dublin City University -> Status = Published
Ireland -> Dublin City University -> Subject = Computer Science: Information retrieval
Ireland -> Dublin City University -> DCU Faculties and Centres = Research Initiatives and Centres

Full list of authors on original publication

Noel E. O'Connor, Gareth J. F. Jones, Andrew Salway, Mark Hughes

Experts in our system

1
Noel E. O'Connor
Dublin City University
Total Publications: 449
 
2
Gareth J. F. Jones
Dublin City University
Total Publications: 297