Type

Journal Article

Authors

Alan F. Smeaton
Hyowon Lee
Noel E. O'Connor
Bart Lehane

Subjects

Computer Science

Topics
low level features finite state machines fsms digital video audiovisual analysis event detection multimedia systems video indexing video summarisation

Indexing of fictional video content for event detection and summarisation (2007)

Abstract This paper presents an approach to movie video indexing that utilises audiovisual analysis to detect important and meaningful temporal video segments, that we term events. We consider three event classes, corresponding to dialogues, action sequences, and montages, where the latter also includes musical sequences. These three event classes are intuitive for a viewer to understand and recognise whilst accounting for over 90% of the content of most movies. To detect events we leverage traditional filmmaking principles and map these to a set of computable low-level audiovisual features. Finite state machines (FSMs) are used to detect when temporal sequences of specific features occur. A set of heuristics, again inspired by filmmaking conventions, are then applied to the output of multiple FSMs to detect the required events. A movie search system, named MovieBrowser, built upon this approach is also described. The overall approach is evaluated against a ground truth of over twenty-three hours of movie content drawn from various genres and consistently obtains high precision and recall for all event classes. A user experiment designed to evaluate the usefulness of an event-based structure for both searching and browsing movie archives is also described and the results indicate the usefulness of the proposed approach.
Collections Ireland -> Dublin City University -> Publication Type = Article
Ireland -> Dublin City University -> Subject = Computer Science
Ireland -> Dublin City University -> DCU Faculties and Centres = Research Initiatives and Centres: Centre for Digital Video Processing (CDVP)
Ireland -> Dublin City University -> Status = Published
Ireland -> Dublin City University -> DCU Faculties and Centres = Research Initiatives and Centres: Adaptive Information Cluster (AIC)
Ireland -> Dublin City University -> Subject = Computer Science: Multimedia systems
Ireland -> Dublin City University -> Subject = Computer Science: Digital video
Ireland -> Dublin City University -> DCU Faculties and Centres = Research Initiatives and Centres

Full list of authors on original publication

Alan F. Smeaton, Hyowon Lee, Noel E. O'Connor, Bart Lehane

Experts in our system

1
Alan F. Smeaton
Dublin City University
Total Publications: 475
 
2
Noel E. O'Connor
Dublin City University
Total Publications: 449