Type

Conference Proceedings

Authors

Nick Campbell
Gareth J.F. Jones
Keith Curtis

Subjects

Computer Science

Topics
eye tracking automatic speech recognition asr classification video summarisation digital video high level features evalueation

Utilising high-level features in summarisation of academic presentations (2017)

Abstract We present a novel method for the generation of automatic video summaries of academic presentations. We base our investigation on a corpus of multimodal academic conference presentations combining transcripts with paralinguistic multimodal features. We First generate summaries based on keywords by using transcripts created using automatic speech recognition (ASR). Start and end times for each spoken phrase are identiFied from the ASR transcript, then a value for each phrase created. Spoken phrases are then augmented by incorporating scores for human annotation of paralinguistic features. These features measure audience engagement, comprehension and speaker emphasis. We evaluate the effectiveness of summaries generated for individual presentations, created using speech transcripts and paralinguistic multimodal features, by performing eye-tracking evaluation of participants as they watch summaries and full presentations, and by questionnaire of participants upon completion of eye-tracking studies. Summaries were also evaluated for effectiveness by performing comparisons with an enhanced digital video browser
Collections Ireland -> Dublin City University -> Publication Type = Conference or Workshop Item
Ireland -> Dublin City University -> DCU Faculties and Centres = DCU Faculties and Schools: Faculty of Engineering and Computing: School of Computing
Ireland -> Dublin City University -> DCU Faculties and Centres = Research Initiatives and Centres: ADAPT
Ireland -> Dublin City University -> Status = Published

Full list of authors on original publication

Nick Campbell, Gareth J.F. Jones, Keith Curtis

Experts in our system

1
Nick Campbell
Trinity College Dublin
Total Publications: 15
 
2
Gareth J. F. Jones
Dublin City University
Total Publications: 297
 
3
Keith Curtis
Dublin City University
Total Publications: 4