Type

Conference Proceedings

Authors

Alan F. Smeaton
Lifeng Sun
Shiqiang Yang
Peng Wang

Subjects

Computer Science

Topics
hidden markov models behaviour human activities lifelog classification effectiveness semantic concepts human behaviour

Improving the classification of quantified self activities and behaviour using a Fisher kernel (2015)

Abstract Visual recording of everyday human activities and behaviour over the long term is now feasible and with the widespread use of wearable devices embedded with cameras this offers the potential to gain real insights into wearers’ activities and behaviour. To date we have concentrated on automatically detecting semantic concepts from within visual lifelogs yet identifying human activities from such lifelogged images or videos is still a major challenge if we are to use lifelogs to maximum benefit. In this paper, we propose an activity classification method from visual lifelogs based on Fisher kernels, which extract discriminative embeddings from Hidden Markov Models (HMMs) of occurrences of semantic concepts. By using the gradients as features, the resulting classifiers can better distinguish different activities and from that we can make inferences about human behaviour. Experiments show the effectiveness of this method in improving classification accuracy, especially when the semantic concepts are initially detected with low degrees of accuracy.
Collections Ireland -> Dublin City University -> Publication Type = Conference or Workshop Item
Ireland -> Dublin City University -> DCU Faculties and Centres = DCU Faculties and Schools: Faculty of Engineering and Computing: School of Computing
Ireland -> Dublin City University -> Status = Published
Ireland -> Dublin City University -> Subject = Computer Science: Lifelog
Ireland -> Dublin City University -> DCU Faculties and Centres = Research Initiatives and Centres: INSIGHT Centre for Data Analytics

Full list of authors on original publication

Alan F. Smeaton, Lifeng Sun, Shiqiang Yang, Peng Wang

Experts in our system

1
Alan F. Smeaton
Dublin City University
Total Publications: 450
 
2
Lifeng Sun
Dublin City University
Total Publications: 4
 
3
Shiqiang Yang
Dublin City University
Total Publications: 3
 
4
Peng Wang
Dublin City University
Total Publications: 14