Type

Conference Proceedings

Authors

Daniel P.W. Ellis
Keansub Lee
Alan F. Smeaton
Aiden R. Doherty

Subjects

Computer Science

Topics
sensor data multimodal data segmentation image sensors image processing audio visual information storage and retrieval systems lifelog

Multimodal segmentation of lifelog data (2007)

Abstract A personal lifelog of visual and audio information can be very helpful as a human memory augmentation tool. The SenseCam, a passive wearable camera, used in conjunction with an iRiver MP3 audio recorder, will capture over 20,000 images and 100 hours of audio per week. If used constantly, very soon this would build up to a substantial collection of personal data. To gain real value from this collection it is important to automatically segment the data into meaningful units or activities. This paper investigates the optimal combination of data sources to segment personal data into such activities. 5 data sources were logged and processed to segment a collection of personal data, namely: image processing on captured SenseCam images; audio processing on captured iRiver audio data; and processing of the temperature, white light level, and accelerometer sensors onboard the SenseCam device. The results indicate that a combination of the image, light and accelerometer sensor data segments our collection of personal data better than a combination of all 5 data sources. The accelerometer sensor is good for detecting when the user moves to a new location, while the image and light sensors are good for detecting changes in wearer activity within the same location, as well as detecting when the wearer socially interacts with others.
Collections Ireland -> Dublin City University -> Publication Type = Conference or Workshop Item
Ireland -> Dublin City University -> Subject = Computer Science
Ireland -> Dublin City University -> DCU Faculties and Centres = Research Initiatives and Centres: Centre for Digital Video Processing (CDVP)
Ireland -> Dublin City University -> Subject = Computer Science: Information storage and retrieval systems
Ireland -> Dublin City University -> Status = Published
Ireland -> Dublin City University -> DCU Faculties and Centres = Research Initiatives and Centres: Adaptive Information Cluster (AIC)
Ireland -> Dublin City University -> Subject = Computer Science: Lifelog
Ireland -> Dublin City University -> DCU Faculties and Centres = Research Initiatives and Centres

Full list of authors on original publication

Daniel P.W. Ellis, Keansub Lee, Alan F. Smeaton, Aiden R. Doherty

Experts in our system

1
Alan F. Smeaton
Dublin City University
Total Publications: 450
 
2
Aiden R. Doherty
Dublin City University
Total Publications: 67