Type

Conference Proceedings

Authors

Gareth J.F. Jones
Debasis Ganguly
Procheta Sen

Subjects

Computer Science

Topics
generation information storage and retrieval systems measure proactive search contextual recommendation effectiveness information retrieval evaluation metric

Procrastination is the thief of time: evaluating the effectiveness of proactive search systems (2018)

Abstract Traditional search system users actively interact with the system to complete their search task. We believe that the next generation of search systems will see a shift towards proactive understanding of user intent based on analysis of user activities. Such a proactive system could start recommending documents that are likely to help users accomplish their tasks without requiring them to explicitly submit queries to the system. We propose a framework to evaluate such a search system. The key idea behind our proposed metric is to aggregate a correlation measure over a search session between the expected outcome, which in this case refers to the list of documents retrieved with a true user query, and the predicted outcome, which refers to the list of documents recommended by a proactive search system. Experiments on the AOL query log data show that the ranking of two sample proactive IR systems induced by our metric conforms to the expected ranking between these systems.
Collections Ireland -> Dublin City University -> Publication Type = Conference or Workshop Item
Ireland -> Dublin City University -> DCU Faculties and Centres = DCU Faculties and Schools: Faculty of Engineering and Computing: School of Computing
Ireland -> Dublin City University -> DCU Faculties and Centres = Research Initiatives and Centres: ADAPT
Ireland -> Dublin City University -> Subject = Computer Science: Information storage and retrieval systems
Ireland -> Dublin City University -> Status = Published
Ireland -> Dublin City University -> Subject = Computer Science: Information retrieval

Full list of authors on original publication

Gareth J.F. Jones, Debasis Ganguly, Procheta Sen

Experts in our system

1
Gareth J. F. Jones
Dublin City University
Total Publications: 297
 
2
Debasis Ganguly
Dublin City University
Total Publications: 40
 
3
Procheta Sen
Dublin City University
Total Publications: 5