Conference Proceedings


Gareth J.F. Jones
Mandar Mitra
Ayan Bandyopadhyay
Debasis Ganguly


Computer Science

retrieval effectiveness social media code mixing retrievability information retrieval fusion microblog retrieval retrieval strategies

Retrievability of code mixed microblogs (2016)

Abstract Mixing multiple languages within the same document, a phenomenon called (linguistic) code mixing or code switching, is a frequent trend among multilingual users of social media. In the context of information retrieval (IR), code mixing may affect retrieval effectiveness due to the mixing of different vocabularies with different collection statistics within a single collection of documents. In this paper, we investigate the indexing and retrieval strategies for a mixed collection of documents, comprising of code-mixed and the monolingual documents. In particular, we address three alternative modes of indexing, namely (a) a single index for the two sub-collections; (b) a separate index for each sub-collection; and (c) a clustered index with two individual sub-collection statistics coupled with the overall one. We make use of the expected retrievability scores of the two classes of documents to empirically show that indexing strategies (a) and (b) mostly retrieve the monolingual documents at top ranks with standard retrieval approaches. Our experiments show that, by contrast, the clustered index (c) is able to alleviate this problem by improving the retrievability of the code-mixed documents.
Collections Ireland -> Dublin City University -> Publication Type = Conference or Workshop Item
Ireland -> Dublin City University -> DCU Faculties and Centres = DCU Faculties and Schools: Faculty of Engineering and Computing: School of Computing
Ireland -> Dublin City University -> DCU Faculties and Centres = Research Initiatives and Centres: ADAPT
Ireland -> Dublin City University -> Status = Published
Ireland -> Dublin City University -> Subject = Computer Science: Information retrieval

Full list of authors on original publication

Gareth J.F. Jones, Mandar Mitra, Ayan Bandyopadhyay, Debasis Ganguly

Experts in our system

Gareth J. F. Jones
Dublin City University
Total Publications: 297
Debasis Ganguly
Dublin City University
Total Publications: 40