Type

Conference Proceedings

Authors

Qun Liu
Andy Way
Zhaopeng Tu
Xiaojun Zhang
Longyue Wang

Subjects

Linguistics

Topics
construction machine translating information retrieval machine translation movie subtitle discourse corpus dialogue movie script

Automatic construction of discourse corpora for dialogue translation (2016)

Abstract In this paper, a novel approach is proposed to automatically construct parallel discourse corpus for dialogue machine translation. Firstly, the parallel subtitle data and its corresponding monolingual movie script data are crawled and collected from Internet. Then tags such as speaker and discourse boundary from the script data are projected to its subtitle data via an information retrieval approach in order to map monolingual discourse to bilingual texts. We not only evaluate the mapping results, but also integrate speaker information into the translation. Experiments show our proposed method can achieve 81.79% and 98.64% accuracy on speaker and dialogue boundary annotation, and speaker-based language model adaptation can obtain around 0.5 BLEU points improvement in translation qualities. Finally, we publicly release around 100K parallel discourse data with manual speaker and dialogue boundary annotation.
Collections Ireland -> Dublin City University -> Publication Type = Conference or Workshop Item
Ireland -> Dublin City University -> DCU Faculties and Centres = DCU Faculties and Schools: Faculty of Engineering and Computing: School of Computing
Ireland -> Dublin City University -> DCU Faculties and Centres = Research Initiatives and Centres: ADAPT
Ireland -> Dublin City University -> Status = Published
Ireland -> Dublin City University -> Subject = Computer Science: Machine translating

Full list of authors on original publication

Qun Liu, Andy Way, Zhaopeng Tu, Xiaojun Zhang, Longyue Wang

Experts in our system

1
Qun Liu
Dublin City University
Total Publications: 31
 
2
Andy Way
Dublin City University
Total Publications: 229
 
3
Zhaopeng Tu
Dublin City University
Total Publications: 6
 
4
Longyue Wang
Dublin City University
Total Publications: 8