Type

Conference Proceedings

Authors

Josef van Genabith
Joachim Wagner
Jennifer Foster
Deirdre Hogan

Subjects

Computer Science

Topics
parser machine translating penn treebank trained probabilistic generator training data national generators state of the art domain adaptation

Parser-based retraining for domain adaptation of probabilistic generators (2008)

Abstract While the effect of domain variation on Penn-treebank- trained probabilistic parsers has been investigated in previous work, we study its effect on a Penn-Treebank-trained probabilistic generator. We show that applying the generator to data from the British National Corpus results in a performance drop (from a BLEU score of 0.66 on the standard WSJ test set to a BLEU score of 0.54 on our BNC test set). We develop a generator retraining method where the domain-specific training data is automatically produced using state-of-the-art parser output. The retraining method recovers a substantial portion of the performance drop, resulting in a generator which achieves a BLEU score of 0.61 on our BNC test data.
Collections Ireland -> Dublin City University -> Publication Type = Conference or Workshop Item
Ireland -> Dublin City University -> DCU Faculties and Centres = DCU Faculties and Schools: Faculty of Engineering and Computing: School of Computing
Ireland -> Dublin City University -> Subject = Computer Science
Ireland -> Dublin City University -> DCU Faculties and Centres = DCU Faculties and Schools
Ireland -> Dublin City University -> Status = Published
Ireland -> Dublin City University -> Subject = Computer Science: Machine translating
Ireland -> Dublin City University -> DCU Faculties and Centres = Research Initiatives and Centres: National Centre for Language Technology (NCLT)
Ireland -> Dublin City University -> DCU Faculties and Centres = DCU Faculties and Schools: Faculty of Engineering and Computing
Ireland -> Dublin City University -> DCU Faculties and Centres = Research Initiatives and Centres

Full list of authors on original publication

Josef van Genabith, Joachim Wagner, Jennifer Foster, Deirdre Hogan

Experts in our system

1
Joachim Wagner
Dublin City University
Total Publications: 24
 
2
Jennifer Foster
Dublin City University
Total Publications: 53
 
3
Deirdre Hogan
Dublin City University
Total Publications: 14