首页    期刊浏览 2024年09月19日 星期四
登录注册

文章基本信息

  • 标题:A Systematic Comparison of Various Statistical Alignment Models
  • 作者:Franz Josef Och ; Hermann Ney
  • 期刊名称:Computational Linguistics
  • 印刷版ISSN:0891-2017
  • 电子版ISSN:1530-9312
  • 出版年度:2003
  • 卷号:44
  • 期号:1
  • 页码:19-51
  • DOI:10.1162/089120103321337421
  • 语种:English
  • 出版社:MIT Press
  • 摘要:We present and compare various methods for computing word alignments using statistical or heuristic models. We consider the five alignment models presented in Brown, Della Pietra, Della Pietra, and Mercer (1993), the hidden Markov alignment model, smoothing techniques, and refinements. These statistical models are compared with two heuristic models based on the Dice coefficient. We present different methods for combining word alignments to perform a symmetrization of directed statistical alignment models. As evaluation criterion, we use the quality of the resulting Viterbi alignment compared to a manually produced reference alignment. We evaluate the models on the German-English Verbmobil task and the French-English Hansards task. We perform a detailed analysis of various design decisions of our statistical alignment system and evaluate these on training corpora of various sizes. An important result is that refined alignment models with a first-order dependence and a fertility model yield significantly better results than simple heuristic models. In the Appendix, we present an efficient training algorithm for the alignment models presented.
Loading...
联系我们|关于我们|网站声明
国家哲学社会科学文献中心版权所有