期刊名称:Conference on European Chapter of the Association for Computational Linguistics (EACL)
出版年度:2011
卷号:2011
出版社:ACL Anthology
摘要:This work introduces AM-FM, a semantic
framework for machine translation evaluation.
Based upon this framework, a new
evaluation metric, which is able to operate
without the need for reference translations,
is implemented and evaluated. The metric
is based on the concepts of adequacy and
fluency, which are independently assessed
by using a cross-language latent semantic
indexing approach and an n-gram based
language model approach, respectively.
Comparative analyses with conventional
evaluation metrics are conducted on two
different evaluation tasks (overall quality
assessment and comparative ranking) over
a large collection of human evaluations involving
five European languages. Finally,
the main pros and cons of the proposed
framework are discussed along with future
research directions.