期刊名称：Conference on European Chapter of the Association for Computational Linguistics (EACL)
出版年度：2017
卷号：2017
页码：188-198
语种：English
出版社：ACL Anthology
摘要：This paper proposes a generic method for the comparative evaluation of system outputs. The approach is able to quantify the pairwise differences between two outputs and to unravel in detail what the differences consist of. We apply our approach to three tasks in Computational Linguistics, i.e. POS tagging, dependency parsing, and coreference resolution. We find that system outputs are more distinct than the (often) small differences in evaluation scores seem to suggest.
