首页    期刊浏览 2024年11月28日 星期四
登录注册

文章基本信息

  • 标题:The Interplay of Task Success and Dialogue Quality: An in-depth Evaluation in Task-Oriented Visual Dialogues
  • 本地全文:下载
  • 作者:Alberto Testoni ; Raffaella Bernardi
  • 期刊名称:Conference on European Chapter of the Association for Computational Linguistics (EACL)
  • 出版年度:2021
  • 卷号:2021
  • 页码:2071-2082
  • DOI:10.18653/v1/2021.eacl-main.178
  • 语种:English
  • 出版社:ACL Anthology
  • 摘要:When training a model on referential dialogue guessing games, the best model is usually chosen based on its task success. We show that in the popular end-to-end approach, this choice prevents the model from learning to generate linguistically richer dialogues, since the acquisition of language proficiency takes longer than learning the guessing task. By comparing models playing different games (GuessWhat, GuessWhich, and Mutual Friends), we show that this discrepancy is model- and task-agnostic. We investigate whether and when better language quality could lead to higher task success. We show that in GuessWhat, models could increase their accuracy if they learn to ground, encode, and decode also words that do not occur frequently in the training set.
国家哲学社会科学文献中心版权所有