首页    期刊浏览 2025年03月01日 星期六
登录注册

文章基本信息

  • 标题:Construction of Context Models for Word Sense Disambiguation
  • 本地全文:下载
  • 作者:Bernard Brosseau-Villeneuve ; Noriko Kando ; Jian-Yun Nie
  • 期刊名称:Information and Media Technologies
  • 电子版ISSN:1881-0896
  • 出版年度:2011
  • 卷号:6
  • 期号:3
  • 页码:701-729
  • DOI:10.11185/imt.6.701
  • 出版社:Information and Media Technologies Editorial Board
  • 摘要:This paper presents a study on the use of word context features for Word Sense Disambiguation (WSD). State-of-the-art WSD systems achieve high accuracy by using resources such as dictionaries, taggers, lexical analyzers or topic modeling packages. However, these resources are either too heavy or don't have sufficient coverage for large-scale tasks such as information retrieval. The use of local context for WSD is common, but the rationale behind the formulation of features is often based on trial and error. We therefore investigate the notion of relatedness of context words to the target word (the word to be disambiguated), and propose an unsupervised method for finding the optimal weights for context words based on their distance to the target word. The key idea behind the method is that the optimal weights should maximize the similarity of two context models constructed from different context samples of the same word. Our experimental results show that the strength of the relation between two words follows approximately a power law. The resulting context models are used in Naïve Bayes classifiers for word sense disambiguation. Our evaluation on Semeval WSD tasks in both English and Japanese show that our method can achieve state-of-the-art effectiveness even though it does not use external tools like most existing methods. The high efficiency makes it possible to use our method in large scale applications such as information retrieval.
  • 关键词:Computer science;Natural Language Processing;NLP;Word Sense Disambiguation;WSD;Word context;Word relation;Decaying function;Stop words;Naïve Bayes
国家哲学社会科学文献中心版权所有