首页    期刊浏览 2024年09月13日 星期五
登录注册

文章基本信息

  • 标题:Outlier Detection in Automatic Collocation Extraction
  • 本地全文:下载
  • 作者:Octavio Santana Suárez ; Octavio Santana Suárez ; Isabel Sánchez-Berriel
  • 期刊名称:Procedia - Social and Behavioral Sciences
  • 印刷版ISSN:1877-0428
  • 出版年度:2015
  • 卷号:198
  • 页码:433-441
  • DOI:10.1016/j.sbspro.2015.07.463
  • 语种:English
  • 出版社:Elsevier
  • 摘要:AbstractIn this paper we have analysed different association measures between words, generally used for the automatic extraction of collocations in textual corpus. Specifically, they have been considered: relative frequency, mutual information, z-score, t-score and Dunning's test. The volume of handled corpus (300000000 words) requires reviewing of the usual approach to this matter, so a solution that is based on methods used to detect statistical outliers is proposed. It is evident from the results that a lot of free combinations extracted with collocations coming from the comparison of words with very different frequencies of use. For this reason, they are applied considering that each word generates a different sample, instead of generating rankings which come from corpus considered as a single sample. The experiment is also performed on a corpus with a much smaller amount of words and the results are reported so contrasted with those obtained with the full corpus. The conclusions and contributions arising give response automatic extraction of collocations from a textual corpus regardless its volume.
  • 关键词:collocations;association measures;outliers.
国家哲学社会科学文献中心版权所有