首页    期刊浏览 2024年11月25日 星期一
登录注册

文章基本信息

  • 标题:Automatize Document Topic and Subtopic Detection with Support of a Corpus
  • 本地全文:下载
  • 作者:Metin Turan ; Metin Turan ; Coskun Sönmez
  • 期刊名称:Procedia - Social and Behavioral Sciences
  • 印刷版ISSN:1877-0428
  • 出版年度:2015
  • 卷号:177
  • 页码:169-177
  • DOI:10.1016/j.sbspro.2015.02.373
  • 语种:English
  • 出版社:Elsevier
  • 摘要:AbstractIn this article, we propose a new automatic topic and subtopic detection method from a document called paragraph extension. In paragraph extension, a document is considered as a set of paragraphs and a paragraph merging technique is used to merge similar consecutive paragraphs until no similar consecutive paragraphs left. Following this, similar word counts in merged paragraphs are summed up to construct subtopic scores by using a corpus which is designed so that we can find words related to a subtopic. The paragraph vectors are represented by subtopics instead of the words. The subtopic of a paragraph is the most frequent one in the paragraph vector. On the other hand, topic of the document is the most dispersive subtopic in the document. An experimental topic/subtopic corpus is constructed for sport and education topics. We also supported corpus by WordNet to obtain synonyms words. We evaluate the proposed method on a data set contains randomly selected 40 documents from the education and sport topics. The experiment results show that average of topic detection success ratio is about %83 and the subtopic detection is about %68.
  • 关键词:topic detection;text mining;document summarization
国家哲学社会科学文献中心版权所有