首页    期刊浏览 2024年10月04日 星期五
登录注册

文章基本信息

  • 标题:Creating Appropriate Corpus for Information Retrieval and Natural Language Processing in Persian Language
  • 本地全文:下载
  • 作者:Zahra Abdolhosseini ; Mohammad Reza Keyvanpour
  • 期刊名称:INTERNATIONAL JOURNAL OF INFORMATION SCIENCE AND MANAGEMENT
  • 印刷版ISSN:2008-8302
  • 电子版ISSN:2008-8310
  • 出版年度:2015
  • 卷号:13
  • 期号:2
  • 语种:English
  • 出版社:REGIONAL INFORMATION CENTER FOR SCIENCE AND TECHNOLOGY
  • 摘要:Persian natural language processing (NLP) researchers have many limitations to access linguistic tools which are suitable for text processing. Therefore, researchin Persian text processing is very limited. Since dataset is an important requirement for experiments and their evaluation, we aimed to create appropriate corpora for information retrieval and natural language processing in Persian. The provided corpora in this article are based on HAMSHAHRI dataset which is appropriate for simple information retrieval and simple natural language processing because it has not been tagged. We converted this dataset to tagged collection and increased its text quality. The new corpora minimize the text preprocessing requirement. Here we have used STep-1 tools for text processing and have proposed some ideas to remove the bugs of these tools in order to increase their quality. At the end we used the new corpora for text retrieval and results showed performance improvement.
国家哲学社会科学文献中心版权所有