期刊名称：INTERNATIONAL JOURNAL OF INFORMATION SCIENCE AND MANAGEMENT
印刷版ISSN：2008-8302
电子版ISSN：2008-8310
出版年度：2015
卷号：13
期号：2
语种：English
出版社：REGIONAL INFORMATION CENTER FOR SCIENCE AND TECHNOLOGY
摘要：Persian natural language processing (NLP) researchers have many limitations to access linguistic tools which are suitable for text processing. Therefore, researchin Persian text processing is very limited. Since dataset is an important requirement for experiments and their evaluation, we aimed to create appropriate corpora for information retrieval and natural language processing in Persian. The provided corpora in this article are based on HAMSHAHRI dataset which is appropriate for simple information retrieval and simple natural language processing because it has not been tagged. We converted this dataset to tagged collection and increased its text quality. The new corpora minimize the text preprocessing requirement. Here we have used STep-1 tools for text processing and have proposed some ideas to remove the bugs of these tools in order to increase their quality. At the end we used the new corpora for text retrieval and results showed performance improvement.
