期刊名称：Journal of Emerging Technologies in Web Intelligence
印刷版ISSN：1798-0461
出版年度：2014
卷号：6
期号：4
页码：388-400
DOI：10.4304/jetwi.6.4.388-400
语种：English
出版社：Academy Publisher
摘要：Language Identification is the process of determining in which natural language the contents of the text is written. Language identification is always been an important research area which has been carried out from early 1970’s. Still it is a fascinating field to be studied due to increased demand of natural language processing applications. In many applications, it works as a primary step of some larger process. In this paper, a number of applications are outlined where language identification is working successfully. Language Identification can be done using two types of techniques: computational techniques and non-computational techniques. Computational techniques are based on statistical methods and requires large set of training data for each of the language while non-computational techniques require that researcher must have extensive knowledge about the language to-be-identified. In this paper, a brief review of the few papers is presented which outlines the various statistical and non-statistical techniques that have been applied by the different researchers for language identification. Besides it, different researchers performed language identification for different type of documents such as monolingual, multilingual, long and short and for a particular set of languages.
关键词：Language Identification;Natural language processing;statistical methods;n-gram model;feature extraction.
