首页    期刊浏览 2024年09月19日 星期四
登录注册

文章基本信息

  • 标题:Improving Basic Natural Language Processing Tools for the Ainu Language
  • 本地全文:下载
  • 作者:Karol Nowakowski ; Michal Ptaszynski ; Fumito Masui
  • 期刊名称:Information
  • 电子版ISSN:2078-2489
  • 出版年度:2019
  • 卷号:10
  • 期号:11
  • 页码:329-349
  • DOI:10.3390/info10110329
  • 出版社:MDPI Publishing
  • 摘要:Ainu is a critically endangered language spoken by the native inhabitants of northern Japan. This paper describes our research aimed at the development of technology for automatic processing of text in Ainu. In particular, we improved the existing tools for normalizing old transcriptions, word segmentation, and part-of-speech tagging. In the experiments we applied two Ainu language dictionaries from different domains (literary and colloquial) and created a new data set by combining them. The experiments revealed that expanding the lexicon had a positive impact on the overall performance of our tools, especially with test data unrelated to any of the training sets used.
  • 关键词:Ainu language; endangered languages; normalization; word segmentation; part-of-speech tagging Ainu language ; endangered languages ; normalization ; word segmentation ; part-of-speech tagging
国家哲学社会科学文献中心版权所有