首页    期刊浏览 2024年07月09日 星期二
登录注册

文章基本信息

  • 标题:Fracture Mechanics Method for Word Embedding Generation of Neural Probabilistic Linguistic Model
  • 本地全文:下载
  • 作者:Size Bi ; Xiao Liang ; Ting-lei Huang
  • 期刊名称:Computational Intelligence and Neuroscience
  • 印刷版ISSN:1687-5265
  • 电子版ISSN:1687-5273
  • 出版年度:2016
  • 卷号:2016
  • DOI:10.1155/2016/3506261
  • 出版社:Hindawi Publishing Corporation
  • 摘要:Word embedding, a lexical vector representation generated via the neural linguistic model (NLM), is empirically demonstrated to be appropriate for improvement of the performance of traditional language model. However, the supreme dimensionality that is inherent in NLM contributes to the problems of hyperparameters and long-time training in modeling. Here, we propose a force-directed method to improve such problems for simplifying the generation of word embedding. In this framework, each word is assumed as a point in the real world; thus it can approximately simulate the physical movement following certain mechanics. To simulate the variation of meaning in phrases, we use the fracture mechanics to do the formation and breakdown of meaning combined by a 2-gram word group. With the experiments on the natural linguistic tasks of part-of-speech tagging, named entity recognition and semantic role labeling, the result demonstrated that the 2-dimensional word embedding can rival the word embeddings generated by classic NLMs, in terms of accuracy, recall, and text visualization.
国家哲学社会科学文献中心版权所有