首页    期刊浏览 2024年07月05日 星期五
登录注册

文章基本信息

  • 标题:Research on Modeling the Nonhomogenous Markov Decision Systems with Dynamic Bayesian Network
  • 本地全文:下载
  • 作者:Guo Junwen ; Qin zheng ; Heng Xingchen
  • 期刊名称:International Journal of Computer Science and Network Security
  • 印刷版ISSN:1738-7906
  • 出版年度:2006
  • 卷号:6
  • 期号:6
  • 页码:150-156
  • 出版社:International Journal of Computer Science and Network Security
  • 摘要:For the purpose of the further wide application of dynamic Bayesian networks (DBNs) to many real complex systems, a new approach was presented to improve the modeling of the Non time homogenous Markov Decision systems with DBNs, in which the extended hidden variables were introduced into the evolutional process to build Markov models required by the hypothesis conditions, a structure learning algorithm of DBNs was given from the incomplete data set and when the extended hidden variables are existed. The sufficient statistics of the subsequent time slices were estimated using Bayesian probability statistical method, and then the time-variant transition probabilities were learned using both of current sufficient statistics and estimated sufficient statistics. The theoretical analysis and simulation results show that the proposed approach is valid.
  • 关键词:Dynamic Bayesian network, Markov model, hidden variables, Bayesian probability statistical method
国家哲学社会科学文献中心版权所有