首页    期刊浏览 2024年07月09日 星期二
登录注册

文章基本信息

  • 标题:A Decentralized Partially Observable Markov Decision Model with Action Duration for Goal Recognition in Real Time Strategy Games
  • 本地全文:下载
  • 作者:Peng Jiao ; Kai Xu ; Shiguang Yue
  • 期刊名称:Discrete Dynamics in Nature and Society
  • 印刷版ISSN:1026-0226
  • 电子版ISSN:1607-887X
  • 出版年度:2017
  • 卷号:2017
  • DOI:10.1155/2017/4580206
  • 出版社:Hindawi Publishing Corporation
  • 摘要:Multiagent goal recognition is a tough yet important problem in many real time strategy games or simulation systems. Traditional modeling methods either are in great demand of detailed agents’ domain knowledge and training dataset for policy estimation or lack clear definition of action duration. To solve the above problems, we propose a novel Dec-POMDM-T model, combining the classic Dec-POMDP, an observation model for recognizer, joint goal with its termination indicator, and time duration variables for actions with action termination variables. In this paper, a model-free algorithm named cooperative colearning based on Sarsa is used. Considering that Dec-POMDM-T usually encounters multiagent goal recognition problems with different sorts of noises, partially missing data, and unknown action durations, the paper exploits the SIS PF with resampling for inference under the dynamic Bayesian network structure of Dec-POMDM-T. In experiments, a modified predator-prey scenario is adopted to study multiagent joint goal recognition problem, which is the recognition of the joint target shared among cooperative predators. Experiment results show that (a) Dec-POMDM-T works effectively in multiagent goal recognition and adapts well to dynamic changing goals within agent group; (b) Dec-POMDM-T outperforms traditional Dec-MDP-based methods in terms of precision, recall, and -measure.
国家哲学社会科学文献中心版权所有