首页    期刊浏览 2024年09月19日 星期四
登录注册

文章基本信息

  • 标题:Computing Probabilistic Bisimilarity Distances via Policy Iteration
  • 本地全文:下载
  • 作者:Qiyi Tang ; Franck van Breugel
  • 期刊名称:LIPIcs : Leibniz International Proceedings in Informatics
  • 电子版ISSN:1868-8969
  • 出版年度:2016
  • 卷号:59
  • 页码:22:1-22:15
  • DOI:10.4230/LIPIcs.CONCUR.2016.22
  • 出版社:Schloss Dagstuhl -- Leibniz-Zentrum fuer Informatik
  • 摘要:A transformation mapping a labelled Markov chain to a simple stochastic game is presented. In the resulting simple stochastic game, each vertex corresponds to a pair of states of the labelled Markov chain. The value of a vertex of the simple stochastic game is shown to be equal to the probabilistic bisimilarity distance, a notion due to Desharnais, Gupta, Jagadeesan and Panangaden, of the corresponding pair of states of the labelled Markov chain. Bacci, Bacci, Larsen and Mardare introduced an algorithm to compute the probabilistic bisimilarity distances for a labelled Markov chain. A modification of a basic version of their algorithm for a labelled Markov chain is shown to be the policy iteration algorithm applied to the corresponding simple stochastic game. Furthermore, it is shown that this algorithm takes exponential time in the worst case.
  • 关键词:labelled Markov chain; simple stochastic game; probabilistic bisimilarity; pseudometric; value function; policy iteration
国家哲学社会科学文献中心版权所有