首页    期刊浏览 2024年09月19日 星期四
登录注册

文章基本信息

  • 标题:Comparing Labelled Markov Decision Processes
  • 本地全文:下载
  • 作者:Stefan Kiefer ; Qiyi Tang
  • 期刊名称:LIPIcs : Leibniz International Proceedings in Informatics
  • 电子版ISSN:1868-8969
  • 出版年度:2020
  • 卷号:182
  • 页码:1-16
  • DOI:10.4230/LIPIcs.FSTTCS.2020.49
  • 出版社:Schloss Dagstuhl -- Leibniz-Zentrum fuer Informatik
  • 摘要:A labelled Markov decision process is a labelled Markov chain with nondeterminism, i.e., together with a strategy a labelled MDP induces a labelled Markov chain. The model is related to interval Markov chains. Motivated by applications of equivalence checking for the verification of anonymity, we study the algorithmic comparison of two labelled MDPs, in particular, whether there exist strategies such that the MDPs become equivalent/inequivalent, both in terms of trace equivalence and in terms of probabilistic bisimilarity. We provide the first polynomial-time algorithms for computing memoryless strategies to make the two labelled MDPs inequivalent if such strategies exist. We also study the computational complexity of qualitative problems about making the total variation distance and the probabilistic bisimilarity distance less than one or equal to one.
  • 关键词:Markov decision processes; Markov chains; Behavioural metrics
国家哲学社会科学文献中心版权所有