Faster Algorithms for Quantitative Analysis of Markov Chains and Markov Decision Processes with Small Treewidth.
Ali AsadiKrishnendu ChatterjeeAmir Kafshdar GoharshadyKiarash MohammadiAndreas PavlogiannisPublished in: CoRR (2020)
Keyphrases
- quantitative analysis
- markov decision processes
- markov chain
- finite state
- state space
- policy iteration
- optimal policy
- steady state
- reinforcement learning
- average reward
- qualitative analysis
- transition probabilities
- factored mdps
- sample path
- random walk
- dynamic programming
- stochastic shortest path
- markov processes
- stationary distribution
- monte carlo
- search algorithm
- np hard
- finite horizon
- partially observable markov decision processes
- probabilistic model
- average cost
- model free
- markov decision process
- infinite horizon
- learning algorithm
- transition matrix
- least squares
- qualitative and quantitative analysis
- model checking