Approximate Abstractions of Markov Chains with Interval Decision Processes (Extended Version).
Yuriy Zacchia LunJack WheatleyAlessandro D'InnocenzoAlessandro AbatePublished in: CoRR (2018)
Keyphrases
- markov chain
- decision processes
- steady state
- finite state
- decision problems
- decision making
- markov model
- markov process
- decision process
- transition probabilities
- random walk
- state space
- stochastic process
- markov decision processes
- stationary distribution
- markov processes
- reasoning process
- confidence intervals
- probabilistic automata
- optimal policy
- transition matrix