Formalization of Finite-State Discrete-Time Markov Chains in HOL.
Liya LiuOsman HasanSofiène TaharPublished in: ATVA (2011)
Keyphrases
- finite state
- markov chain
- transition probabilities
- steady state
- state space
- markov processes
- markov model
- monte carlo
- formal methods
- markov process
- random walk
- stationary distribution
- stochastic process
- average cost
- transition matrix
- partially observable markov decision processes
- continuous state
- markov decision processes