Model Checking of Infinite State Space Markov Chains by Stochastic Bounds.
Mouad Ben MamounNihal PekerginPublished in: ASMTA (2008)
Keyphrases
- markov chain
- model checking
- state space
- stochastic process
- monte carlo
- markov processes
- finite state
- temporal logic
- probabilistic automata
- reachability analysis
- model checker
- transition probabilities
- formal verification
- reinforcement learning
- random walk
- dynamic programming
- heuristic search
- formal specification
- symbolic model checking
- markov decision processes
- state variables
- automated verification
- stationary distribution
- planning problems
- finite state machines
- markov model
- verification method
- bounded model checking
- timed automata
- computation tree logic
- epistemic logic
- temporal properties
- optimal policy
- formal methods
- search space
- transition matrix
- particle filter
- dynamical systems
- variance reduction
- transition systems
- action space
- partially observable
- initial state
- infinite horizon
- fully observable
- belief state
- learning algorithm