Model Checking Finite-Horizon Markov Chains with Probabilistic Inference.
Steven HoltzenSebastian JungesMarcell Vazquez-ChanlatteTodd D. MillsteinSanjit A. SeshiaGuy Van den BroeckPublished in: CoRR (2021)
Keyphrases
- probabilistic inference
- finite horizon
- model checking
- markov chain
- finite state
- average cost
- optimal policy
- state space
- infinite horizon
- temporal logic
- graphical models
- markov decision processes
- markov decision process
- transition probabilities
- bayesian networks
- approximate inference
- probabilistic reasoning
- random walk
- conditional probabilities
- monte carlo
- belief networks
- message passing
- markov model
- finite state machines
- stochastic process
- dynamic programming
- long run
- non stationary
- reinforcement learning
- search space
- special case
- random variables