Model Checking Finite-Horizon Markov Chains with Probabilistic Inference.
Steven HoltzenSebastian JungesMarcell Vazquez-ChanlatteTodd D. MillsteinSanjit A. SeshiaGuy Van den BroeckPublished in: CAV (2) (2021)
Keyphrases
- probabilistic inference
- finite horizon
- model checking
- markov chain
- finite state
- average cost
- optimal policy
- state space
- temporal logic
- infinite horizon
- markov decision process
- transition probabilities
- markov decision processes
- graphical models
- bayesian networks
- monte carlo
- conditional probabilities
- random walk
- message passing
- markov model
- probabilistic reasoning
- dynamic programming
- stochastic process
- approximate inference
- belief networks
- reinforcement learning
- finite state machines
- non stationary
- data mining
- generative model
- objective function
- machine learning