Reachability problems for Markov chains.

S. Akshay Timos Antonopoulos Joël Ouaknine James Worrell

Published in: Inf. Process. Lett. (2015)

Keyphrases

markov chain
state space
steady state
monte carlo
markov model
finite state
markov processes
transition matrix
queueing theory
probabilistic automata
stationary distribution
random walk
stochastic process
theoretical guarantees
transition probabilities
reinforcement learning
learning algorithm