Non-asymptotic and asymptotic analyses on Markov chains in several problems.

Masahito Hayashi Shun Watanabe

Published in: ITA (2014)

Keyphrases

markov chain
steady state
finite state
markov processes
markov model
markov process
search algorithm
stochastic process
transition probabilities
monte carlo
random walk
state space
stationary distribution
probability distribution
hidden markov models
optimal solution
probabilistic automata
assemble to order systems