Inferring the Structure of a Markov Chain from its Output

Published in: FOCS (1985)

Keyphrases

markov chain
steady state
transition probabilities
monte carlo
random walk
stationary distribution
finite state
stochastic process
markov process
monte carlo simulation
markov model
state transition
state space
monte carlo method
transition matrix
higher order
single server
markov chain monte carlo
machine learning