Reviving the Two-State Markov Chain Approach.

Andrzej Mizera Jun Pang Qixia Yuan

Published in: IEEE ACM Trans. Comput. Biol. Bioinform. (2018)

Keyphrases

markov chain
transition probabilities
state space
steady state
stationary distribution
finite state
state transition
random walk
monte carlo
markov process
markov model
monte carlo simulation
monte carlo method
stochastic process
transition matrix
markov decision processes