Estimation of state-transition probability matrices in asynchronous population Markov processes.

Waleed A. Farahat H. Harry Asada

Published in: ACC (2010)

Keyphrases

transition probabilities
markov processes
markov chain
markov process
random walk
stationary distribution
markov models
state space
steady state
markov model
markov random walk
stochastic process
continuous time markov chains
stochastic processes
parameter estimation
reinforcement learning
social networks