Transient Analysis of Acyclic Markov Chains.

Raymond A. Marie Andrew L. Reibman Kishor S. Trivedi

Published in: Perform. Evaluation (1987)

Keyphrases

markov chain
steady state
markov processes
stochastic process
markov process
monte carlo
markov model
transition probabilities
stationary distribution
machine learning
np hard
markov decision processes
monte carlo method
sample path