Time-Inhomogeneous Markov Chains and Piecewise Deterministic Markov Processes.

Alexandru Mereacre

Published in: AlgoSyn (2010)

Keyphrases

markov processes
markov chain
markov process
steady state
finite state
random walk
stochastic process
markov model
stationary distribution
transition probabilities
state space
transition matrix
learning algorithm
maximum likelihood
optimal solution