Keyphrases
- numerical solution
- markov chain
- steady state
- finite state
- transition probabilities
- partial differential equations
- differential equations
- finite element
- markov process
- random walk
- markov model
- markov processes
- stationary distribution
- state space
- transition matrix
- probabilistic automata
- exact solution
- graphical models
- machine learning