Steady state availability general equations of decision and sequential processes in Continuous Time Markov Chain models.
Eduardo M. VasconcelosPublished in: CoRR (2017)
Keyphrases
- markov chain
- steady state
- transition probabilities
- monte carlo simulation
- explicit expressions
- stochastic process
- finite state
- monte carlo
- markov process
- stationary distribution
- transition matrix
- state space
- markov processes
- random walk
- monte carlo method
- markov model
- product form
- markov chain monte carlo
- state dependent
- special case
- stochastic processes
- probabilistic model
- markov models
- fluid model
- arrival rate
- queue length
- queueing networks
- importance sampling
- model selection
- complex systems
- random variables
- search algorithm