Compositional Modeling and Minimization of Time-Inhomogeneous Markov Chains.
Tingting HanJoost-Pieter KatoenAlexandru MereacrePublished in: HSCC (2008)
Keyphrases
- markov chain
- steady state
- finite state
- transition probabilities
- markov process
- state space
- markov model
- monte carlo
- stationary distribution
- monte carlo simulation
- monte carlo method
- stochastic process
- random walk
- markov processes
- probabilistic automata
- sample path
- confidence intervals
- transition matrix
- markov models
- reinforcement learning
- queueing theory
- assemble to order systems