Keyphrases
- markov chain
- online communities
- higher order
- transition probabilities
- state space
- steady state
- finite state
- social networks
- monte carlo method
- markov processes
- random walk
- markov models
- markov process
- stochastic process
- pairwise
- stationary distribution
- transition matrix
- probabilistic automata
- markov model
- social networking
- reinforcement learning
- confidence intervals
- content analysis
- social media
- learning algorithm
- machine learning