Markov Chain Interesting Links (pdf) http://people.math.aau.dk/~jm/courses/PhD06StocSim/Chapters2.4.5.pdf Nice introduction to Markov Chains with good examples like ‘a man walks in a small town’ changing randomly at corners his direction and many other good examples like ‘weather in different cities’ and good mathematical descriptions.