Microsoft interview question

Questions surrounding Markov chains etc