This is a free, online textbook offered by Bookboon.com. According to the author, "This is the eighth book of examples from the Theory of Probability. The topic Stochastic Processes is so huge that I have chosen to split the material into two books. In the present first book we shall deal with examples of Random Walk and Markov chains, where the latter topic is very large. In the next book we give examples of Poisson processes, birth and death processes, queueing theory and other types of stochastic processes.
The prerequisites for the topics can e.g. be found in the Ventus: Calculus 2 series and the Ventus: Complex Function Theory series, and all the previous Ventus: Probability c1-c7."
