For Book: See the link https://amzn.to/2NirzXT
This video describes the basic concept and terms for the Stochastic process and Markov Chain Model. The Transition Probability Matrix is also described with Illustrative examples.
#OptimizationProbStat
Other videos ‪@DrHarishGarg‬
Lecture 1: Markov Chain & TPM:    • Lecture #1: Stochastic process and Ma...  
Lecture 2: Problems using TPM Part 1:    • Lecture #2: Solved Problems of the Ma...  
Lecture 3: Problems using TPM Part 2:    • Lecture #3: Solved Problems of the Ma...  
Lecture 4: Problems using TPM Part 3:    • Lecture #4: Solved Examples of Markov...  
Lecture 5: Stationary Probabilities:    • Lecture #5: Stationary Probability fo...  
Lecture 6: ChapmanKolmogorov Equation & Theorem:    • ChapmanKolmogorov Equation & Theorem...