Material Detail

Lecture 19: Countable-state Markov Processes

Lecture 19: Countable-state Markov Processes

This video was recorded at 6.262 Discrete Stochastic Processes. Markov processes with countable state-spaces are developed in terms of the embedded Markov chain. The steady-state process probabilities and the steady-state transition probabilities are treated.

Quality

  • User Rating
  • Comments
  • Learning Exercises
  • Bookmark Collections
  • Course ePortfolios
  • Accessibility Info

More about this material

Comments

Log in to participate in the discussions or sign up if you are not already a MERLOT member.