Template:WebNotes/Discrete Markov Chain: Difference between revisions
Jump to navigation
Jump to search
John Leavitt (talk | contribs) (Removed a template to make future edits easier. Replaced it with text on this page.) |
John Leavitt (talk | contribs) (Removed spaces to improve formatting.) |
||
| Line 9: | Line 9: | ||
|- | |- | ||
| valign="middle" | | | valign="middle" | | ||
A Markov chain diagram is the graphical representation of a system that can be in various states, including the possible transitions between those states. Each state block represents a state, while each transition line represents a fixed probability (discrete Markov) or constant transition rate (continuous Markov) to move from one state to another. | A Markov chain diagram is the graphical representation of a system that can be in various states, including the possible transitions between those states. Each state block represents a state, while each transition line represents a fixed probability (discrete Markov) or constant transition rate (continuous Markov) to move from one state to another. | ||
In discrete Markov diagrams, the system moves from state to state in steps. These steps are not necessarily time-based; although they can represent a fixed period of time, they can also represent distance or any other measurement. At each step, there is a fixed probability of the system transitioning to another state. | In discrete Markov diagrams, the system moves from state to state in steps. These steps are not necessarily time-based; although they can represent a fixed period of time, they can also represent distance or any other measurement. At each step, there is a fixed probability of the system transitioning to another state. | ||
| Line 36: | Line 34: | ||
<br> | <br> | ||
<br> | <br> | ||
Revision as of 23:44, 30 March 2015
 |
| Discrete Markov Chain |
|
A Markov chain diagram is the graphical representation of a system that can be in various states, including the possible transitions between those states. Each state block represents a state, while each transition line represents a fixed probability (discrete Markov) or constant transition rate (continuous Markov) to move from one state to another. In discrete Markov diagrams, the system moves from state to state in steps. These steps are not necessarily time-based; although they can represent a fixed period of time, they can also represent distance or any other measurement. At each step, there is a fixed probability of the system transitioning to another state. |
Learn more from...
|
the help files... |
|
the theory textbook... |