Calculate n-step transition probabilities using Chapman-Kolmogorov equations: P⁽ⁿ⁾ = Pⁿ
The fundamental equations for computing multi-step transition probabilities:
In matrix form:
The n-step transition matrix is simply the n-th power of the one-step matrix: