Limiting Probabilities

Given probabilities of taking paths in a graph from each node, use matrix multiplication to find the probability of going from one vertex to another in 2 stages, or 3, or 4 or even 100.
Exploring and noticing Working systematically Conjecturing and generalising Visualising and representing Reasoning, convincing and proving
Being curious Being resourceful Being resilient Being collaborative


Image
Limiting Probabilities

The numbers on the edges of this graph give the probabilities of a particle travelling along those edges in the direction given by the arrow. The same information is given by the entry $a_{ij}$ in the following matrix which gives the probability of travelling from vertex $i$ to vertex $j$. $$A=\left( \begin{array}{cccc} 0 &1 &0 &0 \\ 0 &0 &0.5 &0.5 \\ 1 &0 &0 &0 \\ 0 &0 &0 &1 \end{array} \right)$$


For this question you can use a graphic calculator or computer software to find powers of the matrices but you need to understand the definition of matrix multiplication (see the Thesaurus) to be able to do the question.


Can you see why the square of the matrix gives the probabilities of travelling from one vertex to another in two stages and the $n$th power of the matrix gives the probability of traveling from one vertex to another in $n$ stages? For example $$ A^{20}=\left( \begin{array}{cccc} 0 &0 &0.008 &0.992 \\ 0.008 &0 &0 &0.992 \\ 0 &0016 &0 &0.984 \\ 0 &0 &0 &1 \end{array} \right) $$ This matrix shows that there is zero probability of getting from vertex $1$ to vertex $2$ in $20$ stages (that is along $20$ edges with the paths along the edges being repeated), but there is a probability of $0.008$ (to 3 significant figures) of travelling from vertex $1$ to vertex $3$ in $20$ stages.


Work out $A^{21}$ and $A^{22}$ and explain the occurrences of zero and non zero entries in these matrices.


What would you expect to happen for higher powers, (e.g. $A^{100}$), and why?