Challenge Level

The numbers on the edges of this graph give the probabilities
of a particle travelling along those edges in the direction given
by the arrow. The same information is given by the entry $a_{ij}$
in the following matrix which gives the probability of travelling
from vertex $i$ to vertex $j$. $$A=\left( \begin{array}{cccc} 0
&1 &0 &0 \\ 0 &0 &0.5 &0.5 \\ 1 &0
&0 &0 \\ 0 &0 &0 &1 \end{array} \right)$$

For this question you can use a graphic calculator or computer
software to find powers of the matrices but you need to understand
the definition of matrix multiplication (see the Thesaurus) to be
able to do the question.

Can you see why the square of the matrix gives the
probabilities of travelling from one vertex to another in two
stages and the $n$th power of the matrix gives the probability of
traveling from one vertex to another in $n$ stages? For example $$
A^{20}=\left( \begin{array}{cccc} 0 &0 &0.008 &0.992 \\
0.008 &0 &0 &0.992 \\ 0 &0016 &0 &0.984 \\
0 &0 &0 &1 \end{array} \right) $$ This matrix shows
that there is zero probability of getting from vertex $1$ to vertex
$2$ in $20$ stages (that is along $20$ edges with the paths along
the edges being repeated), but there is a probability of $0.008$
(to 3 significant figures) of travelling from vertex $1$ to vertex
$3$ in $20$ stages.

Work out $A^{21}$ and $A^{22}$ and explain the occurrences of
zero and non zero entries in these matrices.

What would you expect to happen for higher powers, (e.g.
$A^{100}$), and why?