Transition Matrix
Properties
Transition matrices are so called stochastic matrices, which means,
that all entries are real values between zero and one, meaning, that
each entry is a probability and a row sum equal one, meaning that
the probability to jump to an arbitrary state is one
From the sum-statement follows easlily, that there is a right eigenvector
with eigenvalue of one, which is constant
From the Perron-Frobenius Theorem follow immediately for stochastic
matrices, that
- there exists a positive eigenvalue of one, which is called Perron Eigenvalue
- All other eigenvalues lie within the spectral radius defined by the Perron Eigenvalue
- the associated left and right eigenvector are also non-negative, so also the left eigenvalue is non negativ.
- if all entries
are strictly positive, then, the dimension of the eigenspace associated with the Perron-Eigenvalue is one.
A transition matrix can be used to propagate a distribution of states
over time. We take a state distribution, which is a vector of dimension

and sum one. That means that the probability over all states
is one. The probability in each state is then moved to other states,
when we apply this vector to the left-hand side of the transition
matrix.
For the left Perron-Eigenvalue

can be shown, that it resembles
the stationary distribution. That means, that this distribution applied
to the transition matrix does not change, i.e. it is an eigenvector
to an eigenvalue of one.
Important to know is, that the existance of the stationary distribution
is not connected to the detailed balance property
Detailed balance is defined as
which is equivalent to a symmetry over the stationary distribution.
In some cases it is possible to postulate a generator, which taken
to the exponent can construct the transition matrix for arbitrary
timesteps.
This is only possibile (in a unique and intuitive way), if the transition
matrix is positive definite
which is due to the logarithm of the eigenvalues, which are only uniquely
defined, if the matrix is positive definite.
From the rate matrix

we get back using