Consider the observations of a man carrying an umbrella.
Supposing that we do not know what the weather is, can we deduce from the presence of his umbrella?
Let the state of the weather be recorded as shown.
Let the initial probabilities be as shown.
Let the transition probabilities be as shown.
The probability of two days of sunshine, followed by two days of rain is