Problem 3. Consider the following Markov chain on the state space Q...