Reversible Markov Chains and Random Walks on Graphs

Chapter 3 Reversible Markov Chains (September 10, 2002)

Chapter 2 margin: 9/10/99 versionreviewed some aspects of the elementary theory of general finite irreducible Markov chains. In this chapter we specialize to reversible chains, treating the discrete-time and continuous-time cases in parallel. After Section 3.3 we shall assume that we are dealing with reversible chains without continually repeating this assumption, and shall instead explicitly say “general” to mean not necessarily reversible.