Markov Chains

by J. R. Norris

Overview

Markov chains are central to the understanding of random processes. This is not only because they pervade the applications of random processes, but also because one can calculate explicitly many quantities of interest. This textbook, aimed at advanced undergraduate or MSc students with some background in basic probability theory, focuses on Markov chains and quickly develops a coherent and rigorous theory whilst showing also how actually to apply it. Both discrete-time and continuous-time chains are studied. A distinguishing feature is an introduction to more advanced topics such as martingales and potentials in the established context of Markov chains. There are applications to simulation, economics, optimal control, genetics, queues and many other topics, and exercises and examples drawn both from theory and practice. It will therefore be an ideal text either for elementary courses on random processes or those that are more oriented towards applications.

Product Details

ISBN-13:	9781107385085
Publisher:	Cambridge University Press
Publication date:	07/28/1998
Series:	Cambridge Series in Statistical and Probabilistic Mathematics , #2
Sold by:	Barnes & Noble
Format:	eBook
File size:	35 MB
Note:	This product may take a few minutes to download.

Table of Contents

Introduction; 1. Discrete-time Markov chains; 2. Continuous-time Markov chains I; 3. Continuous-time Markov chains II; 4. Further theory; 5. Applications; Appendix; Probability and measure; Index.

Editorial Reviews

"...impressive ....I heartily recommend this book....this is the best book available summarizing the theory of Markov Chains....Norris achieves for Markov Chains what Kingman has so elegantly achieved for Poisson processes....Such creative tinkering will be a pleasure to many teachers." Bulletin of Mathematical Biology

From the Publisher