This book is an integrated work published in two volumes. The first volume treats the basic Markov process and its variants; the second, semi-Markov and decision processes. It equips readers to formulate, analyze, and evaluate simple and advanced Markov models of systems, ranging from genetics to space engineering to marketing. 1971 edition.