Markov Models

Page Summary This page…. This page covers just the basics.

Related Pages Probability Refresher Markov Models Lab Markov Models Problems

[[iframe x width="100%" height="500px" scroll="yes"]]
[[iframe x width="100%" height="500px" scroll="yes"]]
[[iframe x width="100%" height="500px" scroll="yes"]]

Stokey & Zeckhauser, ch. 7, "Markov Models," pp. 98-107.
Stokey & Zeckhauser, ch. 7, "Markov Models," pp.104-114.

References

http://www.stat.cmu.edu/~fienberg/Stat36-835/SingerSpilerman-AJS-1976.pdf

Burton Singer; Seymour Spilerman. 1976. "The Representation of Social Processes by Markov Models," The American Journal of Sociology, Vol. 82, No. 1. (Jul., 1976), pp. 1-54.
Kemeny, John G. and J. Laurie Snell. 1962. Mathematical Models in the Social Sciences. Boston: Ginn and Company. (Questia)

KEMENY, JOHN G. & J. LAURIE SNELL Finite Markov Chains.
Princeton NJ: D. Van Nostrand Company, 1963.

Glossary

deterministic

Said of a process when there are contingencies but these depend only on measurable or observable conditions rather than on chance. Opposite, obviously, of non-deterministic, but also, sometimes, of "stochastic" or "probabilistic." (google, wikipedia)