Hidden Markov Models in Context

The original paper on conditional random fields. Contains a good discussion of the label-bias problem. Notoriously difficult to understand - see other references for friendlier introductions to the topic.

Original paper on maximum entropy Markov models (MEMMs). Motivates the use of discriminative models for language. Approachable introduction to the subject with impressive results.

Good tutorial on Bayesian belief networks, including a discussion of the human reasoning paradigms they are meant to model and the mistaken assumption that Bayesian networks imply a use of Bayesian statistics. Contains the excellent diagram of the generative model family by S. Roweis and Z. Gharamani. Details common and less common members of the HMM family and Includes many other diagrams and links to external sources.

Another tutorial on dynamic Bayesian networks that discusses the problems with factorial and coupled HMMs in more detail. Covers more ground than the author's 1998 tutorial at a higher level, including a short discussion of the Rao-Blackwellised particle filter. Erroneously attributes MAP estimation to frequentist statistics.

The classic tutorial on hidden Markov models (HMMs). Heavy emphasis on the extension to HMMs commonly used in speech recognition (and the Aruspix project). Difficult to ascertain the target audience; only the first few sections will be helpful to newcomers.

Details the foundation of the automatic accompaniment system that Raphael built later. Another good example of hidden Markov models as applied to musical applications.

One of the most impressive uses of an HMM variant in the domain of music information retrieval. Details an elaborate Bayesian network for modelling the accomaniment process. The system is implemented and successfully adjusts its tempo to the performer in real time.

Excellent introduction to the hidden Markov model and its relatives in the generative family. Includes pseudo-code implementations of the most significant algorithms. Does not include the authors' famous diagram of the family.

A more accessible introduction to conditional random fields (CRFs) than the original paper. Good discussion of the link between CRFs and HMMs and the distinction between generative and discriminative models. Concludes with a new model for time dependencies in the CRF, the skip-chain CRF.

Classic introduction to the Kalman filter and the extended Kalman filter. Careful and clear description of the mathematics involved. Has more of a feel of electrical engineering than computer science.