Markov Chains


I would like to derive for myself the properties of Markov chains with discrete states in continuous time, as seen in queueing theory and other disciplines, as an exercise in staving off senility.

Keywords: Infinitesimal generator, Kolmogorov equations.

Good references include Gidi Amir and Glen Takahara.

References

Ross, Sheldon. 2008. Stochastic Processes. 2nd edition. New Delhi: WSE.

Warning! Experimental comments system! If is does not work for you, let me know via the contact form.

No comments yet!

GitHub-flavored Markdown & a sane subset of HTML is supported.