Representing Markov chains with transition diagrams
Files
Date
Authors
Kachapova, F
Supervisor
Item type
Journal Article
Degree name
Journal Title
Journal ISSN
Volume Title
Publisher
Science Publications
Abstract
Stochastic processes have many useful applications and are taught in several university programmes. Students often encounter difficulties in learning stochastic processes and Markov chains, in particular. In this article we describe a teaching strategy that uses transition diagrams to represent a Markov chain and to re-define properties of its states in simple terms of directed graphs. This strategy utilises the students’ intuition and makes the learning of complex concepts about Markov chains faster and easier. The method is illustrated by worked examples. The described strategy helps students to master properties of finite Markov chains, so they have a solid basis for the study of infinite Markov chains and other stochastic processes.Description
Keywords
Transition diagram, Transition matrix, Markov chain, First passage time, Persistent state, Transient state, Periodic state, Inter-communicating states
Source
Journal of Mathematics and Statistics, vol.9(3), pp.149 - 154
Publisher's version
Rights statement
Science Publications publishes a collection of peer-reviewed, open access scientific journals covering all areas of science, technology and medicine. All articles published with Science Publications publishes follow the open access policy which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.