Markov Chain properties in terms of column sums of the transition matrix

Date
2012
Authors
Hunter, JJ
Supervisor
Item type
Journal Article
Degree name
Journal Title
Journal ISSN
Volume Title
Publisher
Faculty of Mathematics and Computer Science, University of Tartu
Abstract

Questions are posed regarding the influence that the column sums of the transition probabilities of a stochastic matrix (with row sums all one) have on the stationary distribution, the mean first passage times and the Kemeny constant of the associated irreducible discrete time Markov chain. Some new relationships, including some inequalities, and partial answers to the questions, are given using a special generalized matrix inverse that has not previously been considered in the literature on Markov chains.

Description
Keywords
Markov chains , Stochastic matrices , Column sums , Stationary distributions , Mean rst passage times , Kemeny constant , Generalized matrix inverses
Source
Acta et Commentationes Universitatis Tartuensis de Mathematica, vol.16(1), pp.33 - 51 (29)
DOI
Rights statement
Acta et Commentationes Universitatis Tartuensis de Mathematica is an open access journal starting with volume 14 (2010). This means that all content is freely available without charge on the website of the journal (http://www.math.ut.ee/acta/). Users are allowed to read, download, copy, distribute, print, search, or link to the full texts of the articles in this journal without asking prior permission from the publisher or the author.