LAUSR.org creates dashboard-style pages of related content for over 1.5 million academic articles. Sign Up to like articles & get recommendations!

Time-inhomogeneous random Markov chains

Photo from wikipedia

We consider Markov chains with random transition probabilities which, moreover, fluctuate randomly with time. We describe such a system by a product of stochastic matrices, $U(t)=M_t\cdots M_1$, with the factors… Click to show full abstract

We consider Markov chains with random transition probabilities which, moreover, fluctuate randomly with time. We describe such a system by a product of stochastic matrices, $U(t)=M_t\cdots M_1$, with the factors $M_i$ drawn independently from an ensemble of random Markov matrices, whose columns are independent Dirichlet random variables. The statistical properties of the columns of $U(t)$, its largest eigenvalue and its spectrum are obtained exactly for $N=2$ and numerically investigated for general $N$. For large $t$, the columns are Dirichlet-distributed, however the distribution is different from the initial one. As for the spectrum, we find that the eigenvalues converge to zero exponentially fast and investigate the statistics of the largest Lyapunov exponent, which is well approximated the a Gamma distribution. We also observe a concentration of the spectrum on the real line for large $t$.

Keywords: markov; markov chains; random markov; random; time inhomogeneous

Journal Title: Journal of Statistical Mechanics: Theory and Experiment
Year Published: 2018

Link to full text (if available)


Share on Social Media:                               Sign Up to like & get
recommendations!

Related content

More Information              News              Social Media              Video              Recommended



                Click one of the above tabs to view related content.