LAUSR.org creates dashboard-style pages of related content for over 1.5 million academic articles. Sign Up to like articles & get recommendations!

A unified perturbation analysis framework for countable Markov chains

Photo from wikipedia

Abstract In this paper, we are devoted to singular perturbation analysis for discrete-time or continuous-time Markov chains. We modify and extend the drift condition method, well known for regular perturbation,… Click to show full abstract

Abstract In this paper, we are devoted to singular perturbation analysis for discrete-time or continuous-time Markov chains. We modify and extend the drift condition method, well known for regular perturbation, to develop a new framework for singular perturbation analysis. Our results extend and improve the corresponding ones in [2] for singularly perturbed Markov chains by allowing a general perturbation form, less restrictive conditions, and more computable bounds. Our analysis covers the regular perturbation analysis, and hence unifies singular and regular perturbation analysis. Furthermore, our results are illustrated by two two-dimensional Markov chains, including a discrete-time queue and a continuous-time level dependent quasi-birth-death process.

Keywords: analysis; markov chains; time; perturbation analysis; perturbation

Journal Title: Linear Algebra and its Applications
Year Published: 2017

Link to full text (if available)


Share on Social Media:                               Sign Up to like & get
recommendations!

Related content

More Information              News              Social Media              Video              Recommended



                Click one of the above tabs to view related content.