LAUSR.org creates dashboard-style pages of related content for over 1.5 million academic articles. Sign Up to like articles & get recommendations!

Discounted approximations to the risk-sensitive average cost in finite Markov chains

Photo by sammiechaffin from unsplash

Abstract This work concerns with Markov chains on a finite state space, which is endowed with a cost function. The evolution of the chain is observed by an agent with… Click to show full abstract

Abstract This work concerns with Markov chains on a finite state space, which is endowed with a cost function. The evolution of the chain is observed by an agent with constant risk-sensitivity and, assuming that the state space is a communicating class, the relation between the risk-sensitive discounted and average performance criteria is studied. It is proved that, as the discount factor increases to 1, an appropriate normalization of the discounted value function converges to the average cost. Also, it is shown that if the classical normalization used in the risk-neutral case is applied in the risk-sensitive context, then the normalized discounted value function converges to an arithmetic mean of the average cost.

Keywords: risk sensitive; discounted approximations; markov chains; average cost; cost

Journal Title: Journal of Mathematical Analysis and Applications
Year Published: 2017

Link to full text (if available)


Share on Social Media:                               Sign Up to like & get
recommendations!

Related content

More Information              News              Social Media              Video              Recommended



                Click one of the above tabs to view related content.