LAUSR.org creates dashboard-style pages of related content for over 1.5 million academic articles. Sign Up to like articles & get recommendations!

Compositional Construction of Finite MDPs for Large-Scale Stochastic Switched Systems: A Dissipativity Approach

Photo by cbpsc1 from unsplash

Abstract In this paper, we provide a compositional technique for constructing finite abstractions (a.k.a. finite Markov decision processes) for networks of discrete-time stochastic switched systems. The proposed framework is based… Click to show full abstract

Abstract In this paper, we provide a compositional technique for constructing finite abstractions (a.k.a. finite Markov decision processes) for networks of discrete-time stochastic switched systems. The proposed framework is based on the notion of stochastic simulation functions, using which one can employ a finite MDP as a substitution of the original one in the controller design process with guaranteed error bounds on their output trajectories. In this respect, we first leverage dissipativity-type compositional conditions for quantifying the error between the interconnection of stochastic switched subsystems and that of their finite abstractions. We then propose an approach to construct finite MDPs together with their corresponding stochastic simulation functions for a particular class of nonlinear stochastic switched systems. To demonstrate the effectiveness of our proposed results, we apply our approaches to two different case studies.

Keywords: stochastic switched; finite mdps; dissipativity; switched systems

Journal Title: IFAC-PapersOnLine
Year Published: 2019

Link to full text (if available)


Share on Social Media:                               Sign Up to like & get
recommendations!

Related content

More Information              News              Social Media              Video              Recommended



                Click one of the above tabs to view related content.