Markov decision processes with quasi-hyperbolic discounting
Sign Up to like & getrecommendations! Published in 2020 at "Finance and Stochastics"
DOI: 10.1007/s00780-020-00443-2
Abstract: We study Markov decision processes with Borel state spaces under quasi-hyperbolic discounting. This type of discounting nicely models human behaviour, which is time-inconsistent in the long run. The decision maker has preferences changing in time.… read more here.
Keywords: decision; markov decision; decision processes; hyperbolic discounting ... See more keywords
Contractive Approximations in Risk-Sensitive Average Semi-Markov Decision Chains on a Finite State Space
Sign Up to like & getrecommendations! Published in 2022 at "Journal of Optimization Theory and Applications"
DOI: 10.1007/s10957-021-01968-y
Abstract: This work concerns with semi-Markov decision chains evolving on a finite state space. The controller has a positive and constant risk sensitivity coefficient, and the performance of a control policy is measured by the risk-sensitive… read more here.
Keywords: markov decision; finite state; risk sensitive; semi markov ... See more keywords
Designing Energy Efficient Strategies Using Markov Decision Process for Crowd-Sensing Applications
Sign Up to like & getrecommendations! Published in 2020 at "Mobile Networks and Applications"
DOI: 10.1007/s11036-020-01522-6
Abstract: In mobile crowd-sensing, smartphone users take part in sensing and then share the data to the server (cloud) and get an incentive. These data can be utilized for providing better services to improve quality of… read more here.
Keywords: crowd; energy; markov decision; decision process ... See more keywords
Continuous-Time Zero-Sum Games for Markov Decision Processes with Discounted Risk-Sensitive Cost Criterion
Sign Up to like & getrecommendations! Published in 2021 at "Dynamic Games and Applications"
DOI: 10.1007/s13235-021-00391-2
Abstract: In this paper, we study two-person zero-sum stochastic games for controlled continuous time Markov decision processes with risk-sensitive discounted cost criterion. The transition and cost rates are possibly unbounded. For the zero-sum stochastic game, we… read more here.
Keywords: markov decision; zero sum; continuous time; sum ... See more keywords
Semantic-based topic detection using Markov decision processes
Sign Up to like & getrecommendations! Published in 2017 at "Neurocomputing"
DOI: 10.1016/j.neucom.2017.02.020
Abstract: In the field of text mining, topic modeling and detection are fundamental problems in public opinion monitoring, information retrieval, social media analysis, and other activities. Document clustering has been used for topic detection at the… read more here.
Keywords: detection; using markov; markov decision; decision processes ... See more keywords
Risk-sensitive semi-Markov decision processes with general utilities and multiple criteria
Sign Up to like & getrecommendations! Published in 2018 at "Advances in Applied Probability"
DOI: 10.1017/apr.2018.36
Abstract: Abstract In this paper we investigate risk-sensitive semi-Markov decision processes with a Borel state space, unbounded cost rates, and general utility functions. The performance criteria are several expected utilities of the total cost in a… read more here.
Keywords: sensitive semi; risk sensitive; markov decision; decision processes ... See more keywords
Application of Markov decision process in scheduling strategy on cloud storage
Sign Up to like & getrecommendations! Published in 2018 at "Journal of Interdisciplinary Mathematics"
DOI: 10.1080/09720502.2018.1498309
Abstract: Abstract Storage density of the traditional cloud storage system is not big and the comprehensive storage efficiency is low. When the large amount of data increases dramatically, the storage efficiency of the system would be… read more here.
Keywords: decision process; storage; markov decision; cloud storage ... See more keywords
Intelligent decision making for overtaking maneuver using mixed observable Markov decision process
Sign Up to like & getrecommendations! Published in 2018 at "Journal of Intelligent Transportation Systems"
DOI: 10.1080/15472450.2017.1334558
Abstract: ABSTRACT Overtaking maneuver is one of the most dangerous scenarios for road vehicles especially in two-way roads. In this article, we propose a new formulation for the problem of overtaking in two-way roads using the… read more here.
Keywords: decision; markov decision; mixed observable; decision process ... See more keywords
Constrained Markov Decision Process Modeling for Sequential Optimization of Additive Manufacturing Build Quality
Sign Up to like & getrecommendations! Published in 2018 at "IEEE Access"
DOI: 10.1109/access.2018.2872391
Abstract: Additive manufacturing (AM) provides a greater level of flexibility to produce a 3-D part with complex geometries directly from the design. However, the widespread application of AM is currently hampered by technical challenges in process… read more here.
Keywords: quality; constrained markov; markov decision; process ... See more keywords
A New Markov Decision Process Based Behavioral Prediction System for Airborne Crews
Sign Up to like & getrecommendations! Published in 2020 at "IEEE Access"
DOI: 10.1109/access.2019.2961239
Abstract: In order to ensure the normal and stable flights in the aircraft, a variety of sensors and corresponding instrumentation systems have been applied on the aircraft to monitor/control the current flight status, and the resulted… read more here.
Keywords: markov decision; system; decision process; flight ... See more keywords
Mitigating Cascading Failures in Power Grids via Markov Decision-Based Load-Shedding With DC Power Flow Model
Sign Up to like & getrecommendations! Published in 2022 at "IEEE Systems Journal"
DOI: 10.1109/jsyst.2022.3175359
Abstract: Despite the reliability of modern power systems, large blackouts due to cascading failures (CFs) do occur in power grids with enormous economic and societal costs. In this article, CFs in power grids are theoretically modeled… read more here.
Keywords: load shedding; markov decision; cascading failures; power ... See more keywords