LAUSR

About LAUSR
Donate
Contact Us

Follow us:

You are not signed in:

Sign Up!


   Articles with "markov decision" as a keyword



Markov decision processes with quasi-hyperbolic discounting

Sign Up to like & get
recommendations! Published in 2020 at "Finance and Stochastics"

DOI: 10.1007/s00780-020-00443-2

Abstract: We study Markov decision processes with Borel state spaces under quasi-hyperbolic discounting. This type of discounting nicely models human behaviour, which is time-inconsistent in the long run. The decision maker has preferences changing in time.… read more here.

Keywords: decision; markov decision; decision processes; hyperbolic discounting ... See more keywords

Contractive Approximations in Risk-Sensitive Average Semi-Markov Decision Chains on a Finite State Space

Sign Up to like & get
recommendations! Published in 2022 at "Journal of Optimization Theory and Applications"

DOI: 10.1007/s10957-021-01968-y

Abstract: This work concerns with semi-Markov decision chains evolving on a finite state space. The controller has a positive and constant risk sensitivity coefficient, and the performance of a control policy is measured by the risk-sensitive… read more here.

Keywords: markov decision; finite state; risk sensitive; semi markov ... See more keywords

Designing Energy Efficient Strategies Using Markov Decision Process for Crowd-Sensing Applications

Sign Up to like & get
recommendations! Published in 2020 at "Mobile Networks and Applications"

DOI: 10.1007/s11036-020-01522-6

Abstract: In mobile crowd-sensing, smartphone users take part in sensing and then share the data to the server (cloud) and get an incentive. These data can be utilized for providing better services to improve quality of… read more here.

Keywords: crowd; energy; markov decision; decision process ... See more keywords

Continuous-Time Zero-Sum Games for Markov Decision Processes with Discounted Risk-Sensitive Cost Criterion

Sign Up to like & get
recommendations! Published in 2021 at "Dynamic Games and Applications"

DOI: 10.1007/s13235-021-00391-2

Abstract: In this paper, we study two-person zero-sum stochastic games for controlled continuous time Markov decision processes with risk-sensitive discounted cost criterion. The transition and cost rates are possibly unbounded. For the zero-sum stochastic game, we… read more here.

Keywords: markov decision; zero sum; continuous time; sum ... See more keywords

Semantic-based topic detection using Markov decision processes

Sign Up to like & get
recommendations! Published in 2017 at "Neurocomputing"

DOI: 10.1016/j.neucom.2017.02.020

Abstract: In the field of text mining, topic modeling and detection are fundamental problems in public opinion monitoring, information retrieval, social media analysis, and other activities. Document clustering has been used for topic detection at the… read more here.

Keywords: detection; using markov; markov decision; decision processes ... See more keywords

Risk-sensitive semi-Markov decision processes with general utilities and multiple criteria

Sign Up to like & get
recommendations! Published in 2018 at "Advances in Applied Probability"

DOI: 10.1017/apr.2018.36

Abstract: Abstract In this paper we investigate risk-sensitive semi-Markov decision processes with a Borel state space, unbounded cost rates, and general utility functions. The performance criteria are several expected utilities of the total cost in a… read more here.

Keywords: sensitive semi; risk sensitive; markov decision; decision processes ... See more keywords

Discounted cost exponential semi-Markov decision processes with unbounded transition rates: a service rate control problem with impatient customers

Sign Up to like & get
recommendations! Published in 2024 at "Probability in the Engineering and Informational Sciences"

DOI: 10.1017/s0269964824000044

Abstract: We focus on exponential semi-Markov decision processes with unbounded transition rates. We first provide several sufficient conditions under which the value iteration procedure converges to the optimal value function and optimal deterministic stationary policies exist.… read more here.

Keywords: markov decision; exponential semi; semi markov;

Asymptotic optimality of a class of controlled non-Markov processes

Sign Up to like & get
recommendations! Published in 2024 at "Applicable Analysis"

DOI: 10.1080/00036811.2024.2368078

Abstract: Motivated by applications in power systems and problems arising in simulation of large scale complex system optimizations, this work is concerned with controlled stochastic switching systems. The system of interest displays a multi-time scale structure.… read more here.

Keywords: non markov; process; controlled non; markov ... See more keywords

Application of Markov decision process in scheduling strategy on cloud storage

Sign Up to like & get
recommendations! Published in 2018 at "Journal of Interdisciplinary Mathematics"

DOI: 10.1080/09720502.2018.1498309

Abstract: Abstract Storage density of the traditional cloud storage system is not big and the comprehensive storage efficiency is low. When the large amount of data increases dramatically, the storage efficiency of the system would be… read more here.

Keywords: decision process; storage; markov decision; cloud storage ... See more keywords

Intelligent decision making for overtaking maneuver using mixed observable Markov decision process

Sign Up to like & get
recommendations! Published in 2018 at "Journal of Intelligent Transportation Systems"

DOI: 10.1080/15472450.2017.1334558

Abstract: ABSTRACT Overtaking maneuver is one of the most dangerous scenarios for road vehicles especially in two-way roads. In this article, we propose a new formulation for the problem of overtaking in two-way roads using the… read more here.

Keywords: decision; markov decision; mixed observable; decision process ... See more keywords

Net benefit of anticoagulation in subclinical device-detected atrial fibrillation: a Markov decision model analysis

Sign Up to like & get
recommendations! Published in 2025 at "Europace"

DOI: 10.1093/europace/euaf085.498

Abstract: Abstract Background The role of anticoagulation for stroke prevention in patients with device-detected atrial high-rate episodes, also known as subclinical atrial fibrillation (AF), is a subject of equipoise. Purpose To assess the net benefit of… read more here.

Keywords: device detected; anticoagulation; analysis; markov decision ... See more keywords