Sensitive Discount Optimality in Controlled One-Dimensional Diffusions

Type: Article

Publication Date: 1974-06-01

Citations: 26

DOI: https://doi.org/10.1214/aop/1176996656

Abstract

In this paper we consider the problem of optimally controlling a diffusion process on a compact interval in one-dimensional Euclidean Space. Under the assumptions that the action space is finite and the cost rate, drift and diffusion coefficients are piecewise analytic, we present a constructive proof that there exist piecewise constant $n$-discount optimal controls for all finite $n \geqq 1$ and measurable $\infty$-discount optimal controls. In addition we present a sequence of second order differential equations that characterize the coefficients of the Laurent series of the expected discounted cost of an $n$-discount optimal control.

Locations

  • The Annals of Probability - View - PDF

Similar Works

Action Title Year Authors
+ PDF Chat Blackwell Optimality for Controlled Diffusion Processes 2009 Héctor Jasso-Fuentes
Onésimo Hernández-Lerma
+ PDF Chat Blackwell Optimality for Controlled Diffusion Processes 2009 Héctor Jasso-Fuentes
Onésimo Hernández-Lerma
+ PDF Chat Discount optimality throughout a set of parameters for one-dimensional transport processes 1981 Martin V. Day
+ The Laurent series, sensitive discount and Blackwell optimality for continuous-time controlled Markov chains 2005 Tomás Prieto-Rumeau
Onésimo Hernández-Lerma
+ Infinite Horizon Controlled Diffusions with Randomly Varying and State-Dependent Discount Cost Rates 2016 Xianggang Lu
George Yin
Xianping Guo
+ PDF Chat Discounted Risk-Sensitive Optimal Control of Switching Diffusions: Viscosity Solution and Numerical Approximation 2023 Xianggang Lu
Lin Sun
+ Stochastic control with rough paths 2013 Joscha Diehl
Peter K. Friz
Paul Gassiat
+ Stochastic control with rough paths 2013 Joscha Diehl
Peter K. Friz
Paul Gassiat
+ PDF Chat Discrete-Time Approximations of Controlled Diffusions with Infinite Horizon Discounted and Average Cost 2025 Somnath Pradhan
Serdar Yüksel
+ Infinite horizon risk-sensitive control of diffusions without any blanket stability assumptions 2017 Ari Arapostathis
Anup Biswas
+ PDF Chat On the optimal control of one-dimensional diffusion processes 1964 Petr Mandl
+ Optimal control of one dimensional non-conservative quasi-diffusion processes 1980 Jürgen Groh
+ Optimal Control of One Dimensional Non-Conservative Quasi-Diffusion Processes 1978 Jürgen Groh
+ Optimal Discounted Stochastic Control for Diffusion Processes 1967 Harold J. Kushner
+ Risk-sensitive control of reflected diffusion processes on orthrant 2017 Sunil Kumar Gauttam
Kuldeep Kumar
Chandan Pal
+ Near optimality of Lipschitz and smooth policies in controlled diffusions 2024 Somnath Pradhan
Serdar Yüksel
+ Optimal Control of Diffusions 2002 H. O. Fattorini
+ Average Continuous Control of Piecewise Deterministic Markov Processes 2008 O.L.V. Costa
François Dufour
+ PDF Chat Optimizing a variable-rate diffusion to hit an infinitesimal target at a set time 2014 Jeremy Clark
+ A note on controlled diffusions with long finite horizon 1991 Mrinal K. Ghosh
Steven I. Marcus