Abstract
In this article, we consider a linear-quadratic optimal control problem (LQ problem) for a controlled linear stochastic differential equation driven by a multidimensional Browinan motion and a Poisson random martingale measure in the general case, where the coefficients are allowed to be predictable processes or random matrices. By the duality technique, the dual characterization of the optimal control is derived by the optimality system (so-called stochastic Hamilton system), which turns out to be a linear fully coupled forward-backward stochastic differential equation with jumps. Using a decoupling technique, the connection between the stochastic Hamilton system and the associated Riccati equation is established. As a result, the state feedback representation is obtained for the optimal control. As the coefficients for the LQ problem are random, here, the associated Riccati equation is a highly nonlinear backward stochastic differential equation (BSDE) with jumps, where the generator depends on the unknown variables K, L, and H in a quadratic way (see (5.9) herein). For the case where the generator is bounded and is linearly dependent on the unknown martingale terms L and H, the existence and uniqueness of the solution for the associated Riccati equation are established by Bellman's principle of quasi-linearization.
Original language | English |
---|---|
Pages (from-to) | 88-109 |
Number of pages | 22 |
Journal | Stochastic Analysis and Applications |
Volume | 32 |
Issue number | 1 |
DOIs | |
Publication status | Published - 2014 |
Externally published | Yes |
Keywords
- Backward stochastic Riccati equation
- Dynamic programming
- Itô-Ventzell formula
- Linear quadratic optimal stochastic control
- Poisson random martingale measure
- Stochastic Hamilton system