A numerical method is proposed for a class of one-dimensional stochastic control problems with unbounded state space. This method solves an infinite-dimensional linear program, equivalent to the original formulation based on a stochastic differential equation, using a finite element approximation. The discretization scheme itself and the necessary assumptions are discussed, and a convergence argument for the method is presented. Its performance is illustrated by examples featuring long-term average and infinite horizon discounted costs, and additional optimization constraints.

We consider De Finetti’s control problem for absolutely continuous strategies with control rates bounded by a concave function and prove that a generalized mean-reverting strategy is optimal in a Brownian model. In order to solve this problem, we need to deal with a nonlinear Ornstein–Uhlenbeck process. Despite the level of generality of the bound imposed on the rate, an explicit expression for the value function is obtained up to the evaluation of two functions. This optimal control problem has, as special cases, those solved in Jeanblanc-Picqué and Shiryaev (1995) and Renaud and Simard (2021) when the control rate is bounded by a constant and a linear function, respectively.

Consider a Brownian motion on the circumference of the unit circle, which jumps to the opposite point of the circumference at incident times of an independent Poisson process of rate $\lambda$. We examine the problem of coupling two copies of this ‘jumpy Brownian motion’ started from different locations, so as to optimise certain functions of the coupling time. We describe two intuitive co-adapted couplings (‘Mirror’ and ‘Synchronous’) which differ only when the two processes are directly opposite one another, and show that the question of which strategy is best depends upon the jump rate $\lambda$ in a non-trivial way. We also provide an explicit description of a (non-co-adapted) maximal coupling for any jump rate in the case that the two jumpy Brownian motions begin at antipodal points of the circle.

We study the optimal investment strategy to minimize the probability of lifetime ruin under a general mortality hazard rate. We explore the error between the minimum probability of lifetime ruin and the achieved probability of lifetime ruin if one follows a simple investment strategy inspired by earlier work in this area. We also include numerical examples to illustrate the estimation. We show that the nearly optimal probability of lifetime ruin under the simplified investment strategy is quite close to the original minimum probability of lifetime ruin under reasonable parameter values.

We determine the optimal robust strategy of an individual who seeks to maximize the (penalized) probability of reaching a bequest goal when she is uncertain about the drift of the risky asset and her hazard rate of mortality. We assume the individual can invest in a Black–Scholes market. We solve two optimization problems with ambiguity. The first is to maximize the penalized probability of reaching a bequest goal without life insurance in the market. In the second problem, in addition to investing in the financial market, the individual is allowed to purchase term life insurance to help her reach her bequest goal. As the individual becomes more ambiguity averse concerning the drift of the risky asset, she becomes more conservative with her investment strategy. Also, as she becomes more ambiguity averse about her hazard rate of mortality, numerical work indicates she is more likely to buy life insurance when the ambiguity towards the return of the risky asset is not too large.

This paper deals with the optimal management of the public debt-to-GDP ratio. We specifically focus on a contrasting tax evasion-based strategy for controlling the debt-to-GDP ratio. Two devices can be employed by the policymaker: by the one side, the tax rate is to be applied to the tax payers; by the other side, the monitoring activity is to be performed in order to detect the evaded taxes. To pursue our scopes, a stochastic control problem is developed and solved. Some numerical experiments validate the theoretical proposal and lead to an intuitive discussion of the obtained findings.

For spectrally negative Lévy risk processes we consider a general version of de Finetti's optimal dividend problem in which the ruin time is replaced with a general drawdown time from the running maximum in its value function. We identify a condition under which a barrier dividend strategy is optimal among all admissible strategies if the underlying process does not belong to a small class of compound Poisson processes with drift, for which the take-the-money-and-run dividend strategy is optimal. It generalizes the previous results on dividend optimization from ruin time based to drawdown time based. The associated drawdown functions are discussed in detail for examples of spectrally negative Lévy processes.

In his well-known textbook Probability with Martingales, David Williams (1991) introduces the Mabinogion sheep problem in which there is a magical flock of sheep, some black, some white. At each stage n=1,2,..., a sheep (chosen randomly from the entire flock, independently of previous events) bleats; if this bleating sheep is white, one black sheep (if any remain) instantly becomes white; if the bleating sheep is black, one white sheep (if any remain) instantly becomes black. No births or deaths occur. Suppose that one may remove any number of white sheep from the flock at (the end of) each stage n=0,1,.... The object is to maximize the expected final number of black sheep. By applying the martingale optimality principle, Williams showed that the problem is solvable and admits a simple nice solution. In this paper we consider a generalization of the Mabinogion sheep problem with two parameters 0≤p, q≤1, denoted M(p,q), in which at each stage, when the bleating sheep is white (black, respectively), a black (white, respectively) sheep (if any remain) instantly becomes white (black, respectively), with probability p (q, respectively) and nothing changes with probability 1-p (1-q, respectively). Note that the original problem corresponds to (p,q)=(1,1). Following Williams' approach, we solve the two cases (p,q)=(1,1/2) and (1/2,1) which admit simple solutions.

In the classical optimal dividends problem, dividend decisions are allowed to be made at any point in time — according to a continuous strategy. Depending on the surplus process that is considered and whether dividend payouts are bounded or not, optimal strategies are generally of a band, barrier or threshold type. In reality, while surpluses change continuously, dividends are generally paid on a periodic basis. Because of this, the actuarial literature has recently considered strategies where dividends are only allowed to be distributed at (random) discrete times — according to a periodic strategy.

In this paper, we focus on the Brownian risk model. In this context, the optimal continuous and periodic strategies have previously been shown (independently of one another) to be of barrier type. For the first time, we consider a model where both strategies are used. In such a hybrid strategy, decisions are allowed to be made either at any time (continuously), or periodically at a lower cost. This proves optimal in some cases. We also determine under which combination of parameters a pure continuous, pure periodic or hybrid (including both continuous and periodic dividend payments) barrier strategy is optimal. Interestingly, the hybrid strategy lies in-between periodic and continuous strategies, which provides some interesting insights. Results are illustrated.

We consider a game with K ≥ 2 players, each having an integer-valued fortune. On each round, a pair (i,j) among the players with nonzero fortunes is chosen to play and the winner is decided by flipping a fair coin (independently of the process up to that time). The winner then receives a unit from the loser. All other players' fortunes remain the same. (Once a player's fortune reaches 0, this player is out of the game.) The game continues until only one player wins all. The choices of pairs represent the control present in the problem. While it is known that the expected time to ruin (i.e. expected duration of the game) is independent of the choices of pairs (i,j) (the strategies), our objective is to find a strategy which maximizes the variance of the time to ruin. We show that the maximum variance is uniquely attained by the (optimal) strategy, which always selects a pair of players who have currently the largest fortunes. An explicit formula for the maximum value function is derived. By constructing a simple martingale, we also provide a short proof of a result of Ross (2009) that the expected time to ruin is independent of the strategies. A brief discussion of the (open) problem of minimizing the variance of the time to ruin is given.

Optimal control problems of stochastic switching type appear frequently when making decisions under uncertainty and are notoriously challenging from a computational viewpoint. Although numerous approaches have been suggested in the literature to tackle them, typical real-world applications are inherently high dimensional and usually drive common algorithms to their computational limits. Furthermore, even when numerical approximations of the optimal strategy are obtained, practitioners must apply time-consuming and unreliable Monte Carlo simulations to assess their quality. In this paper, we show how one can overcome both difficulties for a specific class of discrete-time stochastic control problems. A simple and efficient algorithm which yields approximate numerical solutions is presented and methods to perform diagnostics are provided.

In this paper we study the optimal dividend payments for a company of limited liability whose cash reserves in the absence of dividends follow a Markov-modulated jump-diffusion process with positive drifts and negative exponential jumps, where parameters and discount rates are modulated by a finite-state irreducible Markov chain. The main aim is to maximize the expected cumulative discounted dividend payments until bankruptcy time when cash reserves are nonpositive for the first time. We extend the results of Jiang and Pistorius [15] to our setup by proving that it is optimal to adopt a modulated barrier strategy at certain positive regime-dependent levels and that the value function can be explicitly characterized as the fixed point of a contraction.

In this paper, we establish the existence and uniqueness of a classical solution of a degenerate parabolic variational inequality of which a strong solution was shown to exist by Song and Yu [21]. The problem arises from optimal stochastic control of exercising continuously perpetual executive stock options (ESOs). We also characterize the basic graph, continuity, and monotonicity properties of the free boundary from which the optimal control strategy can be described precisely.

In this paper we study the optimal dividend problem for a company whose surplus process evolves as a spectrally positive Lévy process before dividends are deducted. This model includes the dual model of the classical risk model and the dual model with diffusion as special cases. We assume that dividends are paid to the shareholders according to an admissible strategy whose dividend rate is bounded by a constant. The objective is to find a dividend policy so as to maximize the expected discounted value of dividends which are paid to the shareholders until the company is ruined. We show that the optimal dividend strategy is formed by a threshold strategy.

This paper is dedicated to the analysis of backward stochastic differential equations(BSDEs) with jumps, subject to an additional global constraint involving all thecomponents of the solution. We study the existence and uniqueness of a minimal solutionfor these so-called constrained BSDEs with jumps via a penalizationprocedure. This new type of BSDE offers a nice and practical unifying framework to thenotions of constrained BSDEs presented in [S. Peng and M. Xu, Preprint.(2007)] and BSDEs with constrained jumps introduced in [I. Kharroubi, J. Ma, H.Pham and J. Zhang, Ann. Probab. 38 (2008) 794–840]. Moreremarkably, the solution of a multidimensional Brownian reflected BSDE studied in [Y. Huand S. Tang, Probab. Theory Relat. Fields 147 (2010) 89–121]and [S. Hamadène and J. Zhang, Stoch. Proc. Appl. 120 (2010)403–426] can also be represented via a well chosen one-dimensionalconstrained BSDE with jumps. This last result is very promising from a numerical point ofview for the resolution of high dimensional optimal switching problems and more generallyfor systems of coupled variational inequalities.

We consider a multi asset financial market with stochastic volatility modeled by a Wishart process. This is an extension of the one-dimensional Heston model. Within this framework we study the problem of maximizing the expected utility of terminal wealth for power and logarithmic utility. We apply the usual stochastic control approach and obtain, explicitly, the optimal portfolio strategy and the value function in some parameter settings. In particular, we do this when the drift of the assets is a linear function of the volatility matrix. In this case the affine structure of the model can be exploited. In some cases we obtain a Feynman-Kac representation of the candidate value function. Though the approach we use is quite standard, the hard part is to identify when the solution of the Hamilton-Jacobi-Bellman equation is finite. This involves a couple of matrix analytic arguments. In a numerical study we discuss the influence of the investors' risk aversion on the hedging demand.

The problem of constructing an optimal coadapted coupling for a pair of symmetric random walks on Z2d was considered by Connor and Jacka (2008), and the existence of a coupling which is stochastically fastest in the class of all such coadapted couplings was demonstrated. In this paper we show how to generalise this construction to an optimal coadapted coupling for the continuous-time symmetric random walk on Knd, where Kn is the complete graph with n vertices. Moreover, we show that although this coupling is not maximal for any n (i.e. it does not achieve equality in the coupling inequality), it does tend to a maximal coupling as n → ∞.

We study the effects of introducing taxation in classical continuous-time optimization problems with utility from consumption, bequest and retirement savings. Inspired by actual tax favoured retirement savings programs, we formulate and solve the optimization problem for various tax regimes, and compare tax effects on consumption/savings contributions, investment and purchase of life insurance under the regimes. The optimization problems have analytical solutions, which allow for easy comparison of tax effects under the different regimes. To substantiate the results we also present a numerical analysis of the results based on realistic parameter values and regimes. Based on American and Danish tax regimes we estimate the values of existing retirement saving favouring to be 1 – 2 percent of lifetime income.