We study a stochastic differential equation driven by a Poisson point process, which models the continuous change in a population's environment, as well as the stochastic fixation of beneficial mutations that might compensate for this change. The fixation probability of a given mutation increases as the phenotypic lag Xt between the population and the optimum grows larger, and successful mutations are assumed to fix instantaneously (leading to an adaptive jump). Our main result is that the process is transient (i.e. converges to -∞, so that continued adaptation is impossible) if the rate of environmental change v exceeds a parameter m, which can be interpreted as the rate of adaptation in case every beneficial mutation becomes fixed with probability 1. If v < m, the process is Harris recurrent and possesses a unique invariant probability measure, while in the limiting case m = v, Harris recurrence with an infinite invariant measure or transience depends upon additional technical conditions. We show how our results can be extended to a class of time varying rates of environmental change.