We consider a fluid queue with downward jumps, where the fluid flow rate and the downward jumps are controlled by a background Markov chain with a finite state space. We show that the stationary distribution of a buffer content has a matrix exponential form, and identify the exponent matrix. We derive these results using time-reversed arguments and the background state distribution at the hitting time concerning the corresponding fluid flow with upward jumps. This distribution was recently studied for a fluid queue with upward jumps under a stability condition. We give an alternative proof for this result using the rate conservation law. This proof not only simplifies the proof, but also explains an underlying Markov structure and enables us to study more complex cases such that the fluid flow has jumps subject to a nondecreasing Lévy process, a Brownian component, and countably many background states.