We describe the structure of the Ricci tensor on a locally homogeneous Lorentzian gradient Ricci soliton. In the non-steady case, we show that the soliton is rigid in dimensions 3 and 4. In the steady case we give a complete classification in dimension 3.