In this paper, a model-based exponential stabilization of a quadruped robot is studied in bounding motion. The dynamics of the five-link planar underactuated mechanical model of the quadruped robot with four actuated joints system is derived. It is shown that the dynamical equation of the proposed simplified model belongs to a class of second-order nonholonomic mechanical systems which cannot be stabilized by any smooth time-invariant state feedback. Utilizing a coordinate transformation based on the so-called normalized momentum, a robust backstepping control method is presented for the quadruped robot. Both theoretical analysis and numerical simulations show that the robust backstepping controller can stabilize the underactuated quadruped robot so that it could balance on its rear legs and track a desired trajectory. Despite the model parameter uncertainties, the robustness of the controller is maintained. The simulation results show the effectiveness of the proposed method.