In this paper, a brand-new adaptive fault-tolerant non-affine integrated guidance and control method based on reinforcement learning is proposed for a class of skid-to-turn (STT) missile. Firstly, considering the non-affine characteristics of the missile, a new non-affine integrated guidance and control (NAIGC) design model is constructed. For the NAIGC system, an adaptive expansion integral system is introduced to address the issue of challenging control brought on by the non-affine form of the control signal. Subsequently, the hyperbolic tangent function and adaptive boundary estimation are utilised to lessen the jitter due to disturbances in the control system and the deviation caused by actuator failures while taking into account the uncertainty in the NAIGC system. Importantly, actor-critic is introduced into the control framework, where the actor network aims to deal with the multiple uncertainties of the subsystem and generate the control input based on the critic results. Eventually, not only is the stability of the NAIGC closed-loop system demonstrated using Lyapunov theory, but also the validity and superiority of the method are verified by numerical simulations.