The star sensor field of view varies from several arc-minutes to 20 degrees, which directly determines the star vector orientation in the field of view (FOV). Although the relationship between star vector orientation in the FOV and attitude accuracy has been revealed, the influence mechanism of star vector orientation on the integrated navigation performance of a stellar inertial navigation system has not been analysed. In order to improve the integrated accuracy, the main errors such as star sensor installation error, gyro error and initial platform angle error should be estimated online. It is significant to study the influence mechanism of star vector orientation on estimation of the above errors. In this paper, the star sensor sensitivity and the geometry factor are defined to feature the difference between the optical axis direction and the non-optical axis direction. The formulised mechanism and quantification results between star vector orientation and integration attitude and error estimation accuracy are clearly given. Simulation and ground testing were conducted and it was found that the larger the star vector orientation along the optical axis, the better the error estimation accuracy. In contrast, the attitude accuracy is weakly sensitive to the orientation of the star vector in conditions of appropriate posture adjustment and star observation scheme. This conclusion can offer universal guidance for the design and evaluation of stellar inertial navigation systems with narrow field of view or large field of view star sensors.