In this paper we derive matrix formulae in closed form for higher order moments and give sufficient conditions for higher order stationarity of Markov switching VARMA models. We provide asymptotic theory for sample higher order moments which can be used for testing multivariate normality. As an application, we propose new definitions of multivariate skewness and kurtosis measures for such models, and relate them with the existing concepts in the literature. Our work completes the statistical analysis developed in the fundamental paper of Francq and Zakoïan (2001, Econometric Theory 18, 815–818) and relates with the concepts of multivariate skewness and kurtosis proposed by Mardia (1970, Biometrika 57, 519–530), Móri, Rohatgi, and Székely (1993, Theory of Probability and its Applications 38, 547–551), and Kollo (2008, Journal of Multivariate Analysis 99, 2328–2338). Under suitable assumptions, our results imply that the sample estimators of the skewness and kurtosis measures proposed by these authors are consistent and asymptotically normally distributed. Finally, we check our theory statements numerically via Monte Carlo simulations.