We consider the convex ordering for random vectors and some weaker versions of it, like the convex ordering for linear combinations of random variables. First we establish conditions of stochastic equality for random vectors that are ordered by one of the convex orderings. Then we establish necessary and sufficient conditions for the convex ordering to hold in the case of multivariate normal distributions and sufficient conditions for the positive linear convex ordering (without the restriction to multi-normality).