The present paper contains a lemma which implies that varimax rotation can be interpreted as a special case of diagonalizing symmetric matrices as discussed in multidimensional scaling. It is shown that the solution by De Leeuw and Pruzansky is essentially equivalent to the solution by Kaiser. Necessary and sufficient conditions for maxima and minima are derived from first and second order partial derivatives. A counter-example by Gebhardt is reformulated and examined in terms of these conditions. It is concluded that Kaiser's method or, equivalently, the method by De Leeuw and Pruzansky is the most attractive method currently available for the problem at hand.