Referring to Tits′ alternative, we develop a necessary and sufficient condition to decide whether the normalizer of a finite group of integral matrices is polycyclic-by-finite or is containing a non-Abelian free group. This result is of fundamental importance to conclude whether the (outer) automorphism group of a Bieberbach group is polycyclic-by-finite or has a non-cyclic free subgroup.