The evolution of a star cluster is strongly influenced by the presence of primordial binaries and of a central black hole, as dynamical interactions within the core prevents a deep core collapse under these conditions. We present the results from a large set of direct N-body simulations of star clusters that include an intermediate mass black hole, single and binary stars. We highlight the structural and dynamical differences for the various cases showing in particular that on a timescale of a few relaxation times the density profile of the star cluster does no longer depend on the details of the initial conditions but only on the efficiency of the energy generation due to gravitational encounters at the center of the system.