We demonstrate the simultaneous temporal contrast improvement and pulse compression of a Yb-doped femtosecond laser via nonlinear elliptical polarization rotation in a solid state multi-pass cell. The temporal contrast is improved to 109, while the pulse is shortened from 181 to 36 fs, corresponding to a compression factor of 5. The output beam features excellent beam quality with M
2 values of 1.18 × 1.16. The total efficiency of the contrast enhancement system exceeds 50%. This technique will have wide applications in high temporal contrast ultra-intense femtosecond lasers.