Let X be a smooth complex Fano variety. We study ‘quasi-elementary’ contractions of fiber type of X, which are a natural generalization of elementary contractions of fiber type. If f:X→Y is such a contraction, then the Picard numbers satisfy ρX≤ρY+ρF, where F is a general fiber of f. We show that, if dim Y ≤3 and ρY≥4, then Y is smooth and Fano; if moreover ρY≥6, then X is a product. This yields sharp bounds on ρX when dim X=4 and X has a quasi-elementary contraction of fiber type, and other applications in higher dimensions.