Consider a three-dimensional partially hyperbolic diffeomorphism. It is proved that under some rigid hypothesis on the tangent bundle dynamics, the map is (modulo finite covers and iterates) an Anosov diffeomorphism, a (generalized) skew-product or the time-one map of an Anosov flow, thus recovering a well-known classification conjecture of the second author to this restricted setting.