We prove uniform Hölder regularity estimates for a transport-diffusion equation with a fractional diffusion operator and a general advection field in of bounded mean oscillation, as long as the order of the diffusion dominates the transport term at small scales; our only requirement is the smallness of the negative part of the divergence in some critical Lebesgue space. In comparison to a celebrated result by Silvestre, our advection field does not need to be bounded. A similar result can be obtained in the supercritical case if the advection field is Hölder continuous. Our proof is inspired by Kiselev and Nazarov and is based on the dual evolution technique. The idea is to propagate an atom property (i.e., localisation and integrability in Lebesgue spaces) under the dual conservation law, when it is coupled with the fractional diffusion operator.