Although Einstein's general relativity has passed all the tests so far, alternative theories are still required for deeper understanding of the nature of gravity. Double pulsars provide us a significant opportunity to test them. In order to probe some modified gravities which try to explain some astrophysical phenomena without dark matter, we use periastron advance $\dot{\omega}$ of four binary pulsars (PSR B1913+16, PSR B1534+12, PSR J0737-3039 and PSR B2127+11C) to constrain their Yukawa parameters: λ = (3.97 ± 0.01) × 108m and α = (2.40 ± 0.02) × 10−8. It might help us to distinguish different gravity theories and get closer to the new physics.