We analyse the vertical distribution of High Mass X-ray Binaries (HMXBs) in NGC 55, the nearest edge-on galaxy to the Milky Way. Our analysis reveals significant spatial offsets of HMXBs from the star forming regions, greater than those observed in the SMC and the LMC but similar with the Milky Way. The spatial offsets can be explained by a momentum kick the X-ray binaries receive during the formation of the compact object. The difference between the scale height of the vertical distribution of HMXBs and the vertical distribution of star-forming activity is 0.48±0.04 kpc. The centre-of-mass velocity of the distribution of HMXBs in NGC 55 is moving at a velocity of 52.4±11.4 km s−1, greater than the corresponding velocity of HMXBs in the SMC and LMC, but consistent with velocities of Milky Way HMXBs.