Throughout cosmic time, the feedback of massive star winds and supernova explosions has been instrumental in determining the phase structure of the interstellar medium, controlling important aspects of both the formation and evolution of galaxies, producing galactic winds and enriching the intergalactic medium with heavy elements. In this paper, I review progress made in our theoretical understanding of how these feedback processes have operated throughout cosmic time from the epoch of the first stars through to the present day.