Lolium perenne L. (perennial ryegrass) shows variable levels of seed physiological dormancy (PD), which depends on the genotype and environmental condition during seed development. To analyse the effect of field temperature and precipitation during seed filling on the PD, two cultivars were sown on five dates in 2014 and 2015. After harvest, the level of seed PD was 4–28%. High-temperature stress (>29°C) in the field during seed development, measured as heat stress units (HSUs), reduced seed PD (increased germination) at harvest. After 9 months of dry afterripening under laboratory conditions, mean dormant seed values were reduced from 15 ± 8 to 8 ± 7%. An increment in the seed PD level reduced seedling emergence in the field. Seed with 20% PD produced only 50% of field emergence, under optimal environmental conditions. Different vigour tests were conducted and each was compared with field emergence. The speed of germination, through the first count at 5 d of the standard germination test, and the shoot length at 10 d were better associated with the seedling establishment in the field. The HSU could be useful to establish a possible PD range in the seed of perennial ryegrass after the growing season. The development of models considering the HSU and other climatic parameters could motivate future studies.