At the societal and policy level, delaying retirement is generally agreed upon to solve the problem of the increasing proportion of older workers in Sweden, as in many other countries. At the same time, two co-existing narratives that create legitimacy for early versus delayed retirement were found in our study, among both societal- and organisational-level actors. Older workers are viewed as either representatives of productive ageing and a solution to labour shortage problems, or as a barrier to recruiting younger, more promising employees with new skills. Through inductive qualitative analysis, this study shows in what way human resources departments are taking part in the institutional work of maintaining retirement-timing narratives in Swedish workplaces. The existing general organisational narrative of ‘the business case’ is used to mute discussion about delaying the retirement age, except for a select few. Their maintenance of this narrative is supported by the way in which the societal-level narratives target the individual, often backgrounding the role of employers.