Mill argues that, apart from the principle of utility, his utilitarianism is incompatible with absolutes. Yet in On Liberty he introduces an exceptionless anti-paternalism principle—his liberty principle. In this paper I address ‘the absolutism problem, ’ that is, whether Mill's utilitarianism can accommodate an exceptionless principle. Mill's absolute claim is not a mere bit of rhetoric. But the four main solutions to the absolutism problem are also not supported by the relevant texts. I defend a fifth solution—the competence view—that turns on his attention to decision-making structures and, in particular, on the role of expertise considerations in his account.