This paper develops a moderate pessimist account of moral deference. I argue that while some pessimist explanations of the puzzle of moral deference have been misguided in matters of detail, they nevertheless share an important insight, namely that there is a justified moral agency ideal grounded in pro tanto reasons against moral deference. This thought is unpacked in terms of a set of values associated with the practice of morality. I conclude by suggesting that the solution to the puzzle of moral deference developed here gives us a plausible recipe for generalizing to certain cases of nonmoral deference as well.