Early in the history of liberalism, its most important proponents were concerned with freedom of religion. As polities and individuals now accept a dizzying array of religions, this has receded to the background for most theorists. It nonetheless remains a concern. Freedom of speech is a similar concern and very much in the foreground for theorists looking at the current state of academia. In this essay, I argue that inappropriate limits to freedom of religion and inappropriate limits to freedom of speech—especially in the form of de-platforming on college campuses—both have, as one of their effects, what I call harms of silence. This means we ought not have those limits, so should seek to change them where they exist.