When a belief has been influenced, in part or whole, by factors that, by the believer's own lights, do not bear on the truth of the believed proposition, we can say that the belief has been, in a sense, arbitrarily formed. Can such beliefs ever be rational? It might seem obvious that they can't. After all, belief, supposedly, “aims at the truth.” But many epistemologists have come to think that certain kinds of arbitrary beliefs can, indeed, be rational. In this paper, I want to do two things. First, I want to show that the claim that arbitrary beliefs can be rational is inconsistent with the conjunction of two other attractive claims: one saying that rationality requires a certain kind of epistemic immodesty, and one saying that rationality forbids certain kinds of self-ascriptions of epistemic luck. Second, I want to evaluate different ways one might respond to this inconsistent triad. I won't defend any response in particular, but I'll draw out some notable costs and benefits of each response, which may help shed light on the question of whether arbitrary beliefs can be rational.