Scholarship on the modern state’s symbolic and social infrastructural power typically correlates high state capacity to practices of standardization, homogenization, and integration. Less attention has focused on how this power can be directed towards differentiation and heterogenization, as amply demonstrated in the case of empire. This article develops a framework for analyzing how infrastructural power is employed by modern colonial states and how it impacts society. It argues that formal legitimization structures defined for colonial subunits influence legibility practices enacted within them—what is named and counted and how it is named and counted—and that these legitimization-legibility linkages are significant because they politicize particular boundaries of collective identity in lasting ways within the subjugated society. This model is used to analyze variation within French North Africa between a colony-type linkage in Algeria and a protectorate-type linkage in Morocco, and account for the divergent identity politics and claims-making strategies that emerged within these units. The conclusion considers the broader comparative implications of legitimization-legibility combinations in formerly colonized political units.