One facet of group identity is the construction and description of ‘the outsider’. A key dimension of this is the way outsiders are labelled. οἱ ἄπιστοι and τὰ ἔθνη, two outsider-designations used in Pauline texts, are examined here to determine what their use and function indicate about group identity. In these cases, we see the creation of a new designation and linguistic innovation in the way a designation is used, which includes the alteration of the referent of an established term. Defining and understanding ‘the outsider’, grappling with how to represent outsiders to ‘ourselves’ and negotiating across group boundaries were key undertakings that led to linguistic creativity, change and transformation. That such linguistic creativity can be seen as going on ‘at the boundary’, to create and define the boundaries of the movement, shows how important such boundaries were.