Scientific societies played a crucial role in the emergence of a professional culture of science in Britain in the mid- to late-19th Century. At first sight, James Croll's membership of a limited number of scientific associations may be assumed to be the result of his lack of social credit and scientific connections. In this article, by examining Croll's correspondence, I demonstrate that Croll's select participation in scientific clubs and associations reflected his strategic pursuit of a vision of science set apart from party or societal affiliation. I focus on the contrasting histories of the Royal Society of Edinburgh and the Geological Survey, as well as the institutional history of the Philosophical Magazine. Situating the institutions in their respective social and cultural contexts, I argue that the more meritocratic, inclusive social structure of the Survey and Magazine helps explain Croll's choice to avoid affiliation with the Royal Society of Edinburgh.