The philosophical problem of unity and diversity entails a challenge to the rationalist aim to define everything. Definitions of this kind surface in various academic disciplines in formulations like uniqueness, irreducibility, and what has acquired the designation “primitive terms”. Not even the most “exact” disciplines, such as mathematics, can avoid the implications entailed in giving an account of such primitive terms. A mere look at the historical development of mathematics highlights the fact that alternative perspectives prevailed – from the arithmeticism of Pythagoreanism, the eventual geometrisation of mathematics after the discovery of incommensurability up to the revival of arithmeticism in the mathematics of Cauchy, Weierstrass, Dedekind and Cantor (with the later orientation of Frege, who completed the circle by returning to the view that mathematics essentially is geometry). An assessment of logicism and axiomatic formalism is followed by looking at the primitive meaning of wholeness (and the whole-parts relation). With reference to the views of Hilbert, Weyl and Bernays the article concludes by suggesting that in opposition to arithmeticism and geometricism an alternative option ought to be pursued – one in which both the uniqueness and mutual coherence between the aspects of number and space are acknowledged.