This chapter investigates Carnap’s structuralism in his philosophy of mathematics of the 1920s and early 1930s. His approach to mathematics is based on a genuinely structuralist thesis, namely that axiomatic theories describe abstract structures or the structural properties of their objects. The aim in the present article is twofold: first, to show that Carnap, in his contributions to mathematics from the time, proposed three different (but interrelated) ways to characterize the notion of mathematical structure, namely in terms of (i) implicit definitions, (ii) logical constructions, and (iii) definitions by abstraction. The second aim is to re-evaluate Carnap’s early contributions to the philosophy of mathematics in light of contemporary mathematical structuralism. Specifically, the chapter discusses two connections between his structuralist thesis and current philosophical debates on structural abstraction and the on the definition of structural properties.