Glassy carbon nanolattices can exhibit very high strength-to-weight ratios as a consequence of their small size and the material properties of the constituent material. Such nanolattices can be fabricated by pyrolysis of polymeric microlattices. To further elucidate the influence of the mechanical size effect of the constituent material, compression tests of glassy carbon nanopillars with varying sizes were performed. Depending on the specific initial polymer material and the nanopillar size, varying mechanical properties were observed. Small nanopillars exhibited elastic-plastic deformation before failure initiation. Moreover, for smaller nanopillars higher strength values were observed than for larger ones, which might be related to smaller defects and a lower defect concentration in the material.