Breastfeeding has been an important survival trait during human history, though it has long been recognized that individuals differ in their exact breastfeeding behavior. Here our aims were, first, to explore to what extent genetic and environmental influences contributed to the individual differences in breastfeeding behavior; second, to detect possible genetic variants related to breastfeeding; and lastly, to test if the genetic variants associated with breastfeeding have been previously found to be related with breast size. Data were collected from a large community-based cohort of Australian twins, with 3,364 women participating in the twin modelling analyses and 1,521 of them included in the genome-wide association study (GWAS). Monozygotic (MZ) twin correlations (rMZ = 0.52, 95% CI 0.46–0.57) were larger than dizygotic (DZ) twin correlations (rDZ = 0.35, 95% CI 0.25–0.43) and the best-fitting model was the one composed by additive genetics and unique environmental factors, explaining 53% and 47% of the variance in breastfeeding behavior, respectively. No breastfeeding-related genetic variants reached genome-wide significance. The polygenic risk score analyses showed no significant results, suggesting breast size does not influence breastfeeding. This study confers a replication of a previous one exploring the sources of variance of breastfeeding and, to our knowledge, is the first one to conduct a GWAS on breastfeeding and look at the overlap with variants for breast size.