Breast size is primarily determined by a combination of genetics, hormonal influences, and body weight. The amount of fatty tissue and the density of glandular tissue in the breasts play crucial roles in determining their size and shape. Additionally, factors such as puberty, pregnancy, and menopause can cause significant changes in breast size.