The walls of the cerebral ventricles in the developing embryo harbor the primary neural stem cells from which most neurons and glia derive. In many vertebrates, neurogenesis continues postnatally and into adulthood in this region. Adult neurogenesis at the ventricle has been most extensively studied in organisms with small brains, such as reptiles, birds, and rodents. In reptiles and birds, these progenitor cells give rise to young neurons that migrate into many regions of the forebrain. Neurogenesis in adult rodents is also relatively widespread along the lateral ventricles, but migration is largely restricted to the rostral migratory stream into the olfactory bulb. Recent work indicates that the wall of the lateral ventricle is highly regionalized, with progenitor cells giving rise to different types of neurons depending on their location. In species with larger brains, young neurons born in these spatially specified domains become dramatically separated from potential final destinations. Here we hypothesize that the increase in size and topographical complexity (e.g., intervening white matter tracts) in larger brains may severely limit the long-term contribution of new neurons born close to, or in, the ventricular wall. We compare the process of adult neuronal birth, migration, and integration across species with different brain sizes, and discuss how early regional specification of progenitor cells may interact with brain size and affect where and when new neurons are added. J. Comp. Neurol. 524:646–664, 2016. © 2015 The Authors The Journal of Comparative Neurology Published by Wiley Periodicals, Inc.