Knowledge of physiological aging in healthy human brain is increasingly important for neuroscientific research and clinical diagnosis. To investigate neuronal decline in normal aging brain eighty-one healthy subjects aged between 20 and 70 years were studied with MRI and whole-brain 1H MR spectroscopic imaging. Concentrations of brain metabolites N-acetyl-aspartate (NAA), choline (Cho), total creatine (tCr), myo-inositol (mI), and glutamine + glutamate (Glx) in ratios to internal water, and the fractional volumes of brain tissue were estimated simultaneously in eight cerebral lobes and in cerebellum. Results demonstrated that an age-related decrease in gray matter volume was the largest contribution to changes in brain volume. Both lobar NAA and the fractional volume of gray matter (FVGM) decreased with age in all cerebral lobes, indicating that the decreased NAA was predominantly associated with decreased gray matter volume and neuronal density or metabolic activity. In cerebral white matter Cho, tCr, and mI increased with age in association with increased fractional volume, showing altered cellular membrane turn-over, energy metabolism, and glial activity in human aging white matter. In cerebellum tCr increased while brain tissue volume decreased with age, showing difference to cerebral aging. The observed age-related metabolic and microstructural variations suggest that physiological neuronal decline in aging human brain is associated with a reduction of gray matter volume and neuronal density, in combination with cellular aging in white matter indicated by microstructural alterations and altered energy metabolism in the cerebellum.