High fat diets have detrimental effects on cognitive performance, and can increase oxidative stress and inflammation in the brain. The aging brain provides a vulnerable environment to which a high fat diet could cause more damage. We investigated the effects of a high fat/high cholesterol (HFHC) diet on cognitive performance, neuroinflammation markers, and phosphorylated Tau (p-Tau) pathological markers in the hippocampus of Young (4-month old) versus Aged (14-month old) male rats. Young and Aged male Fisher 344 rats were fed a HFHC diet or a normal control diet for 6 months. All animals underwent cognitive testing for 12 days in a water radial arm maze to assess spatial and working reference memory. Hippocampal tissue was analyzed by immunohistochemistry for structural changes and inflammation, and Western blot analysis. Young and Aged rats fed the HFHC diet exhibited worse performance on a spatial working memory task. They also exhibited significant reduction of NeuN and calbindin-D28k immunoreactivity as well as an increased activation of microglial cells in the hippocampal formation. Western blot analysis of the hippocampus showed higher levels of p-Tau S202/T205 and T231 in Aged HFHC rats, suggesting abnormal phosphorylation of Tau protein following the HFHC diet exposure. This work demonstrates HFHC diet-induced cognitive impairment with aging and a link between high fat diet consumption and pathological markers of Alzheimer’s disease.