The concept of “pH memory” has been established in the literature for the correlation between the pH of a pre-lyophilization solution and the ionization state of freeze-dried powder (lyophile). In this paper, the concept of “pH memory” is explored for the system of an aqueous solution, a frozen solution, and a lyophile. Sodium and potassium phosphate buffers in the pH range of 5–9 were frozen and lyophilized with sulfonephthalein indicators as acidity probes, and their Hammett acidity functions were compared to the initial pH of the aqueous solution. The results show that the acidities of the lyophiles are somewhat changed compared to the initial pHs, but the acidities in the frozen state differ more substantially. The Hammett acidity functions of the frozen buffers were found to be markedly dissimilar from the initial pH, especially in the sodium phosphate frozen at 233 K, where an increase in the initial pH led to a decrease in the Hammett acidity function of the frozen state at a certain pH range. The large acidification observed after freezing the sodium phosphate buffer was not detected in the lyophiles after the sample had been dried; the phenomenon is explained considering the formed crystals analyzed by X-ray powder diffraction. The results suggest that monitoring the final acidity of a lyophile is not sufficient to predict all the acidity changes throughout the whole lyophilization process. The importance of well-controlled freezing and lyophilization conditions follows from the results of the research.