In this work we reconsider the one loop calculation for the vacuum polarisation tensor in the Lorentz violating quantum electrodynamics. The electron propagator is “dressed” by a Lorentz breaking extra term in the fermion Lagrangian density. We check gauge invariance and use the Schwinger–Dyson equation to discuss the full photon propagator. After a discussion on a possible photon mass shift, we show how a finite quantum correction can be chosen in a unique way in order to ensure—in the spirit of spontaneously broken theories—the standard normalisation conditions for the vacuum polarisation tensor. Then we comment on possible observable physical consequences on the Lamb-shift.