In this paper, a phononic crystal (PC) plate with tubular pillars is presented and investigated. The band structures and mode displacement profiles are calculated by using finite element method. The result shows that a complete band gap opens when the ratio of the pillar height to the plate thickness is about 1.6. However, for classic cylinder pillar structures, a band gap opens when the ratio is equal or greater than 3. A tubular pillar design with a void room in it enhances acoustic multiple scattering and gives rise to the opening of the band gap. In order to verify it, a PC structure with double tubular pillars different in size (one within the other) is introduced and a more than 2 times band gap enlargement is observed. Furthermore, the coupling between the resonant mode and the plate mode around the band gap is characterized, as well as the effect of the geometrical parameters on the band gap. The behavior of such structure could be utilized to design a pillar PC with stronger structural stability and to enlarge band gaps.