In the existing acoustic micro-particle delivery methods, the micro-particles always lie and slide on the surface of platform in the whole delivery process. To avoid the damage and contamination of micro-particles caused by the sliding motion, this paper deals with a novel approach to trap micro-particles from non-customized rigid surfaces and freely manipulate them. The delivery process contains three procedures: detaching, transporting, and landing. Hence, the micro-particles no longer lie on the surface, but are levitated in the fluid, during the long range transporting procedure. It is very meaningful especially for the fragile and easily contaminated targets. To quantitatively analyze the delivery process, a theoretical model to calculate the acoustic radiation force exerting upon a micro-particle near the boundary in half space is built. An experimental device is also developed to validate the delivery method. A 100 μm diameter micro-silica bead adopted as the delivery target is detached from the upper surface of an aluminum platform and levitated in the fluid. Then, it is transported along the designated path with high precision in horizontal plane. The maximum deviation is only about 3.3 μm. During the horizontal transportation, the levitation of the micro-silica bead is stable, the maximum fluctuation is less than 1 μm. The proposed method may extend the application of acoustic radiation force and provide a promising tool for microstructure or cell manipulation.