In this paper, we are concerned with the nonoverlapping domain decomposition method with Lagrange multiplier for three-dimensional second-order elliptic problems with no zeroth-order term. It is known that the methods result in a singular subproblem on each internal (floating) subdomain. To handle the singularity, we propose a regularization technique which transforms the corresponding singular problems into approximate positive definite problems. For the regularized method, one can build the interface equation of the multiplier directly. We first derive an optimal error estimate of the regularized approximation, and then develop a cheap preconditioned iterative method for solving the interface equation. For the new method, the cost of computation will not be increased comparing the case without any floating subdomain. The effectiveness of the new method will be confirmed by both theoretical analyzes and numerical experiments.