The current article reports on the experimental study of the influence of surface roughness on the measurement of the acoustic nonlinearity parameter. The nonlinearity parameter was measured using contact piezoelectric transducers, which were calibrated using the reciprocity based technique. Aluminum and steel samples were chosen to study the influence of hardness of the sample on the measurement of the nonlinearity parameter. While, lower Ra value (average asperity height) aluminum samples were more susceptible to surface deformation and scratches from coupling the transducer to the sample, the same could not be observed for steel samples. Results demonstrate a large variation in nonlinearity parameter for aluminum (˜35%) compared to steel (˜2%) between two consecutive experiments, suggesting flattening of asperities after the first experiment. Experiments were also performed with 3 different setup configurations; (1) receiver and transmitter on rough sides, (2) receiver on smooth and transmitter on rough side and (3) receiver on rough and transmitter on smooth side. Results show that least variation in the measured nonlinearity parameter was observed when the receiver was placed on the smooth side, and a 10% variation was observed between the three setup configurations. Finally, a comparison of relative nonlinearity parameter calculated using current or voltage ratio and absolute nonlinearity parameter showed large discrepancies. Conclusions were drawn from the experimental observations.