Nontuberculous mycobacteria (NTM) are ubiquitous in the environment and can cause nosocomial infections in immunocompromised patients. Recently the presence of NTM in public drinking water and hospital water distribution systems has been reported. Their ability to form biofilms and their resistance to chlorine both contribute to their survival and colonization in water distribution systems. Here we analyzed thirty-two hospital tap water samples that were collected from different locations in three hospitals so as to evaluate the prevalence of NTM species. The water samples were concentrated by membrane filtration and then eluted with sterilized water following sonication. Two-step direct PCR targeting the rpoB gene, restriction fragment length polymorphism (RFLP) using the MspI restriction enzyme, and sequence analysis were performed for identification of NTM to the species level. The sequences of each PCR product were analyzed using BLASTN. Seven samples (7/32, 21.9%) were positive for NTM as determined by nested-PCR. The PCR-RFLP results indicated five different patterns among the seven positive PCR samples. The waterborn NTM were identified, including M. peregrinum, M. chelonae (2 cases), M. abscessus, M. gordonae (2 cases), and Mycobacterium sp. JLS. The direct two-step PCR-RFLP method targeting the rpoB gene was effective for the detection and the differentiation of NTM species from hospital tap water.