Given recent adaptations of the World Health Organization's World Mental Health Composite International Diagnostic Interview (WMH-CIDI), new methodological studies are needed to evaluate the concordance of CIDI diagnoses with clinical diagnostic interviews. This paper summarizes lessons learned from a clinical reappraisal study done with US Latinos. We compare CIDI diagnoses with independent clinical diagnosis using the World Mental Health Structured Clinical Interview for DSM-IV (WMH-SCID 2000). Three sub-samples stratified by diagnostic status (CIDI positive, CIDI negative, or CIDI sub-threshold for a disorder) based on nine disorders were randomly selected for a telephone re-interview using the SCID. We calculated sensitivity, specificity, and weight-adjusted Cohen's kappa. Weighted 12 month prevalence estimates of the SCID are slightly higher than those of the CIDI for generalized anxiety disorder, alcohol abuse/dependence, and drug abuse/dependence. For Latinos, CIDI-SCID concordance at the aggregate disorder level is comparable, albeit lower, to other published reports. The CIDI does very well identifying negative cases and classifying disorders at the aggregate level. Good concordance was also found for major depressive episode and panic disorder. Yet, our data suggests that the CIDI presents problems for assessing post-traumatic stress disorder (PTSD) and generalized anxiety disorder (GAD). Recommendations on how to improve future versions of the CIDI for Latinos are offered. Copyright © 2009 John Wiley & Sons, Ltd.