Assessing the effectiveness of academic programs is a critical element of institutional research. Changing demographics in the United States compel us to measure the effectiveness of academic programs to address issues of diversity. At a large public university in the Southwestern U.S., a team of researchers constructed a diversity awareness survey as part of its institutional research. This survey was created in response to several factors: (1) results from a university-wide survey of graduating seniors regarding attitudes toward diversity were alarming; (2) the College of Education was undergoing NCATE accreditation review, and assessment had become part of institutionalized procedures in the college; (3) the Curriculum and Instruction department chair requested it; (4) the teacher certification program was guided by a mission to prepare teachers to be effective in diverse classrooms. This process appeared simple at first, but proved to be a lengthy, complex series of steps on a not-so-linear path. After three years, we are just now reaching a point where we believe the survey validity is strong and the questions need no further revision.