Social identity theory maintains that one’s self-concept is partially determined by the social groups to which the individual belongs. Using this as a theoretical framework, this study examined the relationship between multiple dimensions of institutional identity and self-esteem in 411 Black male college freshmen. It was hypothesized that self-esteem would be related to institutional identity and that there would be no differences in this relationship amongst students attending Historically Black Colleges and Universities (HBCUs) and those attending Predominately White Institutions (PWIs). The results suggested that there was a relationship between self-esteem and institutional identity; however, this relationship varied according to institutional type. Although a sense of belonging predicted self-esteem in all institutions, perceptions of others’ appraisal (public regard) of their institution predicted self-esteem in HBCU participants, while one’s personal appraisal (private regard) of their institution predicted self-esteem in PWI participants. The self-concept of Black male freshmen at PWIs appears to be explained by an internalized appraisal of their institution, while the opposite occurs in Black male freshmen at HBCUs. Further investigation may also suggest a difference in this relationship according to different HBCUs.