The purpose of this study was to evaluate the psychometric properties of a newly developed instrument intended to measure faculty competence as it pertains to their role as advisors, particularly in medical and professional programs. A total of 166 students completed the Faculty Advisor’s Skills and Behaviors Inventory (FASBI). The psychometric properties of the FASBI were evaluated using the Rasch Rating Scale Model. Results indicate the FASBI is a psychometrically-sound instrument capable of producing valid and reproducible measures.